[2025-11-03T17:00:01.809592] [INFO ] [MAIN ] Using last completed trading day: 2025-11-03 [2025-11-03T17:00:02.045109] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-11-03T17:00:02.045315] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-11-03T17:00:02.166016] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-11-03T17:00:02.166446] [WARN ] [STATE ] State set to: RUNNING [2025-11-03T17:00:02.166542] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-11-03T17:00:02.166598] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-11-03T17:00:02.166731] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-11-03T17:00:02.166846] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-11-03T17:00:03.741063] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-11-03T17:00:03.741213] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-11-03T17:00:03.741416] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-11-03T17:00:03.741958] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-11-03T17:00:03.742014] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-11-03T17:00:03.742045] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-11-03T17:00:03.742101] [INFO ] [MAIN ] Pruning stale symbols... [2025-11-03T17:00:03.742132] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-11-03T17:00:03.742160] [INFO ] [LOCAL ] Reading cached symbols list. [2025-11-03T17:00:03.742502] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-11-03T17:00:03.742537] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-11-03T17:00:03.742712] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-11-03T17:00:03.742769] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-11-03T17:00:03.742812] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-11-03T17:00:03.742849] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-11-03T17:00:03.748441] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/ERJ.csv (symbol ERJ no longer active). [2025-11-03T17:00:03.751531] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/primary_storage/EQV.csv (symbol EQV no longer active). [2025-11-03T17:00:03.753705] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-11-03T17:00:03.761402] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/ERJ.csv (symbol ERJ no longer active). [2025-11-03T17:00:03.764271] [DEBUG] [LOCAL ] Deleted /opt/tdm/output/data/derivative_storage/EQV.csv (symbol EQV no longer active). [2025-11-03T17:00:03.766330] [INFO ] [LOCAL ] Deleted 4 obsolete data files. [2025-11-03T17:00:03.766386] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-11-03T17:00:03.766422] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-11-03T17:00:03.766452] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-11-03T17:00:03.766508] [INFO ] [LOCAL ] Reading cached symbols list. [2025-11-03T17:00:03.766903] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-11-03T17:00:03.766955] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-11-03T17:00:03.766989] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-11-03T17:00:03.767018] [INFO ] [MAIN ] Running in parallel mode [2025-11-03T17:00:03.767204] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-11-03T17:00:04.388829] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:04.435882] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-11-03T17:00:04.430485] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:04.448863] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-11-03T17:00:04.505492] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:04.508029] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-11-03T17:00:04.508769] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-11-03T17:00:04.510027] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-11-03T17:00:04.510096] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-11-03T17:00:04.507846] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:04.540969] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-11-03T17:00:04.557304] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-11-03T17:00:04.586299] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-11-03T17:00:04.591623] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-11-03T17:00:04.615388] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-11-03T17:00:04.615592] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-11-03T17:00:05.048936] [DEBUG] [LOCAL ] A: Loaded 51183 existing records from primary storage. [2025-11-03T17:00:05.075415] [DEBUG] [LOCAL ] AA: Loaded 54402 existing records from primary storage. [2025-11-03T17:00:05.139043] [INFO ] [MAIN ] AA: Loaded 54402 existing records. [2025-11-03T17:00:05.112386] [INFO ] [MAIN ] A: Loaded 51183 existing records. [2025-11-03T17:00:05.507175] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:05.534730] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-11-03T17:00:05.860523] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:05.856566] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:05.882721] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-11-03T17:00:05.899462] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-11-03T17:00:05.899349] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:05.900199] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-11-03T17:00:05.899783] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-11-03T17:00:05.900427] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-11-03T17:00:05.901406] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-11-03T17:00:05.901505] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-11-03T17:00:05.901677] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-11-03T17:00:05.901611] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-11-03T17:00:06.166337] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-11-03T17:00:06.246959] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-11-03T17:00:06.667353] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:06.701475] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-11-03T17:00:06.706006] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T17:00:06.736947] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-11-03T17:00:06.735784] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:06.738165] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-11-03T17:00:06.933526] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T17:00:06.937812] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-11-03T17:00:07.011927] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-11-03T17:00:07.012865] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-11-03T17:00:07.289151] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-11-03T17:00:07.290120] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-11-03T17:00:07.656633] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T17:00:07.657558] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-11-03T17:00:07.864621] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-11-03T17:00:07.865490] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-11-03T17:00:08.022039] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T17:00:08.026002] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-11-03T17:00:08.110678] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-11-03T17:00:08.111535] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-11-03T17:00:08.207048] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T17:00:08.217071] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-11-03T17:00:08.354221] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-11-03T17:00:08.355978] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-11-03T17:00:08.358365] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-11-03T17:00:08.371382] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-11-03T17:00:08.620530] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-11-03T17:00:08.621425] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-11-03T17:00:08.796274] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T17:00:08.801240] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-11-03T17:00:08.832303] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-11-03T17:00:08.833244] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-11. [2025-11-03T17:00:09.368166] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-11 (0.53 seconds). [2025-11-03T17:00:09.368847] [INFO ] [REMOTE ] AAM: Full fetch complete (907 records). [2025-11-03T17:00:09.368921] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-11-03T17:00:09.584760] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-11-03T17:00:09.585033] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-11-03T17:00:09.585280] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-11-03T17:00:09.585354] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-11-03T17:00:09.585417] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-11-03T17:00:09.585455] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-11-03T17:00:09.585496] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-11-03T17:00:09.585558] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 5.8s. Estimated remaining: 3h 49m 21s. Rate: 10.3 symbols/min [2025-11-03T17:00:09.686369] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-11-03T17:00:09.732051] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-11-03T17:00:09.805131] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:09.856694] [DEBUG] [LOCAL ] AAP: Loaded 52313 existing records from primary storage. [2025-11-03T17:00:09.857001] [INFO ] [MAIN ] AAP: Loaded 52313 existing records. [2025-11-03T17:00:10.040472] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:10.041222] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-11-03T17:00:10.041568] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-11-03T17:00:10.048188] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-11-03T17:00:10.067223] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-11-03T17:00:10.073528] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T17:00:10.148406] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-11-03T17:00:10.160475] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-11-03T17:00:10.213906] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-11-03T17:00:10.481127] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:10.481718] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-11-03T17:00:11.103491] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T17:00:11.109094] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-11-03T17:00:11.290368] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T17:00:11.301121] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-11-03T17:00:11.737275] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T17:00:11.749984] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-11-03T17:00:11.986205] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-11-03T17:00:11.996254] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-11-03T17:00:12.042500] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T17:00:12.047898] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-11-03T17:00:12.458686] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T17:00:12.470320] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-11-03T17:00:12.920974] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T17:00:12.926991] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-11-03T17:00:13.104953] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:00:13.116939] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-11-03T17:00:13.177525] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T17:00:13.187299] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-11-03T17:00:13.755611] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T17:00:13.760962] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-11-03T17:00:13.980352] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T17:00:13.991740] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-11-03T17:00:14.722871] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T17:00:14.734843] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-11-03T17:00:14.753795] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T17:00:14.760729] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-11-03T17:00:14.868814] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-11-03T17:00:14.883569] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-11-03T17:00:15.262918] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T17:00:15.275260] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-11-03T17:00:15.612248] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-11-03T17:00:15.617766] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-11. [2025-11-03T17:00:16.015408] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T17:00:16.027103] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-11-03T17:00:16.297090] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T17:00:16.308030] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-11-03T17:00:16.625930] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T17:00:16.637026] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-11-03T17:00:17.520368] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-11 (1.90 seconds). [2025-11-03T17:00:17.521414] [INFO ] [REMOTE ] AAMI: Full fetch complete (33401 records). [2025-11-03T17:00:17.521496] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-11-03T17:00:17.879225] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-11-03T17:00:17.946609] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-11-03T17:00:17.985803] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-11-03T17:00:17.986036] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-11-03T17:00:17.986455] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-11-03T17:00:17.986673] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-11-03T17:00:17.988673] [DEBUG] [LOCAL ] AAMI: Trimmed 33401 records to 23763 (keeping 200 days of data) [2025-11-03T17:00:18.165550] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-11-03T17:00:18.163921] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T17:00:18.218468] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-11-03T17:00:18.211844] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-11-03T17:00:18.220046] [DEBUG] [LOCAL ] AAMI: Primary data saved (23763 records). [2025-11-03T17:00:18.220304] [INFO ] [MAIN ] AAMI: Full history saved. [2025-11-03T17:00:18.220406] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 14.4s. Estimated remaining: 4h 44m 44s. Rate: 8.3 symbols/min [2025-11-03T17:00:18.394543] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:18.427110] [DEBUG] [LOCAL ] AAT: Loaded 30351 existing records from primary storage. [2025-11-03T17:00:18.427428] [INFO ] [MAIN ] AAT: Loaded 30351 existing records. [2025-11-03T17:00:18.618012] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:18.618217] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-11-03T17:00:18.618266] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-11-03T17:00:18.618840] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-11-03T17:00:18.618907] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-11-03T17:00:18.997378] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:18.997775] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-11-03T17:00:19.361609] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T17:00:19.372515] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-11-03T17:00:19.687254] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T17:00:19.699744] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-11-03T17:00:19.757680] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-11-03T17:00:19.769079] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-11-03T17:00:21.200976] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-11-03T17:00:21.206990] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-11-03T17:00:21.271419] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T17:00:21.283142] [INFO ] [REMOTE ] A: Fetching primary data for 2025-11. [2025-11-03T17:00:21.348681] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:00:21.360066] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-11-03T17:00:21.848503] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-11-03T17:00:21.859835] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-11-03T17:00:22.156684] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T17:00:22.162489] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-11-03T17:00:23.183207] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-11-03T17:00:23.211847] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-11. [2025-11-03T17:00:23.212920] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T17:00:23.221087] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-11-03T17:00:23.327942] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-11 (2.04 seconds). [2025-11-03T17:00:23.330632] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T17:00:23.334548] [INFO ] [REMOTE ] A: Full fetch complete (73532 records). [2025-11-03T17:00:23.341092] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-11-03T17:00:23.342227] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-11-03T17:00:23.732232] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-11-03T17:00:23.732334] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-11-03T17:00:23.733269] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-11-03T17:00:23.733341] [DEBUG] [LOCAL ] A: Saving primary data. [2025-11-03T17:00:23.734933] [DEBUG] [LOCAL ] A: Trimmed 73532 records to 50436 (keeping 200 days of data) [2025-11-03T17:00:24.042546] [DEBUG] [LOCAL ] A: Primary data saved (50436 records). [2025-11-03T17:00:24.042713] [INFO ] [MAIN ] A: Full history saved. [2025-11-03T17:00:24.043128] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 20.3s. Estimated remaining: 4h 26m 11s. Rate: 8.9 symbols/min [2025-11-03T17:00:24.218741] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:24.219072] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-11-03T17:00:24.219119] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-11-03T17:00:24.219233] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-11-03T17:00:24.219277] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-11-03T17:00:24.219318] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-11-03T17:00:24.219395] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-11-03T17:00:24.587315] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:24.587924] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-11-03T17:00:24.613450] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:00:24.622871] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-11-03T17:00:24.751750] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T17:00:24.763223] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:00:24.764336] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-11-03T17:00:24.764483] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:00:24.764581] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-11-03T17:00:24.764777] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:00:24.764873] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-11-03T17:00:24.764972] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-11-03T17:00:24.765463] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-11-03T17:00:24.765577] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-11-03T17:00:24.766841] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-11-03T17:00:24.766920] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 0.7s. Estimated remaining: 3h 26m 40s. Rate: 11.4 symbols/min [2025-11-03T17:00:24.958688] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:24.982605] [DEBUG] [LOCAL ] AB: Loaded 24339 existing records from primary storage. [2025-11-03T17:00:24.982990] [INFO ] [MAIN ] AB: Loaded 24339 existing records. [2025-11-03T17:00:25.167822] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:25.168040] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-11-03T17:00:25.168089] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-11-03T17:00:25.168373] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-11-03T17:00:25.168413] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-11-03T17:00:25.526440] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:25.526925] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-11-03T17:00:25.557362] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T17:00:25.568539] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-11-03T17:00:26.194686] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T17:00:26.208676] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-11. [2025-11-03T17:00:26.259949] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-11 (3.05 seconds). [2025-11-03T17:00:26.261497] [INFO ] [REMOTE ] AA: Full fetch complete (77742 records). [2025-11-03T17:00:26.261596] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-11-03T17:00:26.674190] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T17:00:26.737424] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-11-03T17:00:26.737985] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-11-03T17:00:26.747311] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-11-03T17:00:26.760528] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-11-03T17:00:26.761399] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-11-03T17:00:26.762546] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T17:00:26.771138] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-11-03T17:00:26.773934] [DEBUG] [LOCAL ] AA: Trimmed 77742 records to 53622 (keeping 200 days of data) [2025-11-03T17:00:27.083351] [DEBUG] [LOCAL ] AA: Primary data saved (53622 records). [2025-11-03T17:00:27.083483] [INFO ] [MAIN ] AA: Full history saved. [2025-11-03T17:00:27.083895] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 23.3s. Estimated remaining: 3h 3m 30s. Rate: 12.9 symbols/min [2025-11-03T17:00:27.253532] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:27.299822] [DEBUG] [REMOTE ] AAP: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:00:27.301477] [WARN ] [REMOTE ] AAP: No data returned for month 2025-11 [2025-11-03T17:00:27.301606] [FATAL] [REMOTE ] AAP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:00:27.302463] [DEBUG] [LOCAL ] ABBV: Loaded 54454 existing records from primary storage. [2025-11-03T17:00:27.302702] [FATAL] [MAIN ] AAP: Failed to fetch primary data. [2025-11-03T17:00:27.302949] [WARN ] [MAIN ] AAP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:00:27.303043] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-11-03T17:00:27.303367] [INFO ] [MAIN ] ABBV: Loaded 54454 existing records. [2025-11-03T17:00:27.335129] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-11-03T17:00:27.379143] [INFO ] [LOCAL ] AAP: Starting deletion of derivative data. [2025-11-03T17:00:27.405669] [DEBUG] [LOCAL ] AAP: Deleted derivative data file. [2025-11-03T17:00:27.406226] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAP took 17.8s. Estimated remaining: 2h 34m 58s. Rate: 15.2 symbols/min [2025-11-03T17:00:27.621267] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:27.637381] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-11-03T17:00:27.693871] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-11-03T17:00:27.699050] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:27.700381] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-11-03T17:00:27.700703] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-11-03T17:00:27.883391] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T17:00:27.970038] [DEBUG] [LOCAL ] ABCB: Loaded 30555 existing records from primary storage. [2025-11-03T17:00:27.978123] [INFO ] [MAIN ] ABCB: Loaded 30555 existing records. [2025-11-03T17:00:27.977767] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-11-03T17:00:28.292534] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:28.309246] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-11-03T17:00:28.309534] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-11-03T17:00:28.315345] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:28.315914] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-11-03T17:00:28.316833] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-11-03T17:00:28.317067] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-11-03T17:00:28.668233] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-11-03T17:00:28.698048] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-11-03T17:00:28.719352] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:28.719733] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-11-03T17:00:29.074938] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T17:00:29.081613] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-11-03T17:00:29.654782] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T17:00:29.661272] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-11-03T17:00:29.783092] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T17:00:29.793866] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-11-03T17:00:29.826344] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T17:00:29.833024] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-11-03T17:00:29.909674] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:00:29.919324] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-11-03T17:00:30.441845] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T17:00:30.447952] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-11-03T17:00:30.657329] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-11-03T17:00:30.664490] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-11. [2025-11-03T17:00:31.003557] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T17:00:31.012034] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-11-03T17:00:31.429871] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-11-03T17:00:31.442429] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-11-03T17:00:31.462639] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T17:00:31.470446] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-11-03T17:00:31.946879] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T17:00:31.954472] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-11-03T17:00:32.206277] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-11 (1.54 seconds). [2025-11-03T17:00:32.207528] [INFO ] [REMOTE ] AAT: Full fetch complete (43280 records). [2025-11-03T17:00:32.207609] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-11-03T17:00:32.623830] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-11-03T17:00:32.624049] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-11-03T17:00:32.624618] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-11-03T17:00:32.624736] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-11-03T17:00:32.626150] [DEBUG] [LOCAL ] AAT: Trimmed 43280 records to 29937 (keeping 200 days of data) [2025-11-03T17:00:32.743489] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T17:00:32.786356] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-11-03T17:00:32.856705] [DEBUG] [LOCAL ] AAT: Primary data saved (29937 records). [2025-11-03T17:00:32.858947] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T17:00:32.859168] [INFO ] [MAIN ] AAT: Full history saved. [2025-11-03T17:00:32.861697] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAT took 14.6s. Estimated remaining: 2h 43m 25s. Rate: 14.4 symbols/min [2025-11-03T17:00:32.900028] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-11-03T17:00:33.046068] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:33.046345] [DEBUG] [LOCAL ] ABEV: No existing data file found in primary storage. [2025-11-03T17:00:33.046475] [WARN ] [MAIN ] ABEV: No existing data found, performing full refresh instead. [2025-11-03T17:00:33.046626] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-11-03T17:00:33.046802] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-11-03T17:00:33.046995] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-11-03T17:00:33.047096] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-11-03T17:00:33.388150] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-11-03T17:00:33.450115] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-11-03T17:00:33.475144] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:33.475676] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-11-03T17:00:33.742580] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T17:00:33.750970] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-11-03T17:00:33.868757] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T17:00:33.874280] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-11-03T17:00:34.398432] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T17:00:34.404203] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-11-03T17:00:34.600762] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T17:00:34.605861] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-11-03T17:00:34.730496] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T17:00:34.740873] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-11-03T17:00:35.361364] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T17:00:35.366838] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-11-03T17:00:35.454006] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-11-03T17:00:35.466857] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-11-03T17:00:35.541167] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T17:00:35.548545] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-11-03T17:00:36.119970] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T17:00:36.130671] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-11-03T17:00:36.146589] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-11-03T17:00:36.152415] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-11. [2025-11-03T17:00:36.346854] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T17:00:36.353789] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-11-03T17:00:36.902835] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T17:00:36.914034] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-11-03T17:00:37.160574] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-11-03T17:00:37.168936] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-11-03T17:00:37.357901] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-11 (1.21 seconds). [2025-11-03T17:00:37.359062] [INFO ] [REMOTE ] AB: Full fetch complete (43651 records). [2025-11-03T17:00:37.359160] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-11-03T17:00:37.773258] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-11-03T17:00:37.773631] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-11-03T17:00:37.774174] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-11-03T17:00:37.774480] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-11-03T17:00:37.775985] [DEBUG] [LOCAL ] AB: Trimmed 43651 records to 23774 (keeping 200 days of data) [2025-11-03T17:00:37.894708] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-11-03T17:00:37.910279] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-11-03T17:00:37.963382] [DEBUG] [LOCAL ] AB: Primary data saved (23774 records). [2025-11-03T17:00:37.963530] [INFO ] [MAIN ] AB: Full history saved. [2025-11-03T17:00:37.963732] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 13.2s. Estimated remaining: 2h 47m 59s. Rate: 14.0 symbols/min [2025-11-03T17:00:38.160215] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:38.162224] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T17:00:38.170175] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-11. [2025-11-03T17:00:38.184026] [DEBUG] [LOCAL ] ABG: Loaded 17583 existing records from primary storage. [2025-11-03T17:00:38.184235] [INFO ] [MAIN ] ABG: Loaded 17583 existing records. [2025-11-03T17:00:38.370723] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:38.370902] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-11-03T17:00:38.370950] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-11-03T17:00:38.371248] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-11-03T17:00:38.371316] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-11-03T17:00:38.747827] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:38.748217] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-11-03T17:00:38.788881] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-11-03T17:00:38.801847] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-11-03T17:00:39.489919] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T17:00:39.509566] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-11-03T17:00:39.522602] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T17:00:39.533845] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-11-03T17:00:39.851132] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-11 (1.68 seconds). [2025-11-03T17:00:39.852321] [INFO ] [REMOTE ] ABCB: Full fetch complete (44979 records). [2025-11-03T17:00:39.852396] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-11-03T17:00:40.270755] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-11-03T17:00:40.271020] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-11-03T17:00:40.278927] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-11-03T17:00:40.280391] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-11-03T17:00:40.281408] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T17:00:40.285691] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-11-03T17:00:40.287214] [DEBUG] [LOCAL ] ABCB: Trimmed 44979 records to 30043 (keeping 200 days of data) [2025-11-03T17:00:40.496383] [DEBUG] [LOCAL ] ABCB: Primary data saved (30043 records). [2025-11-03T17:00:40.496553] [INFO ] [MAIN ] ABCB: Full history saved. [2025-11-03T17:00:40.496709] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 13.1s. Estimated remaining: 2h 40m 19s. Rate: 14.7 symbols/min [2025-11-03T17:00:40.498503] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-11-03T17:00:40.604047] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-11-03T17:00:40.685526] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:40.714614] [DEBUG] [LOCAL ] ABM: Loaded 32032 existing records from primary storage. [2025-11-03T17:00:40.714936] [INFO ] [MAIN ] ABM: Loaded 32032 existing records. [2025-11-03T17:00:40.899811] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:40.900160] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-11-03T17:00:40.900325] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-11-03T17:00:40.900767] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-11-03T17:00:40.900827] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-11-03T17:00:41.059529] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-11-03T17:00:41.154309] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-11-03T17:00:41.276802] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T17:00:41.307188] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-11-03T17:00:41.355411] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:41.355958] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-11-03T17:00:42.135039] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T17:00:42.148701] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-11-03T17:00:42.320750] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T17:00:42.327038] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-11-03T17:00:42.397009] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T17:00:42.404062] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-11-03T17:00:42.451620] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T17:00:42.462844] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-11-03T17:00:43.143814] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T17:00:43.154277] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:00:43.155256] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-11-03T17:00:43.160625] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-11-03T17:00:43.525427] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T17:00:43.537054] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-11-03T17:00:43.609138] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-11-03T17:00:43.613033] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-11-03T17:00:43.903354] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T17:00:43.914916] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-11-03T17:00:44.005006] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T17:00:44.011931] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-11-03T17:00:44.370105] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:00:44.376311] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-11-03T17:00:45.142904] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:00:45.151575] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-11-03T17:00:45.167335] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T17:00:45.173075] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-11-03T17:00:45.238103] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T17:00:45.259685] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-11. [2025-11-03T17:00:45.471231] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T17:00:45.482543] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-11-03T17:00:45.915976] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T17:00:45.920163] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-11-03T17:00:45.990703] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-11-03T17:00:45.996395] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-11-03T17:00:46.650199] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T17:00:46.654918] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-11. [2025-11-03T17:00:46.853594] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T17:00:47.049118] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T17:00:47.134877] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-11-03T17:00:47.934962] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-11-03T17:00:47.987295] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-11 (1.33 seconds). [2025-11-03T17:00:47.988298] [INFO ] [REMOTE ] ABG: Full fetch complete (26886 records). [2025-11-03T17:00:47.988369] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-11-03T17:00:48.061164] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-11 (2.80 seconds). [2025-11-03T17:00:48.085438] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-11-03T17:00:48.096509] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-11-03T17:00:48.744273] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-11-03T17:00:48.771332] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-11-03T17:00:48.775351] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T17:00:48.782431] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-11-03T17:00:48.804856] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-11-03T17:00:48.824555] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-11-03T17:00:48.829249] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-11-03T17:00:48.829686] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-11-03T17:00:48.830497] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-11-03T17:00:48.830712] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-11-03T17:00:48.830815] [DEBUG] [LOCAL ] ABG: Trimmed 26886 records to 17221 (keeping 200 days of data) [2025-11-03T17:00:48.832814] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 53674 (keeping 200 days of data) [2025-11-03T17:00:49.056050] [DEBUG] [LOCAL ] ABG: Primary data saved (17221 records). [2025-11-03T17:00:49.066413] [INFO ] [MAIN ] ABG: Full history saved. [2025-11-03T17:00:49.070770] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABG took 11.1s. Estimated remaining: 2h 57m 54s. Rate: 13.2 symbols/min [2025-11-03T17:00:49.360273] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:49.366502] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-11-03T17:00:49.368496] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-11-03T17:00:49.369989] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-11-03T17:00:49.370061] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-11-03T17:00:49.372025] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-11-03T17:00:49.372103] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-11-03T17:00:49.828697] [DEBUG] [LOCAL ] ABBV: Primary data saved (53674 records). [2025-11-03T17:00:49.834742] [INFO ] [MAIN ] ABBV: Full history saved. [2025-11-03T17:00:49.842580] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABBV took 22.8s. Estimated remaining: 2h 44m 24s. Rate: 14.3 symbols/min [2025-11-03T17:00:50.140560] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:00:50.239591] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:50.240317] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-11-03T17:00:50.335264] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-11-03T17:00:50.364769] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:50.368637] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (2.43 seconds). [2025-11-03T17:00:50.434955] [DEBUG] [LOCAL ] ABT: Loaded 54405 existing records from primary storage. [2025-11-03T17:00:50.435286] [INFO ] [MAIN ] ABT: Loaded 54405 existing records. [2025-11-03T17:00:50.615621] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:00:50.615865] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-11-03T17:00:50.615915] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-11-03T17:00:50.616505] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-11-03T17:00:50.616565] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-11-03T17:00:50.973309] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:51.134864] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-11. [2025-11-03T17:00:51.489457] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T17:00:51.642577] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T17:00:51.934856] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-11-03T17:00:52.308897] [DEBUG] [REMOTE ] ABEV: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:00:52.309199] [WARN ] [REMOTE ] ABEV: No data returned for month 2025-11 [2025-11-03T17:00:52.309290] [FATAL] [REMOTE ] ABEV: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:00:52.309369] [FATAL] [MAIN ] ABEV: Failed to fetch primary data. [2025-11-03T17:00:52.309432] [WARN ] [MAIN ] ABEV: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:00:52.309505] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-11-03T17:00:52.309570] [DEBUG] [LOCAL ] ABEV: No primary data file found to delete. [2025-11-03T17:00:52.309605] [INFO ] [LOCAL ] ABEV: Starting deletion of derivative data. [2025-11-03T17:00:52.309669] [DEBUG] [LOCAL ] ABEV: No derivative data file found to delete. [2025-11-03T17:00:52.309738] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABEV took 19.4s. Estimated remaining: 2h 38m 42s. Rate: 14.8 symbols/min [2025-11-03T17:00:52.495627] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:52.495841] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-11-03T17:00:52.495883] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-11-03T17:00:52.496027] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-11-03T17:00:52.496147] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-11-03T17:00:52.496219] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-11-03T17:00:52.496277] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-11-03T17:00:52.742007] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-11-03T17:00:52.863803] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:53.104158] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-11-03T17:00:53.534869] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-11. [2025-11-03T17:00:54.265632] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T17:00:54.334856] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-11-03T17:00:54.932217] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T17:00:54.933477] [INFO ] [REMOTE ] ABM: Full fetch complete (45219 records). [2025-11-03T17:00:54.933588] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-11-03T17:00:55.138860] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-11-03T17:00:55.351906] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-11-03T17:00:55.363703] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-11-03T17:00:55.364875] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-11-03T17:00:55.365696] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T17:00:55.365821] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-11-03T17:00:55.374268] [DEBUG] [LOCAL ] ABM: Trimmed 45219 records to 31608 (keeping 200 days of data) [2025-11-03T17:00:55.564749] [DEBUG] [LOCAL ] ABM: Primary data saved (31608 records). [2025-11-03T17:00:55.564905] [INFO ] [MAIN ] ABM: Full history saved. [2025-11-03T17:00:55.566867] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 15.1s. Estimated remaining: 2h 36m 16s. Rate: 15.1 symbols/min [2025-11-03T17:00:55.753077] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:00:55.753240] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-11-03T17:00:55.753279] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-11-03T17:00:55.753393] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-11-03T17:00:55.753437] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-11-03T17:00:55.753481] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-11-03T17:00:55.753514] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-11-03T17:00:55.940420] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-11-03T17:00:56.141366] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:00:56.515917] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T17:00:56.734848] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-11-03T17:00:57.464764] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T17:00:57.534849] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-11-03T17:00:57.662447] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-11-03T17:00:58.334932] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-11-03T17:00:58.487203] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T17:00:59.095863] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T17:00:59.134824] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-11-03T17:00:59.934854] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-11-03T17:01:00.176493] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T17:01:00.734849] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-11-03T17:01:01.534831] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-11-03T17:01:01.622820] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-11-03T17:01:02.334828] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-11-03T17:01:02.405895] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-11-03T17:01:02.636539] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T17:01:03.134846] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-11-03T17:01:03.934838] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-11-03T17:01:04.121446] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-11-03T17:01:04.736880] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-11-03T17:01:04.739619] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-11-03T17:01:05.451213] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T17:01:05.534822] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-11-03T17:01:06.212533] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T17:01:06.334878] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-11-03T17:01:06.692891] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T17:01:07.134825] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-11-03T17:01:07.239172] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-11-03T17:01:07.934881] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-11-03T17:01:08.300474] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T17:01:08.734923] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-11-03T17:01:09.344922] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T17:01:09.534860] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-11-03T17:01:10.026954] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T17:01:10.159011] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T17:01:10.334891] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-11-03T17:01:11.134843] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-11-03T17:01:11.204263] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T17:01:11.934886] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-11-03T17:01:12.734966] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-11-03T17:01:13.030128] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-11-03T17:01:13.361423] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T17:01:13.534851] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-11-03T17:01:13.666544] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T17:01:14.334885] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-11-03T17:01:14.909795] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T17:01:15.057090] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T17:01:15.134871] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-11-03T17:01:15.866286] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T17:01:15.934884] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-11. [2025-11-03T17:01:16.734914] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-11-03T17:01:17.145400] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-11 (1.21 seconds). [2025-11-03T17:01:17.146447] [INFO ] [REMOTE ] ACA: Full fetch complete (34094 records). [2025-11-03T17:01:17.146520] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-11-03T17:01:17.520560] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-11-03T17:01:17.520710] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-11-03T17:01:17.521164] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-11-03T17:01:17.521228] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-11-03T17:01:17.522313] [DEBUG] [LOCAL ] ACA: Trimmed 34094 records to 21855 (keeping 200 days of data) [2025-11-03T17:01:17.577475] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-11-03T17:01:17.660282] [DEBUG] [LOCAL ] ACA: Primary data saved (21855 records). [2025-11-03T17:01:17.660404] [INFO ] [MAIN ] ACA: Full history saved. [2025-11-03T17:01:17.660475] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 25.4s. Estimated remaining: 3h 26m 54s. Rate: 11.4 symbols/min [2025-11-03T17:01:17.844566] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:01:17.866016] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-11-03T17:01:17.893492] [DEBUG] [LOCAL ] ACEL: Loaded 25783 existing records from primary storage. [2025-11-03T17:01:17.893764] [INFO ] [MAIN ] ACEL: Loaded 25783 existing records. [2025-11-03T17:01:18.081811] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:01:18.082039] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-11-03T17:01:18.082087] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-11-03T17:01:18.082363] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-11-03T17:01:18.082419] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-11-03T17:01:18.340064] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-11-03T17:01:18.483993] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:01:19.022798] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T17:01:19.134822] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-11-03T17:01:19.286681] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T17:01:19.934864] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-11-03T17:01:20.734903] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-11-03T17:01:20.953232] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-11-03T17:01:20.997441] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T17:01:21.534896] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-11-03T17:01:22.334894] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-11-03T17:01:22.526000] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-11-03T17:01:23.134836] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-11-03T17:01:23.198832] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-11-03T17:01:23.290715] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-11-03T17:01:23.934861] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-11-03T17:01:24.116619] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T17:01:24.734883] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-11. [2025-11-03T17:01:25.442317] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-11-03T17:01:25.534817] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-11-03T17:01:26.334862] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-11. [2025-11-03T17:01:26.753816] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T17:01:27.134927] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-11-03T17:01:27.437266] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-11 (2.70 seconds). [2025-11-03T17:01:27.438871] [INFO ] [REMOTE ] ABT: Full fetch complete (77777 records). [2025-11-03T17:01:27.438987] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-11-03T17:01:27.831833] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-11-03T17:01:27.831942] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-11-03T17:01:27.832677] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-11-03T17:01:27.832744] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-11-03T17:01:27.834280] [DEBUG] [LOCAL ] ABT: Trimmed 77777 records to 53625 (keeping 200 days of data) [2025-11-03T17:01:27.938766] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-11-03T17:01:28.163600] [DEBUG] [LOCAL ] ABT: Primary data saved (53625 records). [2025-11-03T17:01:28.163752] [INFO ] [MAIN ] ABT: Full history saved. [2025-11-03T17:01:28.164707] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABT took 38.3s. Estimated remaining: 3h 40m 28s. Rate: 10.7 symbols/min [2025-11-03T17:01:28.336244] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:01:28.339828] [DEBUG] [LOCAL ] ACHR: No existing data file found in primary storage. [2025-11-03T17:01:28.340050] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-11 (2.01 seconds). [2025-11-03T17:01:28.340172] [WARN ] [MAIN ] ACHR: No existing data found, performing full refresh instead. [2025-11-03T17:01:28.341664] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-11-03T17:01:28.341915] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-11-03T17:01:28.342087] [DEBUG] [LOCAL ] ACHR: No primary data file found to delete. [2025-11-03T17:01:28.342413] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-11-03T17:01:28.342187] [INFO ] [REMOTE ] ACCO: Full fetch complete (53702 records). [2025-11-03T17:01:28.381307] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-11-03T17:01:28.996819] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:01:29.015800] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-11-03T17:01:29.153565] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-11-03T17:01:29.161464] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-11-03T17:01:29.165616] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-11-03T17:01:29.167061] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-11-03T17:01:29.167388] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-11-03T17:01:29.206818] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T17:01:29.212511] [DEBUG] [LOCAL ] ACCO: Trimmed 53702 records to 36114 (keeping 200 days of data) [2025-11-03T17:01:29.423947] [DEBUG] [LOCAL ] ACCO: Primary data saved (36114 records). [2025-11-03T17:01:29.424079] [INFO ] [MAIN ] ACCO: Full history saved. [2025-11-03T17:01:29.424152] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ACCO took 33.9s. Estimated remaining: 3h 29m 41s. Rate: 11.2 symbols/min [2025-11-03T17:01:29.540002] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-11. [2025-11-03T17:01:29.600584] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:01:29.647818] [DEBUG] [LOCAL ] ACI: Loaded 54058 existing records from primary storage. [2025-11-03T17:01:29.648113] [INFO ] [MAIN ] ACI: Loaded 54058 existing records. [2025-11-03T17:01:29.825091] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:01:29.825311] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-11-03T17:01:29.825378] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-11-03T17:01:29.825996] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-11-03T17:01:29.826054] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-11-03T17:01:30.173058] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:01:30.334822] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-11-03T17:01:31.134915] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-11-03T17:01:31.209891] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-11-03T17:01:31.807014] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T17:01:31.934817] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-11-03T17:01:31.981837] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-11 (2.44 seconds). [2025-11-03T17:01:31.983287] [INFO ] [REMOTE ] ABR: Full fetch complete (75359 records). [2025-11-03T17:01:31.983375] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-11-03T17:01:32.126169] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T17:01:32.405969] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-11-03T17:01:32.406047] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-11-03T17:01:32.406791] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-11-03T17:01:32.406856] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-11-03T17:01:32.408360] [DEBUG] [LOCAL ] ABR: Trimmed 75359 records to 51778 (keeping 200 days of data) [2025-11-03T17:01:32.706809] [DEBUG] [LOCAL ] ABR: Primary data saved (51778 records). [2025-11-03T17:01:32.706938] [INFO ] [MAIN ] ABR: Full history saved. [2025-11-03T17:01:32.707009] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ABR took 43.6s. Estimated remaining: 3h 24m 49s. Rate: 11.5 symbols/min [2025-11-03T17:01:32.745029] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-11-03T17:01:32.884398] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:01:32.922785] [DEBUG] [LOCAL ] ACM: Loaded 42773 existing records from primary storage. [2025-11-03T17:01:32.923088] [INFO ] [MAIN ] ACM: Loaded 42773 existing records. [2025-11-03T17:01:33.103720] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:01:33.103967] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-11-03T17:01:33.104017] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-11-03T17:01:33.104430] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-11-03T17:01:33.104488] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-11-03T17:01:33.469096] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:01:33.494319] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T17:01:33.534812] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-11-03T17:01:33.922756] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:01:34.334873] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-11-03T17:01:34.902591] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:01:35.134901] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-11-03T17:01:35.541915] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T17:01:35.934869] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-11-03T17:01:36.601824] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T17:01:36.734846] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-11-03T17:01:37.371300] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T17:01:37.534868] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-11-03T17:01:38.004189] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-11-03T17:01:38.334865] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-11-03T17:01:38.665242] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T17:01:39.134897] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-11-03T17:01:39.934822] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-11-03T17:01:40.090017] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-11-03T17:01:40.625160] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-11-03T17:01:40.734827] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-11-03T17:01:41.265494] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T17:01:41.534902] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-11-03T17:01:42.335840] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-11-03T17:01:43.061913] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-11-03T17:01:43.144590] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-11-03T17:01:43.151228] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T17:01:43.454357] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-11-03T17:01:43.934881] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-11-03T17:01:44.734861] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-11-03T17:01:45.206232] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T17:01:45.376980] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-11-03T17:01:45.534892] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-11-03T17:01:45.716428] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T17:01:46.334943] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-11-03T17:01:46.951243] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T17:01:47.134883] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-11-03T17:01:47.733325] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T17:01:47.934880] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-11-03T17:01:48.734850] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-11-03T17:01:48.801925] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T17:01:49.171406] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-11-03T17:01:49.534846] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-11-03T17:01:49.841533] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T17:01:50.214196] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-11-03T17:01:50.334869] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-11-03T17:01:51.134856] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-11. [2025-11-03T17:01:51.698554] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T17:01:51.934859] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-11-03T17:01:52.504638] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-11 (1.37 seconds). [2025-11-03T17:01:52.505774] [INFO ] [REMOTE ] ACEL: Full fetch complete (38715 records). [2025-11-03T17:01:52.505855] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-11-03T17:01:52.743540] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-11-03T17:01:52.878949] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-11-03T17:01:52.879027] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-11-03T17:01:52.879426] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-11-03T17:01:52.879468] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-11-03T17:01:52.880287] [DEBUG] [LOCAL ] ACEL: Trimmed 38715 records to 25228 (keeping 200 days of data) [2025-11-03T17:01:53.020153] [DEBUG] [LOCAL ] ACEL: Primary data saved (25228 records). [2025-11-03T17:01:53.020292] [INFO ] [MAIN ] ACEL: Full history saved. [2025-11-03T17:01:53.020372] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 35.4s. Estimated remaining: 3h 57m 31s. Rate: 9.9 symbols/min [2025-11-03T17:01:53.197108] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:01:53.197403] [DEBUG] [LOCAL ] ACN: No existing data file found in primary storage. [2025-11-03T17:01:53.197464] [WARN ] [MAIN ] ACN: No existing data found, performing full refresh instead. [2025-11-03T17:01:53.197579] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-11-03T17:01:53.197623] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-11-03T17:01:53.197720] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-11-03T17:01:53.197769] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-11-03T17:01:53.538692] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-11-03T17:01:53.607537] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:01:53.613342] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-11-03T17:01:54.177942] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T17:01:54.334884] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-11-03T17:01:55.134862] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-11-03T17:01:55.590815] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T17:01:55.934833] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-11-03T17:01:56.120184] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-11-03T17:01:56.346920] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T17:01:56.734847] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-11-03T17:01:57.486925] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T17:01:57.534847] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-11-03T17:01:58.334855] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-11-03T17:01:58.961151] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T17:01:59.006906] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-11-03T17:01:59.134861] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-11-03T17:01:59.548370] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T17:01:59.934864] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-11-03T17:02:00.734867] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-11-03T17:02:01.422541] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-11-03T17:02:01.534894] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-11-03T17:02:01.728546] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-11-03T17:02:02.064283] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T17:02:02.334881] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-11-03T17:02:03.134880] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-11. [2025-11-03T17:02:03.487960] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-11-03T17:02:03.934888] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-11-03T17:02:04.062601] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-11-03T17:02:04.126397] [DEBUG] [REMOTE ] ACM: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:02:04.126728] [WARN ] [REMOTE ] ACM: No data returned for month 2025-11 [2025-11-03T17:02:04.126814] [FATAL] [REMOTE ] ACM: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:02:04.126921] [FATAL] [MAIN ] ACM: Failed to fetch primary data. [2025-11-03T17:02:04.126988] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:02:04.127056] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-11-03T17:02:04.127177] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-11-03T17:02:04.127239] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-11-03T17:02:04.131417] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-11-03T17:02:04.133108] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACM took 31.4s. Estimated remaining: 4h 7m 48s. Rate: 9.5 symbols/min [2025-11-03T17:02:04.317278] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:04.346923] [DEBUG] [LOCAL ] ACP: Loaded 31123 existing records from primary storage. [2025-11-03T17:02:04.347267] [INFO ] [MAIN ] ACP: Loaded 31123 existing records. [2025-11-03T17:02:04.530790] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:04.531042] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-11-03T17:02:04.531091] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-11-03T17:02:04.531421] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-11-03T17:02:04.531478] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-11-03T17:02:04.739999] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-11. [2025-11-03T17:02:04.928561] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:05.534909] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-11-03T17:02:06.334884] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-11-03T17:02:06.740494] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-11-03T17:02:06.841896] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T17:02:07.134871] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-11-03T17:02:07.142355] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-11 (2.40 seconds). [2025-11-03T17:02:07.143863] [INFO ] [REMOTE ] ACI: Full fetch complete (77230 records). [2025-11-03T17:02:07.143962] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-11-03T17:02:07.537180] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-11-03T17:02:07.537275] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-11-03T17:02:07.538028] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-11-03T17:02:07.538093] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-11-03T17:02:07.539794] [DEBUG] [LOCAL ] ACI: Trimmed 77230 records to 53278 (keeping 200 days of data) [2025-11-03T17:02:07.683076] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T17:02:07.887596] [DEBUG] [LOCAL ] ACI: Primary data saved (53278 records). [2025-11-03T17:02:07.887752] [INFO ] [MAIN ] ACI: Full history saved. [2025-11-03T17:02:07.888603] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACI took 38.5s. Estimated remaining: 4h 2m 39s. Rate: 9.7 symbols/min [2025-11-03T17:02:07.946613] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-11. [2025-11-03T17:02:08.070611] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:08.070818] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-11-03T17:02:08.070862] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-11-03T17:02:08.070969] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-11-03T17:02:08.071012] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-11-03T17:02:08.071056] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-11-03T17:02:08.071091] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-11-03T17:02:08.432357] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:08.734852] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-11-03T17:02:08.830517] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-11-03T17:02:09.534896] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-11-03T17:02:09.684713] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T17:02:10.334848] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-11-03T17:02:10.805019] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-11-03T17:02:11.097700] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T17:02:11.134829] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-11-03T17:02:11.887221] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-11 (3.94 seconds). [2025-11-03T17:02:11.888759] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-11-03T17:02:11.888865] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-11-03T17:02:11.939997] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-11-03T17:02:12.295215] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-11-03T17:02:12.295309] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-11-03T17:02:12.296125] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-11-03T17:02:12.296194] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-11-03T17:02:12.297871] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-11-03T17:02:12.625214] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-11-03T17:02:12.625453] [INFO ] [MAIN ] ACHR: Full history saved. [2025-11-03T17:02:12.625888] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACHR took 44.5s. Estimated remaining: 3h 59m 49s. Rate: 9.8 symbols/min [2025-11-03T17:02:12.742325] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-11-03T17:02:12.805552] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:12.838846] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-11-03T17:02:12.871956] [DEBUG] [LOCAL ] ACRE: Loaded 32786 existing records from primary storage. [2025-11-03T17:02:12.872286] [INFO ] [MAIN ] ACRE: Loaded 32786 existing records. [2025-11-03T17:02:13.058202] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:13.058552] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-11-03T17:02:13.058686] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-11-03T17:02:13.059141] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-11-03T17:02:13.059202] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-11-03T17:02:13.321572] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:02:13.392765] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-11-03T17:02:13.508074] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:13.534819] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-11-03T17:02:14.334858] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-11-03T17:02:14.853145] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:02:15.134833] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-11-03T17:02:15.419997] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T17:02:15.743242] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T17:02:15.934853] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-11-03T17:02:16.734856] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-11-03T17:02:17.007637] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T17:02:17.534851] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-11-03T17:02:17.694255] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T17:02:18.334899] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-11-03T17:02:18.564330] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T17:02:19.134890] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-11-03T17:02:19.934845] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-11-03T17:02:20.012949] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-11-03T17:02:20.084733] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T17:02:20.734866] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-11-03T17:02:21.211404] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T17:02:21.534857] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-11-03T17:02:21.799530] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T17:02:22.334856] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-11-03T17:02:22.575795] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T17:02:23.134839] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-11-03T17:02:23.224211] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T17:02:23.934823] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-11-03T17:02:24.124243] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-11-03T17:02:24.734824] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-11-03T17:02:24.869026] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T17:02:25.534878] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-11-03T17:02:26.334869] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-11-03T17:02:26.362234] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T17:02:26.573526] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-11-03T17:02:26.885504] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-11-03T17:02:27.134906] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-11. [2025-11-03T17:02:27.905048] [DEBUG] [REMOTE ] ACP: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:02:27.905357] [WARN ] [REMOTE ] ACP: No data returned for month 2025-11 [2025-11-03T17:02:27.905444] [FATAL] [REMOTE ] ACP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:02:27.905520] [FATAL] [MAIN ] ACP: Failed to fetch primary data. [2025-11-03T17:02:27.905583] [WARN ] [MAIN ] ACP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:02:27.905683] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-11-03T17:02:27.905785] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-11-03T17:02:27.905843] [INFO ] [LOCAL ] ACP: Starting deletion of derivative data. [2025-11-03T17:02:27.906058] [DEBUG] [LOCAL ] ACP: Deleted derivative data file. [2025-11-03T17:02:27.906144] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACP took 23.8s. Estimated remaining: 4h 15m 57s. Rate: 9.2 symbols/min [2025-11-03T17:02:27.939613] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-11-03T17:02:28.083257] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:28.091346] [DEBUG] [LOCAL ] ACV: Loaded 7443 existing records from primary storage. [2025-11-03T17:02:28.091554] [INFO ] [MAIN ] ACV: Loaded 7443 existing records. [2025-11-03T17:02:28.271611] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:28.271853] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-11-03T17:02:28.271903] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-11-03T17:02:28.272115] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-11-03T17:02:28.272174] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-11-03T17:02:28.680815] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:28.734908] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-11-03T17:02:29.294411] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-11-03T17:02:29.294075] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T17:02:29.534928] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-11-03T17:02:30.137347] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T17:02:30.334875] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-11-03T17:02:30.844428] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-11-03T17:02:31.134865] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-11. [2025-11-03T17:02:31.225505] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-11 (0.09 seconds). [2025-11-03T17:02:31.227365] [INFO ] [REMOTE ] ACN: Full fetch complete (77430 records). [2025-11-03T17:02:31.227489] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-11-03T17:02:31.607606] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-11-03T17:02:31.607721] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-11-03T17:02:31.608445] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-11-03T17:02:31.608490] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-11-03T17:02:31.609982] [DEBUG] [LOCAL ] ACN: Trimmed 77430 records to 53426 (keeping 200 days of data) [2025-11-03T17:02:31.934435] [DEBUG] [LOCAL ] ACN: Primary data saved (53426 records). [2025-11-03T17:02:31.934565] [INFO ] [MAIN ] ACN: Full history saved. [2025-11-03T17:02:31.934636] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACN took 38.9s. Estimated remaining: 4h 11m 34s. Rate: 9.3 symbols/min [2025-11-03T17:02:31.940113] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-11-03T17:02:32.105972] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:32.147189] [DEBUG] [LOCAL ] ACVA: Loaded 49783 existing records from primary storage. [2025-11-03T17:02:32.147490] [INFO ] [MAIN ] ACVA: Loaded 49783 existing records. [2025-11-03T17:02:32.323000] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:32.323235] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-11-03T17:02:32.323283] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-11-03T17:02:32.323688] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-11-03T17:02:32.323746] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-11-03T17:02:32.695665] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:32.734818] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-11-03T17:02:33.122433] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T17:02:33.134634] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T17:02:33.534874] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-11-03T17:02:33.993534] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-11-03T17:02:34.334858] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-11-03T17:02:35.134905] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-11-03T17:02:35.428283] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T17:02:35.934818] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-11-03T17:02:35.996076] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T17:02:36.734850] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-11-03T17:02:37.237662] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:02:37.534918] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-11-03T17:02:37.824170] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T17:02:38.019287] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-11-03T17:02:38.334871] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-11. [2025-11-03T17:02:39.134910] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-11-03T17:02:39.644314] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T17:02:39.804888] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-11 (1.47 seconds). [2025-11-03T17:02:39.806092] [INFO ] [REMOTE ] ACRE: Full fetch complete (48746 records). [2025-11-03T17:02:39.806172] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-11-03T17:02:39.939964] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-11-03T17:02:40.210779] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-11-03T17:02:40.210866] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-11-03T17:02:40.211378] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-11-03T17:02:40.211419] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-11-03T17:02:40.212519] [DEBUG] [LOCAL ] ACRE: Trimmed 48746 records to 32126 (keeping 200 days of data) [2025-11-03T17:02:40.398517] [DEBUG] [LOCAL ] ACRE: Primary data saved (32126 records). [2025-11-03T17:02:40.398675] [INFO ] [MAIN ] ACRE: Full history saved. [2025-11-03T17:02:40.399788] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACRE took 27.8s. Estimated remaining: 4h 14m 45s. Rate: 9.2 symbols/min [2025-11-03T17:02:40.582760] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:40.582948] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-11-03T17:02:40.582986] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-11-03T17:02:40.583098] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-11-03T17:02:40.583160] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-11-03T17:02:40.583229] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-11-03T17:02:40.583274] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-11-03T17:02:40.742743] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-11-03T17:02:40.972332] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:41.249401] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T17:02:41.289383] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:02:41.534886] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-11-03T17:02:41.932445] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T17:02:42.334899] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-11. [2025-11-03T17:02:42.996855] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T17:02:42.997641] [INFO ] [REMOTE ] ACR: Full fetch complete (8613 records). [2025-11-03T17:02:42.997739] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-11-03T17:02:43.140192] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-11-03T17:02:43.322287] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:02:43.350315] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-11-03T17:02:43.360429] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:02:43.366838] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-11-03T17:02:43.366731] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-11-03T17:02:43.366918] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-11-03T17:02:43.367245] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-11-03T17:02:43.367323] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-11-03T17:02:43.366997] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:02:43.367509] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-11-03T17:02:43.367941] [DEBUG] [LOCAL ] ACR: Trimmed 8613 records to 5241 (keeping 200 days of data) [2025-11-03T17:02:43.368009] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-11-03T17:02:43.368105] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-11-03T17:02:43.368422] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-11-03T17:02:43.368493] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. AD took 3.0s. Estimated remaining: 4h 9m 5s. Rate: 9.4 symbols/min [2025-11-03T17:02:43.505445] [DEBUG] [LOCAL ] ACR: Primary data saved (5241 records). [2025-11-03T17:02:43.505852] [INFO ] [MAIN ] ACR: Full history saved. [2025-11-03T17:02:43.511309] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. ACR took 35.6s. Estimated remaining: 3h 59m 37s. Rate: 9.8 symbols/min [2025-11-03T17:02:43.678243] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:43.749945] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:43.808287] [DEBUG] [LOCAL ] ADCT: Loaded 36390 existing records from primary storage. [2025-11-03T17:02:43.809580] [INFO ] [MAIN ] ADCT: Loaded 36390 existing records. [2025-11-03T17:02:43.842129] [DEBUG] [LOCAL ] ADC: Loaded 46954 existing records from primary storage. [2025-11-03T17:02:43.880486] [INFO ] [MAIN ] ADC: Loaded 46954 existing records. [2025-11-03T17:02:43.945990] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-11-03T17:02:44.134476] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:44.157438] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-11-03T17:02:44.175033] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-11-03T17:02:44.177056] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-11-03T17:02:44.191798] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-11-03T17:02:44.228127] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:44.239603] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-11-03T17:02:44.266302] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-11-03T17:02:44.287979] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-11-03T17:02:44.296151] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-11-03T17:02:44.739750] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-11-03T17:02:44.845883] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:44.929274] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:45.383714] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T17:02:45.534841] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-11-03T17:02:45.573668] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T17:02:46.334873] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-11-03T17:02:46.753763] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T17:02:46.854279] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:02:47.134854] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-11-03T17:02:47.579387] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-11-03T17:02:47.934881] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-11-03T17:02:48.334976] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T17:02:48.734904] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-11-03T17:02:49.150332] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-11-03T17:02:49.534850] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-11-03T17:02:50.035378] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-11-03T17:02:50.334842] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-11-03T17:02:51.134883] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-11-03T17:02:51.329140] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T17:02:51.934906] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-11-03T17:02:52.347297] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T17:02:52.734904] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-11-03T17:02:53.246272] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T17:02:53.310424] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-11-03T17:02:53.534895] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-11. [2025-11-03T17:02:54.334855] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-11-03T17:02:54.365038] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-11 (0.83 seconds). [2025-11-03T17:02:54.365788] [INFO ] [REMOTE ] ACV: Full fetch complete (10767 records). [2025-11-03T17:02:54.365857] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-11-03T17:02:54.725567] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-11-03T17:02:54.725686] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-11-03T17:02:54.725965] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-11-03T17:02:54.726020] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-11-03T17:02:54.726491] [DEBUG] [LOCAL ] ACV: Trimmed 10767 records to 7376 (keeping 200 days of data) [2025-11-03T17:02:54.769897] [DEBUG] [LOCAL ] ACV: Primary data saved (7376 records). [2025-11-03T17:02:54.770028] [INFO ] [MAIN ] ACV: Full history saved. [2025-11-03T17:02:54.770105] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ACV took 26.9s. Estimated remaining: 4h 6m 54s. Rate: 9.5 symbols/min [2025-11-03T17:02:54.948993] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:02:54.999279] [DEBUG] [LOCAL ] ADM: Loaded 54151 existing records from primary storage. [2025-11-03T17:02:54.999783] [INFO ] [MAIN ] ADM: Loaded 54151 existing records. [2025-11-03T17:02:55.144266] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-11-03T17:02:55.191303] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:02:55.191946] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-11-03T17:02:55.192111] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-11-03T17:02:55.192763] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-11-03T17:02:55.192842] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-11-03T17:02:55.544845] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:02:55.673519] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:02:55.934859] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-11-03T17:02:56.458026] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T17:02:56.734851] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-11-03T17:02:57.447422] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T17:02:57.535709] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-11-03T17:02:57.539510] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-11-03T17:02:58.334838] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-11-03T17:02:58.915966] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T17:02:59.134858] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-11-03T17:02:59.855285] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T17:02:59.934819] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-11-03T17:02:59.988076] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-11-03T17:03:00.734843] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-11-03T17:03:01.534808] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-11-03T17:03:01.611819] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-11-03T17:03:02.061875] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T17:03:02.334865] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-11-03T17:03:02.776603] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T17:03:03.134964] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-11-03T17:03:03.934892] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-11-03T17:03:03.997805] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-11-03T17:03:04.284953] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T17:03:04.734943] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-11-03T17:03:05.011444] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T17:03:05.535059] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-11-03T17:03:06.070487] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T17:03:06.334948] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-11-03T17:03:06.583347] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T17:03:07.134867] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-11-03T17:03:07.722407] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:03:07.934819] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-11-03T17:03:08.509059] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T17:03:08.734898] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-11-03T17:03:09.212919] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T17:03:09.534900] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-11-03T17:03:10.256840] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T17:03:10.334841] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-11-03T17:03:10.956620] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:03:11.134851] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-11. [2025-11-03T17:03:11.779947] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T17:03:11.934877] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-11-03T17:03:12.451489] [DEBUG] [REMOTE ] ACVA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:03:12.451841] [WARN ] [REMOTE ] ACVA: No data returned for month 2025-11 [2025-11-03T17:03:12.451926] [FATAL] [REMOTE ] ACVA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:03:12.452002] [FATAL] [MAIN ] ACVA: Failed to fetch primary data. [2025-11-03T17:03:12.452064] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:03:12.452152] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-11-03T17:03:12.452216] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-11-03T17:03:12.452250] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-11-03T17:03:12.452582] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-11-03T17:03:12.452697] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ACVA took 40.5s. Estimated remaining: 4h 22m 35s. Rate: 8.9 symbols/min [2025-11-03T17:03:12.629782] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:12.670060] [DEBUG] [LOCAL ] ADNT: Loaded 46443 existing records from primary storage. [2025-11-03T17:03:12.670391] [INFO ] [MAIN ] ADNT: Loaded 46443 existing records. [2025-11-03T17:03:12.740136] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-11-03T17:03:12.857557] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:03:12.857840] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-11-03T17:03:12.857891] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-11-03T17:03:12.858199] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-11-03T17:03:12.858258] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-11-03T17:03:13.239475] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:03:13.261796] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T17:03:13.534861] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-11-03T17:03:14.040850] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T17:03:14.334855] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-11-03T17:03:14.947383] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T17:03:15.134860] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-11-03T17:03:15.665032] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T17:03:15.934857] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-11. [2025-11-03T17:03:16.325869] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T17:03:16.734899] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-11-03T17:03:17.534856] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-11-03T17:03:17.666423] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-11 (1.73 seconds). [2025-11-03T17:03:17.668565] [INFO ] [REMOTE ] ADCT: Full fetch complete (51552 records). [2025-11-03T17:03:17.668695] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-11-03T17:03:18.086448] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-11-03T17:03:18.086574] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-11-03T17:03:18.087291] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-11-03T17:03:18.095138] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-11-03T17:03:18.109866] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T17:03:18.119262] [DEBUG] [LOCAL ] ADCT: Trimmed 51552 records to 36204 (keeping 200 days of data) [2025-11-03T17:03:18.316122] [DEBUG] [LOCAL ] ADCT: Primary data saved (36204 records). [2025-11-03T17:03:18.316296] [INFO ] [MAIN ] ADCT: Full history saved. [2025-11-03T17:03:18.317584] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ADCT took 34.8s. Estimated remaining: 4h 21m 18s. Rate: 8.9 symbols/min [2025-11-03T17:03:18.339944] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-11-03T17:03:18.495574] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:18.543199] [DEBUG] [LOCAL ] ADT: Loaded 54196 existing records from primary storage. [2025-11-03T17:03:18.543489] [INFO ] [MAIN ] ADT: Loaded 54196 existing records. [2025-11-03T17:03:18.741991] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:03:18.742228] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-11-03T17:03:18.742300] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-11-03T17:03:18.742901] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-11-03T17:03:18.742966] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-11-03T17:03:19.127536] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:03:19.139956] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-11-03T17:03:19.153594] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-11-03T17:03:19.600442] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T17:03:19.934897] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-11-03T17:03:20.547291] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T17:03:20.734858] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-11-03T17:03:21.413848] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T17:03:21.534891] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-11-03T17:03:22.334910] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-11-03T17:03:23.008883] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-11-03T17:03:23.095779] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-11-03T17:03:23.134809] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-11-03T17:03:23.803831] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T17:03:23.934857] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-11-03T17:03:24.674245] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-11-03T17:03:24.734843] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-11-03T17:03:25.116538] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T17:03:25.534934] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-11. [2025-11-03T17:03:26.053596] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T17:03:26.334830] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-11-03T17:03:27.134974] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-11-03T17:03:27.360970] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T17:03:27.362374] [INFO ] [REMOTE ] ADC: Full fetch complete (66920 records). [2025-11-03T17:03:27.362475] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-11-03T17:03:27.765010] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-11-03T17:03:27.765198] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-11-03T17:03:27.765920] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-11-03T17:03:27.765998] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-11-03T17:03:27.767474] [DEBUG] [LOCAL ] ADC: Trimmed 66920 records to 46248 (keeping 200 days of data) [2025-11-03T17:03:27.950697] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-11-03T17:03:28.012729] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-11-03T17:03:28.087828] [DEBUG] [LOCAL ] ADC: Primary data saved (46248 records). [2025-11-03T17:03:28.087951] [INFO ] [MAIN ] ADC: Full history saved. [2025-11-03T17:03:28.088051] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADC took 44.7s. Estimated remaining: 4h 25m 10s. Rate: 8.8 symbols/min [2025-11-03T17:03:28.263490] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:28.287939] [DEBUG] [LOCAL ] ADX: Loaded 27962 existing records from primary storage. [2025-11-03T17:03:28.288203] [INFO ] [MAIN ] ADX: Loaded 27962 existing records. [2025-11-03T17:03:28.478335] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:03:28.478691] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-11-03T17:03:28.478847] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-11-03T17:03:28.479344] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-11-03T17:03:28.479403] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-11-03T17:03:28.689674] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T17:03:28.762219] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-11. [2025-11-03T17:03:28.893583] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:03:29.456469] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-11-03T17:03:29.534848] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-11-03T17:03:29.963187] [DEBUG] [REMOTE ] ADM: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:03:29.963485] [WARN ] [REMOTE ] ADM: No data returned for month 2025-11 [2025-11-03T17:03:29.963576] [FATAL] [REMOTE ] ADM: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:03:29.963698] [FATAL] [MAIN ] ADM: Failed to fetch primary data. [2025-11-03T17:03:29.963779] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:03:29.963864] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-11-03T17:03:29.963952] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-11-03T17:03:29.964010] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-11-03T17:03:29.964210] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-11-03T17:03:29.964324] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADM took 35.2s. Estimated remaining: 4h 18m 51s. Rate: 9.0 symbols/min [2025-11-03T17:03:30.133036] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:30.133235] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-11-03T17:03:30.133273] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-11-03T17:03:30.133389] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-11-03T17:03:30.133430] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-11-03T17:03:30.133471] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-11-03T17:03:30.133502] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-11-03T17:03:30.340003] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-11-03T17:03:30.503025] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:03:31.015436] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T17:03:31.134910] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-11-03T17:03:31.498198] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T17:03:31.934835] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-11-03T17:03:32.066974] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T17:03:32.734851] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-11-03T17:03:33.359226] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T17:03:33.534846] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-11-03T17:03:33.906460] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T17:03:34.334865] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-11-03T17:03:35.032827] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T17:03:35.134821] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-11-03T17:03:35.249805] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T17:03:35.934885] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-11-03T17:03:36.734834] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-11-03T17:03:36.809757] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-11-03T17:03:37.037146] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T17:03:37.534856] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-11-03T17:03:37.868549] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T17:03:38.334868] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-11-03T17:03:38.614142] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T17:03:39.134870] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-11-03T17:03:39.468496] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T17:03:39.934870] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-11-03T17:03:40.656834] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T17:03:40.734850] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-11-03T17:03:40.958762] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T17:03:41.534849] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-11-03T17:03:42.003251] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T17:03:42.334864] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-11-03T17:03:42.869136] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:03:43.134899] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-11-03T17:03:43.336146] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T17:03:43.934882] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-11-03T17:03:44.651407] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-11-03T17:03:44.734816] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-11-03T17:03:44.750534] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-11-03T17:03:45.534874] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-11. [2025-11-03T17:03:46.216881] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T17:03:46.334853] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-11-03T17:03:47.134850] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-11-03T17:03:47.288704] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-11 (1.75 seconds). [2025-11-03T17:03:47.290121] [INFO ] [REMOTE ] ADNT: Full fetch complete (67447 records). [2025-11-03T17:03:47.290217] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-11-03T17:03:47.759562] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T17:03:47.758958] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-11-03T17:03:47.765874] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-11-03T17:03:47.766534] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-11-03T17:03:47.766901] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-11-03T17:03:47.768109] [DEBUG] [LOCAL ] ADNT: Trimmed 67447 records to 45653 (keeping 200 days of data) [2025-11-03T17:03:47.940520] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-11-03T17:03:48.033068] [DEBUG] [LOCAL ] ADNT: Primary data saved (45653 records). [2025-11-03T17:03:48.033235] [INFO ] [MAIN ] ADNT: Full history saved. [2025-11-03T17:03:48.033339] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADNT took 35.6s. Estimated remaining: 4h 32m 37s. Rate: 8.6 symbols/min [2025-11-03T17:03:48.211025] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:48.219635] [DEBUG] [LOCAL ] AEFC: Loaded 7580 existing records from primary storage. [2025-11-03T17:03:48.219881] [INFO ] [MAIN ] AEFC: Loaded 7580 existing records. [2025-11-03T17:03:48.409820] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:03:48.410108] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-11-03T17:03:48.410219] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-11-03T17:03:48.410548] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-11-03T17:03:48.410697] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-11-03T17:03:48.743729] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-11-03T17:03:48.832288] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-11-03T17:03:48.838326] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:03:48.874823] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T17:03:49.534851] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-11-03T17:03:50.350392] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-11-03T17:03:50.353084] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-11-03T17:03:50.380702] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-11-03T17:03:51.029513] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T17:03:51.134848] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-11-03T17:03:51.585327] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-11-03T17:03:51.934848] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-11-03T17:03:52.734834] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-11-03T17:03:52.776896] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T17:03:53.534852] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-11. [2025-11-03T17:03:54.124544] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T17:03:54.334857] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-11-03T17:03:54.831986] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-11-03T17:03:55.134893] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-11-03T17:03:55.774619] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-11-03T17:03:55.794166] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T17:03:55.795681] [INFO ] [REMOTE ] ADT: Full fetch complete (77384 records). [2025-11-03T17:03:55.795789] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-11-03T17:03:55.939962] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-11-03T17:03:56.220920] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-11-03T17:03:56.221006] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-11-03T17:03:56.221753] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-11-03T17:03:56.221820] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-11-03T17:03:56.223316] [DEBUG] [LOCAL ] ADT: Trimmed 77384 records to 53420 (keeping 200 days of data) [2025-11-03T17:03:56.540936] [DEBUG] [LOCAL ] ADT: Primary data saved (53420 records). [2025-11-03T17:03:56.541086] [INFO ] [MAIN ] ADT: Full history saved. [2025-11-03T17:03:56.541899] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADT took 38.2s. Estimated remaining: 4h 34m 16s. Rate: 8.5 symbols/min [2025-11-03T17:03:56.704409] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T17:03:56.724174] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:56.734850] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-11-03T17:03:56.770802] [DEBUG] [LOCAL ] AEG: Loaded 50087 existing records from primary storage. [2025-11-03T17:03:56.771101] [INFO ] [MAIN ] AEG: Loaded 50087 existing records. [2025-11-03T17:03:56.950168] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:03:56.950369] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-11-03T17:03:56.950416] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-11-03T17:03:56.951141] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-11-03T17:03:56.951199] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-11-03T17:03:57.296836] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:03:57.534847] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-11-03T17:03:57.803204] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T17:03:58.334846] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-11. [2025-11-03T17:03:58.966238] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T17:03:59.134910] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-11-03T17:03:59.151478] [DEBUG] [REMOTE ] ADX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:03:59.151841] [WARN ] [REMOTE ] ADX: No data returned for month 2025-11 [2025-11-03T17:03:59.151912] [FATAL] [REMOTE ] ADX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:03:59.151982] [FATAL] [MAIN ] ADX: Failed to fetch primary data. [2025-11-03T17:03:59.152019] [WARN ] [MAIN ] ADX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:03:59.152088] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-11-03T17:03:59.152152] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-11-03T17:03:59.152188] [INFO ] [LOCAL ] ADX: Starting deletion of derivative data. [2025-11-03T17:03:59.152363] [DEBUG] [LOCAL ] ADX: Deleted derivative data file. [2025-11-03T17:03:59.152741] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. ADX took 31.1s. Estimated remaining: 4h 29m 5s. Rate: 8.7 symbols/min [2025-11-03T17:03:59.362747] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:03:59.416112] [DEBUG] [LOCAL ] AEM: Loaded 54249 existing records from primary storage. [2025-11-03T17:03:59.416463] [INFO ] [MAIN ] AEM: Loaded 54249 existing records. [2025-11-03T17:03:59.642728] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:03:59.642935] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-11-03T17:03:59.642983] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-11-03T17:03:59.643744] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-11-03T17:03:59.643804] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-11-03T17:03:59.939957] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-11-03T17:04:00.066490] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:00.431854] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T17:04:00.496001] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-11-03T17:04:00.734849] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-11-03T17:04:01.460008] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T17:04:01.534871] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-11-03T17:04:02.103901] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T17:04:02.334862] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-11-03T17:04:03.134856] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-11-03T17:04:03.577671] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T17:04:03.934883] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-11-03T17:04:04.471556] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T17:04:04.734883] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-11-03T17:04:05.179754] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-11-03T17:04:05.257258] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T17:04:05.534875] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-11-03T17:04:06.334931] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-11-03T17:04:06.771162] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-11-03T17:04:07.134866] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-11. [2025-11-03T17:04:07.172278] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T17:04:07.205808] [DEBUG] [REMOTE ] AEE: Error fetching primary data for 2025-11: 'API call returned an empty response.' [2025-11-03T17:04:07.206054] [WARN ] [REMOTE ] AEE: No data returned for month 2025-11 [2025-11-03T17:04:07.206138] [FATAL] [REMOTE ] AEE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:04:07.206232] [FATAL] [MAIN ] AEE: Failed to fetch primary data. [2025-11-03T17:04:07.206297] [WARN ] [MAIN ] AEE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:04:07.206368] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-11-03T17:04:07.206430] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-11-03T17:04:07.206465] [INFO ] [LOCAL ] AEE: Starting deletion of derivative data. [2025-11-03T17:04:07.206504] [DEBUG] [LOCAL ] AEE: No derivative data file found to delete. [2025-11-03T17:04:07.206546] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEE took 37.2s. Estimated remaining: 4h 30m 13s. Rate: 8.6 symbols/min [2025-11-03T17:04:07.374438] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:07.422567] [DEBUG] [LOCAL ] AEO: Loaded 54343 existing records from primary storage. [2025-11-03T17:04:07.422917] [INFO ] [MAIN ] AEO: Loaded 54343 existing records. [2025-11-03T17:04:07.599033] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:04:07.599267] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-11-03T17:04:07.599314] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-11-03T17:04:07.599995] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-11-03T17:04:07.600052] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-11-03T17:04:07.950000] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-11-03T17:04:07.955442] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:08.734834] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-11-03T17:04:09.444688] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T17:04:09.534899] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-11. [2025-11-03T17:04:10.334826] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-11-03T17:04:10.348517] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T17:04:10.349311] [INFO ] [REMOTE ] AEFC: Full fetch complete (11586 records). [2025-11-03T17:04:10.349382] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-11-03T17:04:10.749428] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-11-03T17:04:10.765063] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-11-03T17:04:10.775699] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-11-03T17:04:10.776012] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-11-03T17:04:10.777540] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-11-03T17:04:10.789005] [DEBUG] [LOCAL ] AEFC: Trimmed 11586 records to 7498 (keeping 200 days of data) [2025-11-03T17:04:10.836945] [DEBUG] [LOCAL ] AEFC: Primary data saved (7498 records). [2025-11-03T17:04:10.837119] [INFO ] [MAIN ] AEFC: Full history saved. [2025-11-03T17:04:10.837274] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. AEFC took 22.8s. Estimated remaining: 4h 26m 31s. Rate: 8.7 symbols/min [2025-11-03T17:04:11.008545] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:11.052097] [DEBUG] [LOCAL ] AER: Loaded 48373 existing records from primary storage. [2025-11-03T17:04:11.052404] [INFO ] [MAIN ] AER: Loaded 48373 existing records. [2025-11-03T17:04:11.142711] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-11-03T17:04:11.233405] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:04:11.233663] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-11-03T17:04:11.233727] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-11-03T17:04:11.234574] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-11-03T17:04:11.234632] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-11-03T17:04:11.593206] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:11.622500] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T17:04:11.934862] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-11-03T17:04:12.727516] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-11-03T17:04:12.738499] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-11-03T17:04:13.156581] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T17:04:13.534863] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-11-03T17:04:14.223378] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-11-03T17:04:14.334840] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-11-03T17:04:15.134827] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-11-03T17:04:15.242018] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-11-03T17:04:15.741930] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:04:15.934874] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-11-03T17:04:16.522096] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:04:16.734878] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-11-03T17:04:17.525892] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T17:04:17.536392] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-11-03T17:04:18.026399] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:04:18.334837] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-11-03T17:04:18.927715] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:04:19.134925] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-11-03T17:04:19.685198] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T17:04:19.934873] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-11-03T17:04:20.580114] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T17:04:20.734844] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-11-03T17:04:21.098558] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T17:04:21.534898] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-11-03T17:04:22.227238] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T17:04:22.334807] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-11-03T17:04:22.789249] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T17:04:23.134870] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-11-03T17:04:23.679012] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T17:04:23.934876] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-11-03T17:04:24.603711] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T17:04:24.734854] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-11-03T17:04:25.534996] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-11-03T17:04:25.705871] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-11-03T17:04:26.269318] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-11-03T17:04:26.334919] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-11-03T17:04:27.014480] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T17:04:27.134848] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-11-03T17:04:27.934835] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-11-03T17:04:28.148594] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-11-03T17:04:28.548330] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T17:04:28.734849] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-11-03T17:04:29.534893] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-11-03T17:04:30.093160] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-11-03T17:04:30.133599] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T17:04:30.334891] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-11. [2025-11-03T17:04:30.510531] [DEBUG] [REMOTE ] AEM: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:04:30.510864] [WARN ] [REMOTE ] AEM: No data returned for month 2025-11 [2025-11-03T17:04:30.510950] [FATAL] [REMOTE ] AEM: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:04:30.511028] [FATAL] [MAIN ] AEM: Failed to fetch primary data. [2025-11-03T17:04:30.511090] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:04:30.511159] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-11-03T17:04:30.511221] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-11-03T17:04:30.511256] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-11-03T17:04:30.511446] [DEBUG] [LOCAL ] AEM: Deleted derivative data file. [2025-11-03T17:04:30.512551] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEM took 31.4s. Estimated remaining: 4h 39m 51s. Rate: 8.3 symbols/min [2025-11-03T17:04:30.884782] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:04:31.134865] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-11-03T17:04:31.934925] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-11-03T17:04:32.631359] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T17:04:32.734880] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-11-03T17:04:33.132034] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T17:04:33.534872] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-11-03T17:04:34.348041] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-11-03T17:04:34.355790] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-11-03T17:04:34.853510] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T17:04:35.134920] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-11-03T17:04:35.697410] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-11-03T17:04:35.934871] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-11-03T17:04:36.734909] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-11. [2025-11-03T17:04:36.976339] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-11-03T17:04:37.089092] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T17:04:37.534853] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-11-03T17:04:38.334938] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-11. [2025-11-03T17:04:38.827088] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:04:38.841943] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-11 (2.11 seconds). [2025-11-03T17:04:38.843329] [INFO ] [REMOTE ] AEG: Full fetch complete (70665 records). [2025-11-03T17:04:38.843453] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-11-03T17:04:39.136932] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-11-03T17:04:39.228610] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-11-03T17:04:39.228716] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-11-03T17:04:39.229363] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-11-03T17:04:39.229405] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-11-03T17:04:39.230678] [DEBUG] [LOCAL ] AEG: Trimmed 70665 records to 49336 (keeping 200 days of data) [2025-11-03T17:04:39.499792] [DEBUG] [LOCAL ] AEG: Primary data saved (49336 records). [2025-11-03T17:04:39.499911] [INFO ] [MAIN ] AEG: Full history saved. [2025-11-03T17:04:39.500809] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEG took 43.0s. Estimated remaining: 4h 41m 32s. Rate: 8.3 symbols/min [2025-11-03T17:04:40.369099] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T17:04:40.379601] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-11-03T17:04:40.455996] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-11 (2.12 seconds). [2025-11-03T17:04:40.457552] [INFO ] [REMOTE ] AEO: Full fetch complete (77656 records). [2025-11-03T17:04:40.457683] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-11-03T17:04:40.863079] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-11-03T17:04:40.863172] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-11-03T17:04:40.863952] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-11-03T17:04:40.864018] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-11-03T17:04:40.865526] [DEBUG] [LOCAL ] AEO: Trimmed 77656 records to 53564 (keeping 200 days of data) [2025-11-03T17:04:41.186560] [DEBUG] [LOCAL ] AEO: Primary data saved (53564 records). [2025-11-03T17:04:41.186714] [INFO ] [MAIN ] AEO: Full history saved. [2025-11-03T17:04:41.186800] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEO took 34.0s. Estimated remaining: 4h 35m 53s. Rate: 8.4 symbols/min [2025-11-03T17:04:41.662816] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:04:41.674477] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-11-03T17:04:42.905529] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T17:04:42.917990] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-11. [2025-11-03T17:04:43.984948] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-11 (1.07 seconds). [2025-11-03T17:04:43.986770] [INFO ] [REMOTE ] AER: Full fetch complete (69979 records). [2025-11-03T17:04:43.986903] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-11-03T17:04:44.398161] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-11-03T17:04:44.398283] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-11-03T17:04:44.399147] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-11-03T17:04:44.399222] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-11-03T17:04:44.401266] [DEBUG] [LOCAL ] AER: Trimmed 69979 records to 47595 (keeping 200 days of data) [2025-11-03T17:04:44.693755] [DEBUG] [LOCAL ] AER: Primary data saved (47595 records). [2025-11-03T17:04:44.693889] [INFO ] [MAIN ] AER: Full history saved. [2025-11-03T17:04:44.693969] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 33.9s. Estimated remaining: 4h 32m 16s. Rate: 8.5 symbols/min [2025-11-03T17:04:45.241263] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:45.450940] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:45.454291] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:45.454484] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-11-03T17:04:45.434639] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:45.454815] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-11-03T17:04:45.455069] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-11-03T17:04:45.455171] [DEBUG] [LOCAL ] AFB: No existing data file found in primary storage. [2025-11-03T17:04:45.455304] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-11-03T17:04:45.455238] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-11-03T17:04:45.455505] [WARN ] [MAIN ] AFB: No existing data found, performing full refresh instead. [2025-11-03T17:04:45.455694] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-11-03T17:04:45.456330] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-11-03T17:04:45.455834] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-11-03T17:04:45.456520] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-11-03T17:04:45.468011] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-11-03T17:04:45.467886] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-11-03T17:04:45.478429] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-11-03T17:04:45.499155] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-11-03T17:04:45.504541] [DEBUG] [LOCAL ] AFB: No primary data file found to delete. [2025-11-03T17:04:45.514199] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-11-03T17:04:45.514069] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-11-03T17:04:46.160880] [DEBUG] [LOCAL ] AES: Loaded 54443 existing records from primary storage. [2025-11-03T17:04:46.191795] [INFO ] [MAIN ] AES: Loaded 54443 existing records. [2025-11-03T17:04:46.604589] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:46.672079] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-11-03T17:04:46.767181] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:46.797535] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-11-03T17:04:46.845087] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:46.869358] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:04:46.869871] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-11-03T17:04:46.870383] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-11-03T17:04:46.871369] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-11-03T17:04:46.872536] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-11-03T17:04:46.872695] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-11-03T17:04:47.049421] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:04:47.096875] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-11-03T17:04:47.146513] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:04:47.157283] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-11-03T17:04:47.157767] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:04:47.168494] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-11-03T17:04:47.201858] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-11-03T17:04:47.217032] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-11-03T17:04:47.237205] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:47.237489] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-11-03T17:04:47.238013] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-11-03T17:04:47.237777] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.5s. Estimated remaining: 4h 27m 55s. Rate: 8.7 symbols/min [2025-11-03T17:04:47.433415] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:04:47.433606] [DEBUG] [LOCAL ] AFG: No existing data file found in primary storage. [2025-11-03T17:04:47.433689] [WARN ] [MAIN ] AFG: No existing data found, performing full refresh instead. [2025-11-03T17:04:47.433796] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-11-03T17:04:47.433837] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-11-03T17:04:47.433877] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-11-03T17:04:47.433910] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-11-03T17:04:47.561897] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T17:04:47.592449] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-11-03T17:04:47.800008] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:04:47.800492] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-11-03T17:04:48.047739] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T17:04:48.056427] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-11-03T17:04:48.235555] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T17:04:48.238601] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-11-03T17:04:48.791248] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:04:48.796566] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-11-03T17:04:48.849853] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T17:04:48.920087] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-11-03T17:04:49.247325] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T17:04:49.534878] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-11-03T17:04:49.845375] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T17:04:50.208569] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T17:04:50.334854] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-11-03T17:04:51.134869] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-11-03T17:04:51.912744] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-11-03T17:04:51.934822] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-11-03T17:04:52.350261] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T17:04:52.734847] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-11-03T17:04:53.534846] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-11-03T17:04:53.733639] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-11-03T17:04:53.924101] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:04:54.334838] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-11-03T17:04:54.461893] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T17:04:55.134852] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-11-03T17:04:55.849943] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T17:04:55.934852] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-11-03T17:04:56.555823] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T17:04:56.734862] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-11-03T17:04:57.534828] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-11-03T17:04:57.670888] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-11-03T17:04:58.057601] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-11-03T17:04:58.334852] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-11-03T17:04:58.767019] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:04:59.134863] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-11-03T17:04:59.605387] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T17:04:59.755192] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-11-03T17:04:59.934859] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-11-03T17:05:00.734902] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-11-03T17:05:01.534921] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-11-03T17:05:01.850382] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-11-03T17:05:02.334831] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-11-03T17:05:02.380415] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-11-03T17:05:02.621879] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T17:05:03.134923] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-11-03T17:05:03.934891] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-11-03T17:05:04.017107] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T17:05:04.079060] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T17:05:04.582479] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T17:05:04.734861] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-11-03T17:05:05.534896] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-11-03T17:05:06.113117] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T17:05:06.145331] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T17:05:06.334853] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-11-03T17:05:07.060392] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T17:05:07.134861] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-11-03T17:05:07.791290] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T17:05:07.934886] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-11-03T17:05:08.734864] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-11-03T17:05:09.322143] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:05:09.534895] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-11-03T17:05:09.830216] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T17:05:10.334931] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-11-03T17:05:11.012861] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T17:05:11.089469] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-11-03T17:05:11.134840] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-11-03T17:05:11.934854] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-11-03T17:05:12.734868] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-11-03T17:05:13.001900] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-11-03T17:05:13.181688] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:05:13.534976] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-11. [2025-11-03T17:05:13.657887] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T17:05:14.334868] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-11. [2025-11-03T17:05:15.134874] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-11-03T17:05:15.225122] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-11 (0.89 seconds). [2025-11-03T17:05:15.226054] [INFO ] [REMOTE ] AFB: Full fetch complete (16321 records). [2025-11-03T17:05:15.226125] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-11-03T17:05:15.586812] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-11-03T17:05:15.586899] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-11-03T17:05:15.587209] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-11-03T17:05:15.587277] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-11-03T17:05:15.588068] [DEBUG] [LOCAL ] AFB: Trimmed 16321 records to 10898 (keeping 200 days of data) [2025-11-03T17:05:15.652160] [DEBUG] [LOCAL ] AFB: Primary data saved (10898 records). [2025-11-03T17:05:15.652291] [INFO ] [MAIN ] AFB: Full history saved. [2025-11-03T17:05:15.652362] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 30.9s. Estimated remaining: 4h 47m 38s. Rate: 8.1 symbols/min [2025-11-03T17:05:15.820758] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:05:15.824289] [DEBUG] [LOCAL ] AFGB: Loaded 2114 existing records from primary storage. [2025-11-03T17:05:15.824429] [INFO ] [MAIN ] AFGB: Loaded 2114 existing records. [2025-11-03T17:05:15.940195] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-11-03T17:05:16.010862] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:05:16.011054] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-11-03T17:05:16.011102] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-11-03T17:05:16.011287] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-11-03T17:05:16.011358] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-11-03T17:05:16.308286] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-11 (2.77 seconds). [2025-11-03T17:05:16.370738] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-11-03T17:05:16.396570] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T17:05:16.394687] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:05:16.395202] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-11-03T17:05:16.740119] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-11-03T17:05:16.798341] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-11-03T17:05:16.798425] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-11-03T17:05:16.799226] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-11-03T17:05:16.799288] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-11-03T17:05:16.801174] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 53663 (keeping 200 days of data) [2025-11-03T17:05:17.116532] [DEBUG] [LOCAL ] AES: Primary data saved (53663 records). [2025-11-03T17:05:17.116690] [INFO ] [MAIN ] AES: Full history saved. [2025-11-03T17:05:17.116786] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AES took 32.4s. Estimated remaining: 4h 42m 8s. Rate: 8.2 symbols/min [2025-11-03T17:05:17.298000] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:05:17.295056] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T17:05:17.303687] [DEBUG] [LOCAL ] AFGC: Loaded 2598 existing records from primary storage. [2025-11-03T17:05:17.303839] [INFO ] [MAIN ] AFGC: Loaded 2598 existing records. [2025-11-03T17:05:17.483737] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:05:17.484093] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-11-03T17:05:17.484165] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-11-03T17:05:17.484716] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-11-03T17:05:17.484773] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-11-03T17:05:17.550824] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-11-03T17:05:17.643805] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T17:05:17.905105] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:05:18.027718] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-11-03T17:05:18.334908] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-11-03T17:05:18.718808] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-11-03T17:05:19.134918] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-11. [2025-11-03T17:05:19.934911] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-11. [2025-11-03T17:05:20.352481] [DEBUG] [REMOTE ] AESI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:05:20.352833] [WARN ] [REMOTE ] AESI: No data returned for month 2025-11 [2025-11-03T17:05:20.352920] [FATAL] [REMOTE ] AESI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:05:20.352999] [FATAL] [MAIN ] AESI: Failed to fetch primary data. [2025-11-03T17:05:20.353060] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:05:20.353131] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-11-03T17:05:20.353193] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-11-03T17:05:20.353229] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-11-03T17:05:20.353268] [DEBUG] [LOCAL ] AESI: No derivative data file found to delete. [2025-11-03T17:05:20.353312] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AESI took 35.7s. Estimated remaining: 4h 38m 27s. Rate: 8.3 symbols/min [2025-11-03T17:05:20.522400] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:05:20.525505] [DEBUG] [LOCAL ] AFGD: Loaded 1724 existing records from primary storage. [2025-11-03T17:05:20.525662] [INFO ] [MAIN ] AFGD: Loaded 1724 existing records. [2025-11-03T17:05:20.730977] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:05:20.731258] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-11-03T17:05:20.731335] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-11-03T17:05:20.731554] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-11-03T17:05:20.731626] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-11-03T17:05:20.745854] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-11-03T17:05:20.930227] [DEBUG] [REMOTE ] AFG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:05:20.978060] [WARN ] [REMOTE ] AFG: No data returned for month 2025-11 [2025-11-03T17:05:20.999941] [FATAL] [REMOTE ] AFG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:05:21.028271] [FATAL] [MAIN ] AFG: Failed to fetch primary data. [2025-11-03T17:05:21.039856] [WARN ] [MAIN ] AFG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:05:21.040210] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-11-03T17:05:21.040299] [DEBUG] [LOCAL ] AFG: No primary data file found to delete. [2025-11-03T17:05:21.045725] [INFO ] [LOCAL ] AFG: Starting deletion of derivative data. [2025-11-03T17:05:21.061224] [DEBUG] [LOCAL ] AFG: No derivative data file found to delete. [2025-11-03T17:05:21.066473] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AFG took 33.8s. Estimated remaining: 4h 32m 46s. Rate: 8.5 symbols/min [2025-11-03T17:05:21.140021] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:05:21.193344] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-11-03T17:05:21.326836] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:05:21.327021] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-11-03T17:05:21.327060] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-11-03T17:05:21.327229] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-11-03T17:05:21.327280] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-11-03T17:05:21.327323] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-11-03T17:05:21.327356] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-11-03T17:05:21.539972] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-11-03T17:05:21.701116] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:05:22.103465] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-11-03T17:05:22.334845] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-11-03T17:05:22.776995] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-11-03T17:05:23.134865] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-11-03T17:05:23.457660] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-11-03T17:05:23.934855] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-11-03T17:05:24.274209] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T17:05:24.734863] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-11-03T17:05:25.025189] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-11-03T17:05:25.534859] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-11-03T17:05:25.829503] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-11-03T17:05:26.334859] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-11-03T17:05:26.654569] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-11-03T17:05:27.134867] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-11-03T17:05:27.431535] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-11-03T17:05:27.934856] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-11-03T17:05:28.431063] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T17:05:28.734883] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-11-03T17:05:29.209994] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T17:05:29.534853] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-11-03T17:05:29.832485] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-11-03T17:05:30.334847] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-11-03T17:05:30.700125] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-11-03T17:05:31.134917] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-11-03T17:05:31.513004] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-11-03T17:05:31.934889] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-11-03T17:05:32.219010] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-11-03T17:05:32.734853] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-11-03T17:05:33.080942] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-11-03T17:05:33.534853] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-11-03T17:05:33.791504] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-11-03T17:05:34.334866] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-11. [2025-11-03T17:05:34.882495] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T17:05:34.883150] [INFO ] [REMOTE ] AFGB: Full fetch complete (3349 records). [2025-11-03T17:05:34.883217] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-11-03T17:05:35.140037] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-11-03T17:05:35.242849] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-11-03T17:05:35.242929] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-11-03T17:05:35.243090] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-11-03T17:05:35.243130] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-11-03T17:05:35.243483] [DEBUG] [LOCAL ] AFGB: Trimmed 3349 records to 2070 (keeping 200 days of data) [2025-11-03T17:05:35.256173] [DEBUG] [LOCAL ] AFGB: Primary data saved (2070 records). [2025-11-03T17:05:35.256233] [INFO ] [MAIN ] AFGB: Full history saved. [2025-11-03T17:05:35.256308] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AFGB took 19.6s. Estimated remaining: 4h 38m 39s. Rate: 8.3 symbols/min [2025-11-03T17:05:35.420969] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:05:35.469731] [DEBUG] [LOCAL ] AFL: Loaded 53920 existing records from primary storage. [2025-11-03T17:05:35.470098] [INFO ] [MAIN ] AFL: Loaded 53920 existing records. [2025-11-03T17:05:35.646219] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:05:35.646431] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-11-03T17:05:35.646480] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-11-03T17:05:35.647508] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-11-03T17:05:35.647566] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-11-03T17:05:35.940097] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-11-03T17:05:35.999929] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:05:36.089041] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T17:05:36.440077] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-11-03T17:05:36.734865] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-11-03T17:05:37.039850] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-11-03T17:05:37.534871] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-11-03T17:05:37.934371] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T17:05:38.334852] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-11-03T17:05:38.612563] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-11-03T17:05:39.134895] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-11-03T17:05:39.934910] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-11-03T17:05:40.300408] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-11-03T17:05:40.425884] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T17:05:40.734872] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-11-03T17:05:41.534857] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-11-03T17:05:41.829242] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-11-03T17:05:42.017736] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T17:05:42.334916] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-11-03T17:05:42.749948] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-11-03T17:05:43.134905] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-11-03T17:05:43.434004] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-11-03T17:05:43.934871] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-11-03T17:05:44.316872] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T17:05:44.734882] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-11-03T17:05:44.987784] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-11-03T17:05:45.534885] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-11-03T17:05:45.815979] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-11-03T17:05:46.334853] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-11-03T17:05:47.134907] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-11. [2025-11-03T17:05:47.526965] [DEBUG] [REMOTE ] AFGE: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:05:47.527385] [WARN ] [REMOTE ] AFGE: No data returned for month 2025-11 [2025-11-03T17:05:47.527487] [FATAL] [REMOTE ] AFGE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:05:47.527564] [FATAL] [MAIN ] AFGE: Failed to fetch primary data. [2025-11-03T17:05:47.527627] [WARN ] [MAIN ] AFGE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:05:47.527714] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-11-03T17:05:47.527777] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-11-03T17:05:47.527813] [INFO ] [LOCAL ] AFGE: Starting deletion of derivative data. [2025-11-03T17:05:47.527852] [DEBUG] [LOCAL ] AFGE: No derivative data file found to delete. [2025-11-03T17:05:47.527898] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGE took 26.4s. Estimated remaining: 4h 42m 41s. Rate: 8.2 symbols/min [2025-11-03T17:05:47.695543] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:05:47.733489] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T17:05:47.782133] [DEBUG] [LOCAL ] AG: Loaded 54423 existing records from primary storage. [2025-11-03T17:05:47.782439] [INFO ] [MAIN ] AG: Loaded 54423 existing records. [2025-11-03T17:05:47.936011] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-11-03T17:05:47.983288] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:05:47.983489] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-11-03T17:05:47.983565] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-11-03T17:05:47.984442] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-11-03T17:05:47.984499] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-11-03T17:05:48.338044] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:05:48.466598] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T17:05:48.734843] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-11-03T17:05:49.534864] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-11-03T17:05:50.126244] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:05:50.334853] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-11-03T17:05:51.126476] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-11-03T17:05:51.136554] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-11-03T17:05:51.416317] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-11-03T17:05:51.592171] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T17:05:51.934842] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-11-03T17:05:52.331846] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T17:05:52.734862] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-11-03T17:05:53.085581] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-11-03T17:05:53.534862] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-11-03T17:05:53.873454] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-11-03T17:05:54.334845] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-11-03T17:05:55.134845] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-11-03T17:05:55.476342] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-11-03T17:05:55.664381] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:05:55.934865] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-11-03T17:05:56.320507] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-11-03T17:05:56.734895] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-11-03T17:05:57.534853] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-11-03T17:05:57.798307] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-11-03T17:05:58.312191] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-11-03T17:05:58.334814] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-11-03T17:05:59.134893] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-11-03T17:05:59.722826] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:05:59.934874] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-11-03T17:06:00.734819] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-11. [2025-11-03T17:06:01.417873] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-11-03T17:06:01.534823] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-11. [2025-11-03T17:06:01.741370] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-11-03T17:06:02.334829] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-11-03T17:06:02.528858] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-11 (1.79 seconds). [2025-11-03T17:06:02.529508] [INFO ] [REMOTE ] AFGD: Full fetch complete (2622 records). [2025-11-03T17:06:02.529577] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-11-03T17:06:02.683041] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-11 (1.15 seconds). [2025-11-03T17:06:02.709948] [INFO ] [REMOTE ] AFGC: Full fetch complete (3551 records). [2025-11-03T17:06:02.745917] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-11-03T17:06:03.127938] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-11-03T17:06:03.151195] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-11-03T17:06:03.139361] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-11-03T17:06:03.165137] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-11-03T17:06:03.176855] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-11-03T17:06:03.183720] [DEBUG] [LOCAL ] AFGD: Trimmed 2622 records to 1669 (keeping 200 days of data) [2025-11-03T17:06:03.261505] [DEBUG] [LOCAL ] AFGD: Primary data saved (1669 records). [2025-11-03T17:06:03.269992] [INFO ] [MAIN ] AFGD: Full history saved. [2025-11-03T17:06:03.271942] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGD took 42.9s. Estimated remaining: 4h 49m 21s. Rate: 8.0 symbols/min [2025-11-03T17:06:03.297997] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-11-03T17:06:03.329182] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-11-03T17:06:03.365488] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-11-03T17:06:03.371973] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-11-03T17:06:03.379138] [DEBUG] [LOCAL ] AFGC: Trimmed 3551 records to 2569 (keeping 200 days of data) [2025-11-03T17:06:03.451230] [DEBUG] [LOCAL ] AFGC: Primary data saved (2569 records). [2025-11-03T17:06:03.470132] [INFO ] [MAIN ] AFGC: Full history saved. [2025-11-03T17:06:03.470244] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGC took 46.4s. Estimated remaining: 4h 43m 29s. Rate: 8.2 symbols/min [2025-11-03T17:06:03.552800] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:03.675761] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:03.712371] [DEBUG] [LOCAL ] AGCO: Loaded 42460 existing records from primary storage. [2025-11-03T17:06:03.713373] [DEBUG] [LOCAL ] AGD: Loaded 19111 existing records from primary storage. [2025-11-03T17:06:03.713501] [INFO ] [MAIN ] AGCO: Loaded 42460 existing records. [2025-11-03T17:06:03.756417] [INFO ] [MAIN ] AGD: Loaded 19111 existing records. [2025-11-03T17:06:04.031112] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:06:04.080862] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-11-03T17:06:04.084976] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:06:04.085238] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-11-03T17:06:04.085558] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-11-03T17:06:04.085443] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-11-03T17:06:04.085977] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-11-03T17:06:04.086089] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-11-03T17:06:04.107483] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-11-03T17:06:04.142721] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-11-03T17:06:04.757386] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:04.784033] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-11-03T17:06:04.794575] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-11-03T17:06:04.894713] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:04.888846] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-11-03T17:06:04.932345] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-11-03T17:06:05.534909] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-11-03T17:06:05.961421] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:06:06.334890] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-11. [2025-11-03T17:06:06.497810] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T17:06:06.877466] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T17:06:07.134912] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-11-03T17:06:07.414954] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-11 (1.08 seconds). [2025-11-03T17:06:07.416507] [INFO ] [REMOTE ] AFL: Full fetch complete (77056 records). [2025-11-03T17:06:07.416689] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-11-03T17:06:07.807630] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-11-03T17:06:07.807839] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-11-03T17:06:07.808685] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-11-03T17:06:07.808761] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-11-03T17:06:07.819970] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T17:06:07.824291] [DEBUG] [LOCAL ] AFL: Trimmed 77056 records to 53131 (keeping 200 days of data) [2025-11-03T17:06:07.934887] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-11-03T17:06:08.151092] [DEBUG] [LOCAL ] AFL: Primary data saved (53131 records). [2025-11-03T17:06:08.151238] [INFO ] [MAIN ] AFL: Full history saved. [2025-11-03T17:06:08.151958] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AFL took 32.9s. Estimated remaining: 4h 41m 18s. Rate: 8.2 symbols/min [2025-11-03T17:06:08.317801] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:08.317986] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-11-03T17:06:08.318024] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-11-03T17:06:08.318132] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-11-03T17:06:08.318172] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-11-03T17:06:08.318212] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-11-03T17:06:08.318243] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-11-03T17:06:08.661478] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:08.734856] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-11-03T17:06:09.530381] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-11-03T17:06:09.540532] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-11-03T17:06:09.847071] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T17:06:10.334850] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-11-03T17:06:10.864357] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:06:11.134899] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-11-03T17:06:11.934878] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-11-03T17:06:12.728409] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T17:06:12.737348] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-11-03T17:06:12.795344] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-11-03T17:06:13.534849] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-11-03T17:06:13.981139] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-11-03T17:06:14.103031] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T17:06:14.334891] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-11-03T17:06:15.134865] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-11-03T17:06:15.712490] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T17:06:15.880483] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T17:06:15.934857] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-11-03T17:06:16.361668] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-11-03T17:06:16.705516] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T17:06:16.734843] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-11-03T17:06:17.459077] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T17:06:17.534869] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-11-03T17:06:18.296865] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:06:18.334851] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-11-03T17:06:19.048195] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T17:06:19.134861] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-11-03T17:06:19.865750] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T17:06:19.934898] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-11-03T17:06:20.734916] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-11-03T17:06:21.154114] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:06:21.541570] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-11-03T17:06:21.546977] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T17:06:22.334904] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-11. [2025-11-03T17:06:23.132310] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T17:06:23.142333] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-11-03T17:06:23.449905] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T17:06:23.450719] [INFO ] [REMOTE ] AGD: Full fetch complete (25851 records). [2025-11-03T17:06:23.450788] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-11-03T17:06:23.817674] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-11-03T17:06:23.817763] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-11-03T17:06:23.818100] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-11-03T17:06:23.818140] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-11-03T17:06:23.818858] [DEBUG] [LOCAL ] AGD: Trimmed 25851 records to 18745 (keeping 200 days of data) [2025-11-03T17:06:23.935694] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-11-03T17:06:23.945733] [DEBUG] [LOCAL ] AGD: Primary data saved (18745 records). [2025-11-03T17:06:23.945847] [INFO ] [MAIN ] AGD: Full history saved. [2025-11-03T17:06:23.945924] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AGD took 20.5s. Estimated remaining: 4h 47m 37s. Rate: 8.0 symbols/min [2025-11-03T17:06:24.117803] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:24.118059] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-11-03T17:06:24.118114] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-11-03T17:06:24.118226] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-11-03T17:06:24.118268] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-11-03T17:06:24.118311] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-11-03T17:06:24.118372] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-11-03T17:06:24.483068] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:24.505568] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T17:06:24.734859] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-11-03T17:06:25.462474] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T17:06:25.534845] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-11-03T17:06:26.301466] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-11-03T17:06:26.334866] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-11-03T17:06:26.544706] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T17:06:27.134902] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-11-03T17:06:27.674615] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T17:06:27.934864] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-11-03T17:06:28.674538] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T17:06:28.734905] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-11-03T17:06:29.534869] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-11-03T17:06:29.928980] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-11-03T17:06:30.078491] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T17:06:30.334891] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-11-03T17:06:30.642941] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T17:06:31.134962] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-11-03T17:06:31.934909] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-11-03T17:06:32.112036] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-11-03T17:06:32.291585] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T17:06:32.734894] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-11-03T17:06:33.431619] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-11-03T17:06:33.534893] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-11. [2025-11-03T17:06:34.089468] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:06:34.334877] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-11-03T17:06:35.134958] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-11-03T17:06:35.719542] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:06:35.934888] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-11-03T17:06:36.349670] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T17:06:36.465026] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-11 (2.93 seconds). [2025-11-03T17:06:36.466503] [INFO ] [REMOTE ] AG: Full fetch complete (77808 records). [2025-11-03T17:06:36.466635] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-11-03T17:06:36.740497] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-11-03T17:06:36.864392] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-11-03T17:06:36.864479] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-11-03T17:06:36.865223] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-11-03T17:06:36.865290] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-11-03T17:06:36.866750] [DEBUG] [LOCAL ] AG: Trimmed 77808 records to 53644 (keeping 200 days of data) [2025-11-03T17:06:37.178201] [DEBUG] [LOCAL ] AG: Primary data saved (53644 records). [2025-11-03T17:06:37.178684] [INFO ] [MAIN ] AG: Full history saved. [2025-11-03T17:06:37.179268] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AG took 49.7s. Estimated remaining: 4h 51m 47s. Rate: 7.9 symbols/min [2025-11-03T17:06:37.349286] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:37.383181] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T17:06:37.399152] [DEBUG] [LOCAL ] AGM: Loaded 10547 existing records from primary storage. [2025-11-03T17:06:37.399372] [INFO ] [MAIN ] AGM: Loaded 10547 existing records. [2025-11-03T17:06:37.538717] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-11-03T17:06:37.573232] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:06:37.573568] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-11-03T17:06:37.573618] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-11-03T17:06:37.573887] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-11-03T17:06:37.573937] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-11-03T17:06:37.921202] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:38.052396] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T17:06:38.334862] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-11-03T17:06:38.939593] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T17:06:39.134884] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-11-03T17:06:39.469958] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T17:06:39.724749] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-11-03T17:06:39.934889] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-11-03T17:06:40.734850] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-11. [2025-11-03T17:06:41.339331] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T17:06:41.534860] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-11-03T17:06:41.554489] [DEBUG] [REMOTE ] AGCO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:06:41.554846] [WARN ] [REMOTE ] AGCO: No data returned for month 2025-11 [2025-11-03T17:06:41.554936] [FATAL] [REMOTE ] AGCO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:06:41.555031] [FATAL] [MAIN ] AGCO: Failed to fetch primary data. [2025-11-03T17:06:41.555107] [WARN ] [MAIN ] AGCO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:06:41.555191] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-11-03T17:06:41.555269] [DEBUG] [LOCAL ] AGCO: No primary data file found to delete. [2025-11-03T17:06:41.555320] [INFO ] [LOCAL ] AGCO: Starting deletion of derivative data. [2025-11-03T17:06:41.555577] [DEBUG] [LOCAL ] AGCO: Deleted derivative data file. [2025-11-03T17:06:41.555708] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AGCO took 38.3s. Estimated remaining: 4h 49m 20s. Rate: 8.0 symbols/min [2025-11-03T17:06:41.738063] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:41.762022] [DEBUG] [LOCAL ] AGO: Loaded 27543 existing records from primary storage. [2025-11-03T17:06:41.762253] [INFO ] [MAIN ] AGO: Loaded 27543 existing records. [2025-11-03T17:06:41.937242] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:06:41.937484] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-11-03T17:06:41.937533] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-11-03T17:06:41.938063] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-11-03T17:06:41.938123] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-11-03T17:06:42.302447] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:42.334813] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-11-03T17:06:42.796888] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T17:06:43.045142] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T17:06:43.134822] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-11-03T17:06:43.934848] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-11. [2025-11-03T17:06:44.457023] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:06:44.734859] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-11-03T17:06:45.534833] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-11-03T17:06:45.611355] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T17:06:46.235485] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-11 (2.30 seconds). [2025-11-03T17:06:46.237096] [INFO ] [REMOTE ] AGI: Full fetch complete (77423 records). [2025-11-03T17:06:46.237233] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-11-03T17:06:46.338791] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-11-03T17:06:46.639145] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-11-03T17:06:46.639343] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-11-03T17:06:46.640237] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-11-03T17:06:46.640338] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-11-03T17:06:46.642359] [DEBUG] [LOCAL ] AGI: Trimmed 77423 records to 53426 (keeping 200 days of data) [2025-11-03T17:06:46.814010] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T17:06:46.921604] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T17:06:47.030081] [DEBUG] [LOCAL ] AGI: Primary data saved (53426 records). [2025-11-03T17:06:47.030220] [INFO ] [MAIN ] AGI: Full history saved. [2025-11-03T17:06:47.030338] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 38.9s. Estimated remaining: 4h 47m 46s. Rate: 8.0 symbols/min [2025-11-03T17:06:47.140001] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-11-03T17:06:47.204288] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:06:47.233515] [DEBUG] [LOCAL ] AGRO: Loaded 32372 existing records from primary storage. [2025-11-03T17:06:47.233823] [INFO ] [MAIN ] AGRO: Loaded 32372 existing records. [2025-11-03T17:06:47.412812] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:06:47.413086] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-11-03T17:06:47.413134] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-11-03T17:06:47.413516] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-11-03T17:06:47.413578] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-11-03T17:06:47.770724] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:06:47.934862] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-11-03T17:06:48.734944] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-11-03T17:06:48.849466] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-11-03T17:06:49.044636] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:06:49.237011] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T17:06:49.534889] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-11-03T17:06:50.334855] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-11-03T17:06:51.116600] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:06:51.134809] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-11-03T17:06:51.271819] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-11-03T17:06:51.768318] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T17:06:51.934837] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-11-03T17:06:52.734865] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-11-03T17:06:52.774580] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T17:06:53.534886] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-11-03T17:06:53.678978] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T17:06:54.334944] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-11-03T17:06:54.597988] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:06:54.952898] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T17:06:55.134933] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-11-03T17:06:55.934858] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-11-03T17:06:56.370743] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T17:06:56.430716] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T17:06:56.734836] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-11-03T17:06:57.534885] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-11-03T17:06:57.699343] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T17:06:58.027373] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T17:06:58.334852] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-11-03T17:06:59.134887] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-11-03T17:06:59.764902] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T17:06:59.918188] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T17:06:59.934801] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-11-03T17:07:00.734829] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-11-03T17:07:00.919187] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-11-03T17:07:01.322023] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T17:07:01.534866] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-11-03T17:07:02.334901] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-11. [2025-11-03T17:07:02.750575] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T17:07:03.134934] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-11-03T17:07:03.298772] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T17:07:03.299796] [INFO ] [REMOTE ] AGM: Full fetch complete (13266 records). [2025-11-03T17:07:03.299874] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-11-03T17:07:03.672983] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-11-03T17:07:03.673060] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-11-03T17:07:03.673304] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-11-03T17:07:03.673345] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-11-03T17:07:03.673878] [DEBUG] [LOCAL ] AGM: Trimmed 13266 records to 10494 (keeping 200 days of data) [2025-11-03T17:07:03.738297] [DEBUG] [LOCAL ] AGM: Primary data saved (10494 records). [2025-11-03T17:07:03.738429] [INFO ] [MAIN ] AGM: Full history saved. [2025-11-03T17:07:03.738507] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGM took 26.6s. Estimated remaining: 4h 54m 6s. Rate: 7.9 symbols/min [2025-11-03T17:07:03.915284] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:03.934873] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-11. [2025-11-03T17:07:03.945782] [DEBUG] [LOCAL ] AGX: Loaded 32530 existing records from primary storage. [2025-11-03T17:07:03.946019] [INFO ] [MAIN ] AGX: Loaded 32530 existing records. [2025-11-03T17:07:04.153073] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T17:07:04.156952] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:07:04.164012] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-11-03T17:07:04.164139] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-11-03T17:07:04.164863] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-11-03T17:07:04.164935] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-11-03T17:07:04.529480] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:04.734897] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-11-03T17:07:05.172377] [DEBUG] [REMOTE ] AGL: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:07:05.172719] [WARN ] [REMOTE ] AGL: No data returned for month 2025-11 [2025-11-03T17:07:05.172805] [FATAL] [REMOTE ] AGL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:07:05.172891] [FATAL] [MAIN ] AGL: Failed to fetch primary data. [2025-11-03T17:07:05.172962] [WARN ] [MAIN ] AGL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:07:05.173036] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-11-03T17:07:05.173119] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-11-03T17:07:05.173202] [INFO ] [LOCAL ] AGL: Starting deletion of derivative data. [2025-11-03T17:07:05.173254] [DEBUG] [LOCAL ] AGL: No derivative data file found to delete. [2025-11-03T17:07:05.173303] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGL took 41.2s. Estimated remaining: 4h 49m 43s. Rate: 8.0 symbols/min [2025-11-03T17:07:05.340140] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:05.372946] [DEBUG] [LOCAL ] AHH: Loaded 40199 existing records from primary storage. [2025-11-03T17:07:05.373225] [INFO ] [MAIN ] AHH: Loaded 40199 existing records. [2025-11-03T17:07:05.550469] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-11-03T17:07:05.558963] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:07:05.559946] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-11-03T17:07:05.560015] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-11-03T17:07:05.560761] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-11-03T17:07:05.560878] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-11-03T17:07:05.669915] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T17:07:05.943989] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:06.334883] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-11-03T17:07:06.470193] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T17:07:07.134931] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-11-03T17:07:07.891618] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T17:07:07.934813] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-11-03T17:07:08.033232] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T17:07:08.734893] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-11-03T17:07:09.064715] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T17:07:09.534904] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-11-03T17:07:10.025118] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T17:07:10.334881] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-11-03T17:07:10.462138] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T17:07:11.134875] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-11-03T17:07:11.357872] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:07:11.934856] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-11-03T17:07:12.031540] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-11-03T17:07:12.734952] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-11-03T17:07:13.160577] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T17:07:13.534920] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-11-03T17:07:14.036097] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T17:07:14.334935] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-11-03T17:07:14.589731] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-11-03T17:07:15.134883] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-11-03T17:07:15.901504] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-11-03T17:07:15.934849] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-11-03T17:07:16.237021] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T17:07:16.734890] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-11-03T17:07:17.159638] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:07:17.534860] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-11-03T17:07:17.870862] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T17:07:18.334848] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-11-03T17:07:18.882873] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T17:07:19.134893] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-11-03T17:07:19.397379] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T17:07:19.934937] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-11-03T17:07:20.365485] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:07:20.734839] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-11-03T17:07:20.919109] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T17:07:21.534896] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-11-03T17:07:21.778934] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:07:22.334849] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-11. [2025-11-03T17:07:22.596803] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T17:07:23.134904] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-11-03T17:07:23.685090] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T17:07:23.686198] [INFO ] [REMOTE ] AGO: Full fetch complete (39556 records). [2025-11-03T17:07:23.686271] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-11-03T17:07:23.943123] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-11-03T17:07:24.088547] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-11-03T17:07:24.088668] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-11-03T17:07:24.089123] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-11-03T17:07:24.089197] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-11-03T17:07:24.090399] [DEBUG] [LOCAL ] AGO: Trimmed 39556 records to 27035 (keeping 200 days of data) [2025-11-03T17:07:24.195183] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T17:07:24.274991] [DEBUG] [LOCAL ] AGO: Primary data saved (27035 records). [2025-11-03T17:07:24.275119] [INFO ] [MAIN ] AGO: Full history saved. [2025-11-03T17:07:24.275194] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGO took 42.7s. Estimated remaining: 4h 57m 24s. Rate: 7.8 symbols/min [2025-11-03T17:07:24.444549] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:24.444757] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-11-03T17:07:24.444802] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-11-03T17:07:24.444907] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-11-03T17:07:24.444948] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-11-03T17:07:24.444989] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-11-03T17:07:24.445024] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-11-03T17:07:24.740041] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-11. [2025-11-03T17:07:24.796223] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:25.094988] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T17:07:25.534915] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-11-03T17:07:26.193990] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-11 (1.45 seconds). [2025-11-03T17:07:26.195087] [INFO ] [REMOTE ] AGRO: Full fetch complete (48479 records). [2025-11-03T17:07:26.195170] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-11-03T17:07:26.345612] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-11-03T17:07:26.585726] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:07:26.601470] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-11-03T17:07:26.601716] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-11-03T17:07:26.601922] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-11-03T17:07:26.602514] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-11-03T17:07:26.602617] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-11-03T17:07:26.602013] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:07:26.602768] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-11-03T17:07:26.602943] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:07:26.603029] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-11-03T17:07:26.603354] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-11-03T17:07:26.603463] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-11-03T17:07:26.603539] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-11-03T17:07:26.603704] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 2.3s. Estimated remaining: 4h 53m 42s. Rate: 7.9 symbols/min [2025-11-03T17:07:26.625460] [DEBUG] [LOCAL ] AGRO: Trimmed 48479 records to 31768 (keeping 200 days of data) [2025-11-03T17:07:26.863617] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:26.971202] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T17:07:26.993756] [DEBUG] [LOCAL ] AGRO: Primary data saved (31768 records). [2025-11-03T17:07:26.994070] [INFO ] [MAIN ] AGRO: Full history saved. [2025-11-03T17:07:26.994178] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AGRO took 40.0s. Estimated remaining: 4h 48m 51s. Rate: 8.0 symbols/min [2025-11-03T17:07:27.116990] [DEBUG] [LOCAL ] AHR: Loaded 49541 existing records from primary storage. [2025-11-03T17:07:27.138135] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-11-03T17:07:27.138419] [INFO ] [MAIN ] AHR: Loaded 49541 existing records. [2025-11-03T17:07:27.257876] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:27.364401] [DEBUG] [LOCAL ] AHT: Loaded 6540 existing records from primary storage. [2025-11-03T17:07:27.384789] [INFO ] [MAIN ] AHT: Loaded 6540 existing records. [2025-11-03T17:07:27.384612] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:07:27.427147] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-11-03T17:07:27.452865] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-11-03T17:07:27.483524] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-11-03T17:07:27.485986] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-11-03T17:07:27.679100] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:07:27.701587] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-11-03T17:07:27.711631] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-11-03T17:07:27.729000] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-11-03T17:07:27.736711] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-11-03T17:07:27.936485] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-11-03T17:07:28.140631] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:28.281497] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:28.299730] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T17:07:28.734877] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-11. [2025-11-03T17:07:29.239047] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T17:07:29.534828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-11-03T17:07:30.334869] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-11-03T17:07:30.482185] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-11 (1.75 seconds). [2025-11-03T17:07:30.483355] [INFO ] [REMOTE ] AGX: Full fetch complete (48205 records). [2025-11-03T17:07:30.483439] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-11-03T17:07:30.905910] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T17:07:30.931417] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-11-03T17:07:30.931503] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-11-03T17:07:30.932266] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-11-03T17:07:30.932617] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-11-03T17:07:30.934208] [DEBUG] [LOCAL ] AGX: Trimmed 48205 records to 31924 (keeping 200 days of data) [2025-11-03T17:07:31.128301] [DEBUG] [LOCAL ] AGX: Primary data saved (31924 records). [2025-11-03T17:07:31.128427] [INFO ] [MAIN ] AGX: Full history saved. [2025-11-03T17:07:31.128500] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGX took 27.4s. Estimated remaining: 4h 46m 34s. Rate: 8.0 symbols/min [2025-11-03T17:07:31.140138] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-11. [2025-11-03T17:07:31.298242] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:31.347693] [DEBUG] [LOCAL ] AI: Loaded 54545 existing records from primary storage. [2025-11-03T17:07:31.348127] [INFO ] [MAIN ] AI: Loaded 54545 existing records. [2025-11-03T17:07:31.551578] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:07:31.553406] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T17:07:31.562264] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-11-03T17:07:31.562910] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-11-03T17:07:31.563472] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-11-03T17:07:31.563529] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-11-03T17:07:31.919070] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:31.934817] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-11-03T17:07:32.734879] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-11-03T17:07:32.772855] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-11 (1.63 seconds). [2025-11-03T17:07:32.774175] [INFO ] [REMOTE ] AHH: Full fetch complete (59210 records). [2025-11-03T17:07:32.774251] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-11-03T17:07:33.148206] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-11-03T17:07:33.148302] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-11-03T17:07:33.148918] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-11-03T17:07:33.148980] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-11-03T17:07:33.150169] [DEBUG] [LOCAL ] AHH: Trimmed 59210 records to 39477 (keeping 200 days of data) [2025-11-03T17:07:33.370608] [DEBUG] [LOCAL ] AHH: Primary data saved (39477 records). [2025-11-03T17:07:33.370781] [INFO ] [MAIN ] AHH: Full history saved. [2025-11-03T17:07:33.371779] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AHH took 28.2s. Estimated remaining: 4h 43m 9s. Rate: 8.1 symbols/min [2025-11-03T17:07:33.541513] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:07:33.541625] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-11-03T17:07:33.595144] [DEBUG] [LOCAL ] AIG: Loaded 54227 existing records from primary storage. [2025-11-03T17:07:33.595490] [INFO ] [MAIN ] AIG: Loaded 54227 existing records. [2025-11-03T17:07:33.797618] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:07:33.798280] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-11-03T17:07:33.798559] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-11-03T17:07:33.799826] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-11-03T17:07:33.799995] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-11-03T17:07:34.061019] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T17:07:34.167951] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-11-03T17:07:34.166472] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T17:07:34.260401] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:07:34.334823] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-11-03T17:07:35.134914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-11-03T17:07:35.533848] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:07:35.934876] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-11-03T17:07:36.674891] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T17:07:36.734843] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-11-03T17:07:37.124569] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T17:07:37.534868] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-11-03T17:07:37.875342] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T17:07:37.905017] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T17:07:38.334861] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-11-03T17:07:39.134893] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-11-03T17:07:39.713985] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:07:39.934889] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-11-03T17:07:40.425346] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:07:40.734883] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-11-03T17:07:41.149146] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-11-03T17:07:41.370159] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T17:07:41.534914] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-11-03T17:07:42.334868] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-11-03T17:07:42.799829] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T17:07:42.929762] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T17:07:43.134919] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-11-03T17:07:43.934875] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-11-03T17:07:44.563805] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T17:07:44.616303] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T17:07:44.734863] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-11-03T17:07:45.534855] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-11-03T17:07:46.334883] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-11-03T17:07:46.593049] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-11-03T17:07:46.796194] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T17:07:46.860052] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:07:47.134867] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-11-03T17:07:47.934857] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-11-03T17:07:48.734857] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-11-03T17:07:49.145683] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-11-03T17:07:49.296146] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T17:07:49.523490] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T17:07:49.534803] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-11-03T17:07:50.019033] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-11-03T17:07:50.334871] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-11-03T17:07:51.134857] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-11-03T17:07:51.676876] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T17:07:51.934842] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-11-03T17:07:52.000125] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-11-03T17:07:52.734846] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-11-03T17:07:53.258518] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:07:53.534871] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-11-03T17:07:54.334826] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-11-03T17:07:54.386032] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-11-03T17:07:54.787447] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:07:55.134853] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-11-03T17:07:55.705738] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T17:07:55.934858] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-11-03T17:07:56.546488] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T17:07:56.734832] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-11-03T17:07:56.968887] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-11-03T17:07:57.534901] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-11-03T17:07:58.157460] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T17:07:58.334876] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-11-03T17:07:58.807799] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T17:07:59.134876] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-11. [2025-11-03T17:07:59.934950] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-11. [2025-11-03T17:08:00.237668] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-11-03T17:08:00.735841] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-11 (0.80 seconds). [2025-11-03T17:08:00.735703] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-11-03T17:08:00.737370] [INFO ] [REMOTE ] AHT: Full fetch complete (9072 records). [2025-11-03T17:08:00.737445] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-11-03T17:08:01.024889] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T17:08:01.054354] [INFO ] [REMOTE ] AHR: Full fetch complete (70965 records). [2025-11-03T17:08:01.060232] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-11-03T17:08:01.277173] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-11-03T17:08:01.288099] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-11-03T17:08:01.312115] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-11-03T17:08:01.322779] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-11-03T17:08:01.431028] [DEBUG] [LOCAL ] AHT: Trimmed 9072 records to 6501 (keeping 200 days of data) [2025-11-03T17:08:01.561915] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-11-03T17:08:01.672053] [DEBUG] [LOCAL ] AHT: Primary data saved (6501 records). [2025-11-03T17:08:01.672250] [INFO ] [MAIN ] AHT: Full history saved. [2025-11-03T17:08:01.684794] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHT took 34.7s. Estimated remaining: 4h 56m 0s. Rate: 7.8 symbols/min [2025-11-03T17:08:01.961686] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-11-03T17:08:01.986790] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-11-03T17:08:01.995462] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-11-03T17:08:01.996087] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-11-03T17:08:02.066717] [DEBUG] [LOCAL ] AHR: Trimmed 70965 records to 48889 (keeping 200 days of data) [2025-11-03T17:08:02.097593] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:02.097990] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-11-03T17:08:02.098238] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-11-03T17:08:02.098358] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-11-03T17:08:02.098405] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-11-03T17:08:02.098448] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-11-03T17:08:02.098480] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-11-03T17:08:02.735578] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:02.737559] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-11-03T17:08:02.820119] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-11-03T17:08:02.858053] [DEBUG] [LOCAL ] AHR: Primary data saved (48889 records). [2025-11-03T17:08:02.858166] [INFO ] [MAIN ] AHR: Full history saved. [2025-11-03T17:08:02.859036] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AHR took 36.3s. Estimated remaining: 4h 51m 53s. Rate: 7.9 symbols/min [2025-11-03T17:08:02.930284] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:08:02.953240] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-11-03T17:08:02.964295] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:08:02.964393] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-11-03T17:08:02.964456] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:08:02.970177] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-11-03T17:08:02.980506] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-11-03T17:08:02.990834] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-11-03T17:08:03.012615] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-11-03T17:08:03.020998] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AII took 1.3s. Estimated remaining: 4h 47m 18s. Rate: 8.0 symbols/min [2025-11-03T17:08:03.073484] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:03.137516] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-11-03T17:08:03.229780] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:03.238887] [DEBUG] [LOCAL ] AIN: Loaded 24586 existing records from primary storage. [2025-11-03T17:08:03.239164] [INFO ] [MAIN ] AIN: Loaded 24586 existing records. [2025-11-03T17:08:03.426762] [DEBUG] [LOCAL ] AIO: Loaded 12928 existing records from primary storage. [2025-11-03T17:08:03.427398] [INFO ] [MAIN ] AIO: Loaded 12928 existing records. [2025-11-03T17:08:03.437371] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:08:03.466630] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-11-03T17:08:03.486621] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-11-03T17:08:03.508318] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-11-03T17:08:03.525273] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-11-03T17:08:03.802757] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:08:03.838348] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-11-03T17:08:03.887824] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-11-03T17:08:03.919830] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-11-03T17:08:03.926190] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-11-03T17:08:04.249227] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:04.259321] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-11-03T17:08:04.251823] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-11-03T17:08:04.539740] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:04.615286] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T17:08:04.734850] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-11. [2025-11-03T17:08:05.144058] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T17:08:05.534872] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-11-03T17:08:05.841679] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T17:08:05.843189] [INFO ] [REMOTE ] AIG: Full fetch complete (77565 records). [2025-11-03T17:08:05.843278] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-11-03T17:08:06.238402] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-11-03T17:08:06.238525] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-11-03T17:08:06.239298] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-11-03T17:08:06.239361] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-11-03T17:08:06.240876] [DEBUG] [LOCAL ] AIG: Trimmed 77565 records to 53448 (keeping 200 days of data) [2025-11-03T17:08:06.334930] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-11-03T17:08:06.382631] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T17:08:06.636455] [DEBUG] [LOCAL ] AIG: Primary data saved (53448 records). [2025-11-03T17:08:06.636701] [INFO ] [MAIN ] AIG: Full history saved. [2025-11-03T17:08:06.637813] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AIG took 33.3s. Estimated remaining: 4h 44m 54s. Rate: 8.1 symbols/min [2025-11-03T17:08:06.876271] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:06.876788] [DEBUG] [LOCAL ] AIR: No existing data file found in primary storage. [2025-11-03T17:08:06.876839] [WARN ] [MAIN ] AIR: No existing data found, performing full refresh instead. [2025-11-03T17:08:06.876982] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-11-03T17:08:06.877028] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-11-03T17:08:06.877072] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-11-03T17:08:06.877137] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-11-03T17:08:07.141790] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-11-03T17:08:07.326174] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:07.747628] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T17:08:07.934867] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-11-03T17:08:08.224907] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-11-03T17:08:08.734843] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-11-03T17:08:08.883299] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T17:08:09.339229] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-11-03T17:08:09.534872] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-11-03T17:08:10.334837] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-11-03T17:08:10.392341] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-11-03T17:08:11.074958] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T17:08:11.134850] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-11-03T17:08:11.834551] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T17:08:11.934831] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-11-03T17:08:12.734834] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-11-03T17:08:12.820760] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:08:13.534856] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-11-03T17:08:13.754932] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T17:08:14.334830] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-11-03T17:08:14.437855] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-11-03T17:08:15.134950] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-11-03T17:08:15.934908] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-11-03T17:08:16.189980] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T17:08:16.467969] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-11-03T17:08:16.734815] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-11. [2025-11-03T17:08:16.792556] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-11-03T17:08:17.534916] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-11-03T17:08:18.343399] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-11-03T17:08:18.345723] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T17:08:19.134829] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-11-03T17:08:19.218921] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T17:08:19.864275] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T17:08:19.934861] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-11-03T17:08:20.185788] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-11 (3.45 seconds). [2025-11-03T17:08:20.187386] [INFO ] [REMOTE ] AI: Full fetch complete (77918 records). [2025-11-03T17:08:20.187497] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-11-03T17:08:20.589418] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-11-03T17:08:20.589498] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-11-03T17:08:20.590240] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-11-03T17:08:20.590305] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-11-03T17:08:20.591763] [DEBUG] [LOCAL ] AI: Trimmed 77918 records to 53765 (keeping 200 days of data) [2025-11-03T17:08:20.762076] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-11-03T17:08:20.927837] [DEBUG] [LOCAL ] AI: Primary data saved (53765 records). [2025-11-03T17:08:20.927967] [INFO ] [MAIN ] AI: Full history saved. [2025-11-03T17:08:20.928668] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AI took 49.8s. Estimated remaining: 4h 48m 45s. Rate: 8.0 symbols/min [2025-11-03T17:08:21.113365] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:21.121032] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T17:08:21.120420] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-11-03T17:08:21.127009] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-11-03T17:08:21.128153] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-11-03T17:08:21.128232] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-11-03T17:08:21.128285] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-11-03T17:08:21.128321] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-11-03T17:08:21.530336] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:21.535788] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-11-03T17:08:21.544124] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T17:08:22.334824] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-11-03T17:08:22.438926] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-11-03T17:08:23.134831] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-11-03T17:08:23.311433] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-11-03T17:08:23.934909] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-11-03T17:08:24.339208] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:08:24.734825] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-11-03T17:08:24.914565] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T17:08:25.534840] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-11-03T17:08:25.663626] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T17:08:26.092520] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-11-03T17:08:26.334862] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-11-03T17:08:27.091128] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T17:08:27.134847] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-11-03T17:08:27.852770] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-11-03T17:08:27.934819] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-11-03T17:08:28.530609] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T17:08:28.734825] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-11-03T17:08:29.534859] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-11-03T17:08:29.859714] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T17:08:30.076213] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T17:08:30.334863] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-11-03T17:08:31.134866] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-11-03T17:08:31.373084] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-11-03T17:08:31.852037] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-11-03T17:08:31.934853] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-11-03T17:08:32.734831] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-11. [2025-11-03T17:08:32.793882] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-11-03T17:08:33.534862] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-11-03T17:08:33.614541] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T17:08:33.615354] [INFO ] [REMOTE ] AIO: Full fetch complete (20121 records). [2025-11-03T17:08:33.615419] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-11-03T17:08:33.975166] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-11-03T17:08:33.975246] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-11-03T17:08:33.975519] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-11-03T17:08:33.975557] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-11-03T17:08:33.976112] [DEBUG] [LOCAL ] AIO: Trimmed 20121 records to 12741 (keeping 200 days of data) [2025-11-03T17:08:34.050227] [DEBUG] [LOCAL ] AIO: Primary data saved (12741 records). [2025-11-03T17:08:34.050352] [INFO ] [MAIN ] AIO: Full history saved. [2025-11-03T17:08:34.050428] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIO took 31.0s. Estimated remaining: 4h 51m 50s. Rate: 7.9 symbols/min [2025-11-03T17:08:34.214739] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:34.249967] [DEBUG] [LOCAL ] AIV: Loaded 42489 existing records from primary storage. [2025-11-03T17:08:34.250232] [INFO ] [MAIN ] AIV: Loaded 42489 existing records. [2025-11-03T17:08:34.339936] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-11. [2025-11-03T17:08:34.427819] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:08:34.428044] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-11-03T17:08:34.428090] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-11-03T17:08:34.428607] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-11-03T17:08:34.428700] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-11-03T17:08:34.793174] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:34.814571] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T17:08:35.134855] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-11. [2025-11-03T17:08:35.770722] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-11 (1.43 seconds). [2025-11-03T17:08:35.772535] [INFO ] [REMOTE ] AIR: Full fetch complete (40135 records). [2025-11-03T17:08:35.772841] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-11-03T17:08:35.965021] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-11-03T17:08:36.190322] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-11-03T17:08:36.190463] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-11-03T17:08:36.191049] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-11-03T17:08:36.191118] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-11-03T17:08:36.192551] [DEBUG] [LOCAL ] AIR: Trimmed 40135 records to 28450 (keeping 200 days of data) [2025-11-03T17:08:36.370086] [DEBUG] [LOCAL ] AIR: Primary data saved (28450 records). [2025-11-03T17:08:36.370273] [INFO ] [MAIN ] AIR: Full history saved. [2025-11-03T17:08:36.370361] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIR took 29.7s. Estimated remaining: 4h 48m 43s. Rate: 8.0 symbols/min [2025-11-03T17:08:36.561242] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:36.591185] [DEBUG] [LOCAL ] AIZ: Loaded 29093 existing records from primary storage. [2025-11-03T17:08:36.591557] [INFO ] [MAIN ] AIZ: Loaded 29093 existing records. [2025-11-03T17:08:36.681552] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-11 (1.55 seconds). [2025-11-03T17:08:36.718953] [INFO ] [REMOTE ] AIN: Full fetch complete (34071 records). [2025-11-03T17:08:36.729348] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-11-03T17:08:36.752523] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-11-03T17:08:36.802407] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:08:36.813148] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-11-03T17:08:36.823774] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-11-03T17:08:36.836582] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-11-03T17:08:36.848260] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-11-03T17:08:37.450365] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:37.537678] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-11-03T17:08:37.539865] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-11-03T17:08:37.540894] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-11-03T17:08:37.541298] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-11-03T17:08:37.541464] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-11-03T17:08:37.566743] [DEBUG] [LOCAL ] AIN: Trimmed 34071 records to 24197 (keeping 200 days of data) [2025-11-03T17:08:37.568711] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-11-03T17:08:37.721453] [DEBUG] [LOCAL ] AIN: Primary data saved (24197 records). [2025-11-03T17:08:37.721612] [INFO ] [MAIN ] AIN: Full history saved. [2025-11-03T17:08:37.721741] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIN took 34.9s. Estimated remaining: 4h 45m 9s. Rate: 8.1 symbols/min [2025-11-03T17:08:37.897063] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:37.901981] [DEBUG] [LOCAL ] AIZN: Loaded 3660 existing records from primary storage. [2025-11-03T17:08:37.902132] [INFO ] [MAIN ] AIZN: Loaded 3660 existing records. [2025-11-03T17:08:38.081408] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:08:38.081815] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-11-03T17:08:38.081946] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-11-03T17:08:38.082180] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-11-03T17:08:38.082286] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-11-03T17:08:38.219210] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T17:08:38.340084] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-11-03T17:08:38.471886] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:38.607067] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T17:08:39.134854] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-11-03T17:08:39.523696] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T17:08:39.934899] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-11-03T17:08:40.256121] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T17:08:40.382876] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-11-03T17:08:40.734919] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-11-03T17:08:41.534839] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-11-03T17:08:41.819056] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T17:08:42.334853] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-11-03T17:08:42.666180] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T17:08:43.134818] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-11-03T17:08:43.380075] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T17:08:43.934856] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-11-03T17:08:44.177327] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T17:08:44.734857] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-11-03T17:08:45.057018] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T17:08:45.080392] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T17:08:45.534848] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-11-03T17:08:46.334865] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-11-03T17:08:46.695606] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T17:08:46.762077] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T17:08:47.134900] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-11-03T17:08:47.934862] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-11-03T17:08:48.178846] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:08:48.323776] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-11-03T17:08:48.734848] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-11-03T17:08:49.534841] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-11-03T17:08:49.903377] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T17:08:50.334866] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-11-03T17:08:50.334804] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T17:08:50.712185] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-11-03T17:08:51.134858] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-11-03T17:08:51.934867] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-11-03T17:08:52.147060] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T17:08:52.310868] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-11-03T17:08:52.734888] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-11-03T17:08:53.524417] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T17:08:53.534816] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-11-03T17:08:54.334844] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-11-03T17:08:54.465829] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T17:08:54.725164] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T17:08:55.134916] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-11-03T17:08:55.934901] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-11-03T17:08:56.374838] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T17:08:56.463924] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:08:56.734882] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-11. [2025-11-03T17:08:57.534857] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-11-03T17:08:58.334873] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-11-03T17:08:58.445931] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-11 (1.71 seconds). [2025-11-03T17:08:58.447039] [INFO ] [REMOTE ] AIT: Full fetch complete (38950 records). [2025-11-03T17:08:58.447144] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-11-03T17:08:58.815236] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-11-03T17:08:58.815314] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-11-03T17:08:58.815773] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-11-03T17:08:58.815835] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-11-03T17:08:58.816696] [DEBUG] [LOCAL ] AIT: Trimmed 38950 records to 25978 (keeping 200 days of data) [2025-11-03T17:08:58.977776] [DEBUG] [LOCAL ] AIT: Primary data saved (25978 records). [2025-11-03T17:08:58.977901] [INFO ] [MAIN ] AIT: Full history saved. [2025-11-03T17:08:58.977969] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIT took 38.0s. Estimated remaining: 4h 52m 35s. Rate: 7.8 symbols/min [2025-11-03T17:08:59.153707] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:08:59.150247] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-11-03T17:08:59.175963] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-11-03T17:08:59.220129] [DEBUG] [LOCAL ] AJG: Loaded 46977 existing records from primary storage. [2025-11-03T17:08:59.220405] [INFO ] [MAIN ] AJG: Loaded 46977 existing records. [2025-11-03T17:08:59.394454] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:08:59.394666] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-11-03T17:08:59.394727] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-11-03T17:08:59.395170] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-11-03T17:08:59.395209] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-11-03T17:08:59.766232] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:08:59.770993] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T17:08:59.790267] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T17:08:59.934868] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-11-03T17:09:00.734851] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-11-03T17:09:01.228586] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T17:09:01.511376] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T17:09:01.534811] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-11. [2025-11-03T17:09:02.235868] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T17:09:02.236825] [INFO ] [REMOTE ] AIZN: Full fetch complete (5435 records). [2025-11-03T17:09:02.236943] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-11-03T17:09:02.340101] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-11-03T17:09:02.624807] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-11-03T17:09:02.624893] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-11-03T17:09:02.625062] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-11-03T17:09:02.625101] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-11-03T17:09:02.625545] [DEBUG] [LOCAL ] AIZN: Trimmed 5435 records to 3605 (keeping 200 days of data) [2025-11-03T17:09:02.648469] [DEBUG] [LOCAL ] AIZN: Primary data saved (3605 records). [2025-11-03T17:09:02.648610] [INFO ] [MAIN ] AIZN: Full history saved. [2025-11-03T17:09:02.648723] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIZN took 24.9s. Estimated remaining: 4h 50m 19s. Rate: 7.9 symbols/min [2025-11-03T17:09:02.823843] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:09:02.824089] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-11-03T17:09:02.824133] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-11-03T17:09:02.824247] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-11-03T17:09:02.824288] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-11-03T17:09:02.824329] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-11-03T17:09:02.824362] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-11-03T17:09:03.142537] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-11-03T17:09:03.184305] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:09:03.475325] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T17:09:03.934908] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-11-03T17:09:04.416262] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T17:09:04.585830] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-11-03T17:09:04.734884] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-11-03T17:09:05.060571] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T17:09:05.534850] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-11-03T17:09:06.334851] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-11-03T17:09:06.945018] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:09:07.134822] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-11-03T17:09:07.187956] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T17:09:07.934849] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-11-03T17:09:08.468802] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:09:08.734843] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-11-03T17:09:08.820860] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T17:09:09.534915] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-11-03T17:09:09.874495] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T17:09:09.888191] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T17:09:10.334858] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-11-03T17:09:11.134856] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-11-03T17:09:11.581123] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T17:09:11.934877] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-11. [2025-11-03T17:09:12.734864] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-11-03T17:09:12.875743] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-11-03T17:09:13.362475] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-11 (1.43 seconds). [2025-11-03T17:09:13.363567] [INFO ] [REMOTE ] AIZ: Full fetch complete (42673 records). [2025-11-03T17:09:13.363637] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-11-03T17:09:13.541226] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-11-03T17:09:13.811631] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-11-03T17:09:13.811747] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-11-03T17:09:13.812198] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-11-03T17:09:13.812237] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-11-03T17:09:13.813164] [DEBUG] [LOCAL ] AIZ: Trimmed 42673 records to 28599 (keeping 200 days of data) [2025-11-03T17:09:13.924694] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T17:09:14.021672] [DEBUG] [LOCAL ] AIZ: Primary data saved (28599 records). [2025-11-03T17:09:14.022155] [INFO ] [MAIN ] AIZ: Full history saved. [2025-11-03T17:09:14.023129] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T17:09:14.023243] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIZ took 37.7s. Estimated remaining: 4h 52m 12s. Rate: 7.9 symbols/min [2025-11-03T17:09:14.199240] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:09:14.199404] [DEBUG] [LOCAL ] AKR: No existing data file found in primary storage. [2025-11-03T17:09:14.199440] [WARN ] [MAIN ] AKR: No existing data found, performing full refresh instead. [2025-11-03T17:09:14.199548] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-11-03T17:09:14.199588] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-11-03T17:09:14.199628] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-11-03T17:09:14.199695] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-11-03T17:09:14.342160] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-11-03T17:09:14.558932] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:09:15.134911] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-11-03T17:09:15.822234] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T17:09:15.934891] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-11-03T17:09:16.283526] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T17:09:16.401075] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T17:09:16.734887] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-11-03T17:09:17.534904] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-11-03T17:09:17.800100] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T17:09:17.813502] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-11-03T17:09:18.334896] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-11-03T17:09:18.616759] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-11-03T17:09:19.134880] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-11. [2025-11-03T17:09:19.934908] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-11-03T17:09:20.734863] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-11-03T17:09:21.094873] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T17:09:21.164525] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-11 (2.03 seconds). [2025-11-03T17:09:21.166250] [INFO ] [REMOTE ] AIV: Full fetch complete (60392 records). [2025-11-03T17:09:21.166395] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-11-03T17:09:21.540050] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-11-03T17:09:21.612489] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-11-03T17:09:21.612599] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-11-03T17:09:21.613376] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-11-03T17:09:21.613444] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-11-03T17:09:21.615146] [DEBUG] [LOCAL ] AIV: Trimmed 60392 records to 41968 (keeping 200 days of data) [2025-11-03T17:09:21.883205] [DEBUG] [LOCAL ] AIV: Primary data saved (41968 records). [2025-11-03T17:09:21.883538] [INFO ] [MAIN ] AIV: Full history saved. [2025-11-03T17:09:21.883738] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AIV took 47.8s. Estimated remaining: 4h 52m 11s. Rate: 7.8 symbols/min [2025-11-03T17:09:22.083987] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T17:09:22.103953] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:09:22.158880] [DEBUG] [LOCAL ] AL: Loaded 45397 existing records from primary storage. [2025-11-03T17:09:22.159183] [INFO ] [MAIN ] AL: Loaded 45397 existing records. [2025-11-03T17:09:22.349356] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-11-03T17:09:22.356464] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:09:22.356819] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-11-03T17:09:22.356904] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-11-03T17:09:22.357709] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-11-03T17:09:22.357770] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-11-03T17:09:22.752752] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:09:22.908635] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T17:09:23.134870] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-11-03T17:09:23.904507] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T17:09:23.934815] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-11-03T17:09:24.109851] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-11-03T17:09:24.734953] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-11-03T17:09:25.046450] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-11-03T17:09:25.200775] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:09:25.534893] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-11-03T17:09:26.334868] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-11-03T17:09:26.711230] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-11-03T17:09:26.819484] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:09:27.134885] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-11-03T17:09:27.934890] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-11-03T17:09:28.502112] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T17:09:28.540910] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T17:09:28.734938] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-11. [2025-11-03T17:09:29.534915] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-11-03T17:09:30.334922] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-11. [2025-11-03T17:09:30.700385] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T17:09:30.878373] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-11 (2.14 seconds). [2025-11-03T17:09:30.879829] [INFO ] [REMOTE ] AJG: Full fetch complete (68759 records). [2025-11-03T17:09:30.879913] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-11-03T17:09:31.139691] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-11-03T17:09:31.143102] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T17:09:31.172769] [INFO ] [REMOTE ] AKA: Full fetch complete (2823 records). [2025-11-03T17:09:31.183323] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-11-03T17:09:31.358859] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-11-03T17:09:31.380611] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-11-03T17:09:31.381724] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-11-03T17:09:31.397450] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-11-03T17:09:31.461719] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-11-03T17:09:31.462035] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-11-03T17:09:31.462250] [DEBUG] [LOCAL ] AJG: Trimmed 68759 records to 46324 (keeping 200 days of data) [2025-11-03T17:09:31.462117] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-11-03T17:09:31.462371] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-11-03T17:09:31.462471] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-11-03T17:09:31.462841] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-11-03T17:09:31.462907] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-11-03T17:09:31.462998] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AKA took 28.8s. Estimated remaining: 4h 53m 3s. Rate: 7.8 symbols/min [2025-11-03T17:09:31.765330] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:09:31.939125] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-11-03T17:09:31.961036] [DEBUG] [LOCAL ] AJG: Primary data saved (46324 records). [2025-11-03T17:09:31.961356] [INFO ] [MAIN ] AJG: Full history saved. [2025-11-03T17:09:31.962276] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AJG took 33.0s. Estimated remaining: 4h 49m 16s. Rate: 7.9 symbols/min [2025-11-03T17:09:32.066799] [DEBUG] [LOCAL ] ALB: Loaded 54123 existing records from primary storage. [2025-11-03T17:09:32.091144] [INFO ] [MAIN ] ALB: Loaded 54123 existing records. [2025-11-03T17:09:32.279984] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:09:32.363735] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:09:32.364202] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-11-03T17:09:32.364353] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-11-03T17:09:32.365111] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-11-03T17:09:32.365210] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-11-03T17:09:32.632165] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T17:09:32.694931] [DEBUG] [LOCAL ] ALC: Loaded 51876 existing records from primary storage. [2025-11-03T17:09:32.716374] [INFO ] [MAIN ] ALC: Loaded 51876 existing records. [2025-11-03T17:09:32.747034] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-11-03T17:09:32.928150] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:09:33.003059] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:09:33.003261] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-11-03T17:09:33.003309] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-11-03T17:09:33.003791] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-11-03T17:09:33.003849] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-11-03T17:09:33.370736] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:09:33.397164] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T17:09:33.534846] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-11-03T17:09:33.898484] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-11-03T17:09:34.334869] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-11-03T17:09:34.728714] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T17:09:35.134879] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-11-03T17:09:35.870895] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T17:09:35.934832] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-11-03T17:09:36.664385] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T17:09:36.734842] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-11-03T17:09:37.328463] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-11-03T17:09:37.534841] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-11-03T17:09:37.959942] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:09:38.334866] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-11-03T17:09:38.941063] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:09:39.134847] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-11-03T17:09:39.563171] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T17:09:39.934900] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-11-03T17:09:40.394973] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T17:09:40.734854] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-11-03T17:09:41.182297] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T17:09:41.534945] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-11-03T17:09:42.022253] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T17:09:42.334858] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-11-03T17:09:43.142434] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-11-03T17:09:43.148129] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T17:09:43.934874] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-11-03T17:09:44.085896] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-11-03T17:09:44.650495] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T17:09:44.734863] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-11-03T17:09:45.390219] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T17:09:45.534843] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-11-03T17:09:45.766360] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T17:09:46.334851] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-11-03T17:09:47.075150] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T17:09:47.134834] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-11-03T17:09:47.653844] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T17:09:47.934848] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-11. [2025-11-03T17:09:48.328427] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T17:09:48.734863] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-11-03T17:09:49.534916] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-11-03T17:09:49.919597] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T17:09:49.921066] [INFO ] [REMOTE ] AKR: Full fetch complete (65692 records). [2025-11-03T17:09:49.921155] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-11-03T17:09:50.339976] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-11-03T17:09:50.400198] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-11-03T17:09:50.400305] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-11-03T17:09:50.401101] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-11-03T17:09:50.401167] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-11-03T17:09:50.402708] [DEBUG] [LOCAL ] AKR: Trimmed 65692 records to 46136 (keeping 200 days of data) [2025-11-03T17:09:50.701772] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-11-03T17:09:50.737626] [DEBUG] [LOCAL ] AKR: Primary data saved (46136 records). [2025-11-03T17:09:50.737833] [INFO ] [MAIN ] AKR: Full history saved. [2025-11-03T17:09:50.738055] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AKR took 36.7s. Estimated remaining: 4h 54m 46s. Rate: 7.8 symbols/min [2025-11-03T17:09:50.941371] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:09:50.972581] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T17:09:51.010223] [DEBUG] [LOCAL ] ALE: Loaded 32228 existing records from primary storage. [2025-11-03T17:09:51.010484] [INFO ] [MAIN ] ALE: Loaded 32228 existing records. [2025-11-03T17:09:51.146325] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-11-03T17:09:51.189568] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:09:51.190586] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-11-03T17:09:51.190636] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-11-03T17:09:51.191193] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-11-03T17:09:51.191251] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-11-03T17:09:51.551592] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:09:51.685902] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-11-03T17:09:51.934825] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-11-03T17:09:52.734872] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-11-03T17:09:53.200582] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-11-03T17:09:53.248518] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T17:09:53.534895] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-11-03T17:09:54.289799] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-11-03T17:09:54.334822] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-11-03T17:09:55.134862] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-11-03T17:09:55.524380] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-11-03T17:09:55.572495] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T17:09:55.934878] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-11-03T17:09:56.002131] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T17:09:56.734882] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-11-03T17:09:57.357513] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T17:09:57.531030] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T17:09:57.535894] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-11-03T17:09:58.334917] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-11-03T17:09:59.134872] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-11. [2025-11-03T17:09:59.170574] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T17:09:59.554631] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-11-03T17:09:59.934881] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-11. [2025-11-03T17:10:00.734908] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-11-03T17:10:01.254715] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-11 (2.12 seconds). [2025-11-03T17:10:01.256126] [INFO ] [REMOTE ] AL: Full fetch complete (63998 records). [2025-11-03T17:10:01.256251] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-11-03T17:10:01.539998] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-11-03T17:10:01.692709] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-11-03T17:10:01.692847] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-11-03T17:10:01.697904] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-11 (1.76 seconds). [2025-11-03T17:10:01.697612] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-11-03T17:10:01.699531] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-11-03T17:10:01.700270] [INFO ] [REMOTE ] ALB: Full fetch complete (77141 records). [2025-11-03T17:10:01.700719] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-11-03T17:10:01.737963] [DEBUG] [LOCAL ] AL: Trimmed 63998 records to 44722 (keeping 200 days of data) [2025-11-03T17:10:02.341101] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-11-03T17:10:02.367945] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-11-03T17:10:02.370088] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-11-03T17:10:02.370461] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-11-03T17:10:02.383255] [DEBUG] [LOCAL ] ALB: Trimmed 77141 records to 53339 (keeping 200 days of data) [2025-11-03T17:10:02.551154] [DEBUG] [LOCAL ] AL: Primary data saved (44722 records). [2025-11-03T17:10:02.554455] [INFO ] [MAIN ] AL: Full history saved. [2025-11-03T17:10:02.554582] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AL took 40.7s. Estimated remaining: 4h 56m 40s. Rate: 7.7 symbols/min [2025-11-03T17:10:02.673568] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:10:02.682878] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-11-03T17:10:02.796463] [DEBUG] [LOCAL ] ALB: Primary data saved (53339 records). [2025-11-03T17:10:02.796603] [INFO ] [MAIN ] ALB: Full history saved. [2025-11-03T17:10:02.797799] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALB took 31.3s. Estimated remaining: 4h 52m 52s. Rate: 7.8 symbols/min [2025-11-03T17:10:03.033703] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-11-03T17:10:03.134888] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-11-03T17:10:03.534305] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-11-03T17:10:03.934855] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-11-03T17:10:04.527197] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T17:10:04.734914] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-11-03T17:10:05.244423] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T17:10:05.534880] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-11-03T17:10:06.435771] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T17:10:06.448990] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-11. [2025-11-03T17:10:06.703752] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T17:10:07.134848] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-11-03T17:10:08.409399] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:10:08.409672] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-11 (1.96 seconds). [2025-11-03T17:10:08.423029] [INFO ] [REMOTE ] ALC: Full fetch complete (74030 records). [2025-11-03T17:10:08.422932] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-11-03T17:10:08.424195] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-11-03T17:10:08.885267] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-11-03T17:10:08.885346] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-11-03T17:10:08.886054] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-11-03T17:10:08.886118] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-11-03T17:10:08.890581] [DEBUG] [LOCAL ] ALC: Trimmed 74030 records to 51117 (keeping 200 days of data) [2025-11-03T17:10:09.180522] [DEBUG] [LOCAL ] ALC: Primary data saved (51117 records). [2025-11-03T17:10:09.180670] [INFO ] [MAIN ] ALC: Full history saved. [2025-11-03T17:10:09.180768] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALC took 37.2s. Estimated remaining: 4h 52m 6s. Rate: 7.8 symbols/min [2025-11-03T17:10:09.541142] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T17:10:09.550282] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-11-03T17:10:10.673322] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T17:10:10.682143] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-11. [2025-11-03T17:10:12.191709] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T17:10:12.192940] [INFO ] [REMOTE ] ALE: Full fetch complete (44501 records). [2025-11-03T17:10:12.193023] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-11-03T17:10:12.582355] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-11-03T17:10:12.582433] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-11-03T17:10:12.582953] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-11-03T17:10:12.583015] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-11-03T17:10:12.584032] [DEBUG] [LOCAL ] ALE: Trimmed 44501 records to 31960 (keeping 200 days of data) [2025-11-03T17:10:12.772380] [DEBUG] [LOCAL ] ALE: Primary data saved (31960 records). [2025-11-03T17:10:12.772533] [INFO ] [MAIN ] ALE: Full history saved. [2025-11-03T17:10:12.773614] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALE took 22.0s. Estimated remaining: 4h 50m 2s. Rate: 7.9 symbols/min [2025-11-03T17:10:13.402276] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:13.474963] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:13.475778] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:13.475912] [DEBUG] [LOCAL ] ALEX: No existing data file found in primary storage. [2025-11-03T17:10:13.478367] [WARN ] [MAIN ] ALEX: No existing data found, performing full refresh instead. [2025-11-03T17:10:13.480965] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:13.481210] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-11-03T17:10:13.481157] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-11-03T17:10:13.481930] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-11-03T17:10:13.482094] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-11-03T17:10:13.481974] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-11-03T17:10:13.482373] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-11-03T17:10:13.482548] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-11-03T17:10:13.482503] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-11-03T17:10:13.482798] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-11-03T17:10:13.482869] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-11-03T17:10:13.657446] [DEBUG] [LOCAL ] ALG: Loaded 9664 existing records from primary storage. [2025-11-03T17:10:13.691861] [INFO ] [MAIN ] ALG: Loaded 9664 existing records. [2025-11-03T17:10:14.121876] [DEBUG] [LOCAL ] ALIT: Loaded 53532 existing records from primary storage. [2025-11-03T17:10:14.224340] [INFO ] [MAIN ] ALIT: Loaded 53532 existing records. [2025-11-03T17:10:14.480236] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:14.524934] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-11-03T17:10:14.556562] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:14.552972] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-11-03T17:10:14.575930] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-11-03T17:10:14.575866] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:14.586324] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-11-03T17:10:14.586621] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-11-03T17:10:14.572520] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-11-03T17:10:14.703878] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:14.758989] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-11-03T17:10:14.761635] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-11-03T17:10:14.778586] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-11-03T17:10:14.801305] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-11-03T17:10:14.864164] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:10:14.927299] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-11-03T17:10:14.969872] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:10:15.016431] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-11-03T17:10:15.048759] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:10:15.054174] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-11-03T17:10:15.099069] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-11-03T17:10:15.127396] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-11-03T17:10:15.154776] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-11-03T17:10:15.168159] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.4s. Estimated remaining: 4h 47m 28s. Rate: 7.9 symbols/min [2025-11-03T17:10:15.308890] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:15.325792] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-11-03T17:10:15.558241] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:15.582859] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:15.583224] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-11-03T17:10:15.628486] [DEBUG] [LOCAL ] ALK: Loaded 53863 existing records from primary storage. [2025-11-03T17:10:15.628839] [INFO ] [MAIN ] ALK: Loaded 53863 existing records. [2025-11-03T17:10:15.805948] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:15.806256] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-11-03T17:10:15.806427] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-11-03T17:10:15.816156] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-11-03T17:10:15.825947] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-11-03T17:10:15.857847] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T17:10:15.906509] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-11-03T17:10:16.176504] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T17:10:16.198290] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-11-03T17:10:16.195374] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:16.199255] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-11-03T17:10:16.611465] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T17:10:16.616760] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-11-03T17:10:16.781375] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T17:10:16.784262] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-11-03T17:10:16.951471] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:10:17.503051] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T17:10:17.521954] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T17:10:17.534810] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-11-03T17:10:17.679260] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:10:18.134867] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-11-03T17:10:18.334903] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-11-03T17:10:19.134833] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-11-03T17:10:19.434945] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T17:10:19.934953] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-11-03T17:10:20.392718] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T17:10:20.734852] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-11-03T17:10:20.907741] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-11-03T17:10:21.140916] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T17:10:21.534851] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-11-03T17:10:22.179460] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T17:10:22.334862] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-11-03T17:10:23.134911] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-11-03T17:10:23.762435] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T17:10:23.934917] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-11-03T17:10:24.505852] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T17:10:24.740894] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-11-03T17:10:24.746001] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T17:10:25.382308] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T17:10:25.534915] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-11-03T17:10:26.334885] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-11-03T17:10:26.689098] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T17:10:27.134848] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-11-03T17:10:27.662253] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:10:27.934905] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-11-03T17:10:28.516490] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:10:28.734957] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-11-03T17:10:29.174151] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T17:10:29.534854] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-11-03T17:10:30.145332] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T17:10:30.335024] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-11-03T17:10:30.335098] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-11-03T17:10:31.134841] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-11-03T17:10:31.229545] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T17:10:31.934863] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-11-03T17:10:32.501066] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T17:10:32.678308] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T17:10:32.734852] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-11-03T17:10:33.291023] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-11-03T17:10:33.534872] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-11-03T17:10:34.334835] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-11. [2025-11-03T17:10:35.134835] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-11-03T17:10:35.273109] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T17:10:35.274762] [INFO ] [REMOTE ] ALG: Full fetch complete (14999 records). [2025-11-03T17:10:35.276026] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-11-03T17:10:35.275922] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-11-03T17:10:35.675110] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-11-03T17:10:35.675177] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-11-03T17:10:35.675437] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-11-03T17:10:35.675475] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-11-03T17:10:35.675998] [DEBUG] [LOCAL ] ALG: Trimmed 14999 records to 9467 (keeping 200 days of data) [2025-11-03T17:10:35.736375] [DEBUG] [LOCAL ] ALG: Primary data saved (9467 records). [2025-11-03T17:10:35.736503] [INFO ] [MAIN ] ALG: Full history saved. [2025-11-03T17:10:35.736578] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 23.0s. Estimated remaining: 4h 53m 23s. Rate: 7.8 symbols/min [2025-11-03T17:10:35.901246] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:35.945583] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-11-03T17:10:35.948386] [DEBUG] [LOCAL ] ALL: Loaded 50082 existing records from primary storage. [2025-11-03T17:10:35.948784] [INFO ] [MAIN ] ALL: Loaded 50082 existing records. [2025-11-03T17:10:36.123824] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:36.124048] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-11-03T17:10:36.124098] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-11-03T17:10:36.124414] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-11-03T17:10:36.124471] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-11-03T17:10:36.508785] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:36.537204] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T17:10:36.734861] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-11-03T17:10:37.384712] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T17:10:37.534837] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-11-03T17:10:37.853061] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T17:10:38.334873] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-11-03T17:10:38.882630] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T17:10:39.134876] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-11-03T17:10:39.855483] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T17:10:39.934881] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-11-03T17:10:40.522389] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T17:10:40.734843] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-11-03T17:10:41.504806] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-11-03T17:10:41.534810] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-11-03T17:10:42.334886] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-11-03T17:10:42.397756] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-11-03T17:10:42.719197] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:10:43.134848] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-11. [2025-11-03T17:10:43.641224] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T17:10:43.934859] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-11-03T17:10:44.734832] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-11-03T17:10:45.350949] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:10:45.534849] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-11-03T17:10:45.626855] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-11 (2.49 seconds). [2025-11-03T17:10:45.628331] [INFO ] [REMOTE ] ALK: Full fetch complete (77054 records). [2025-11-03T17:10:45.628418] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-11-03T17:10:46.024524] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-11-03T17:10:46.024745] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-11-03T17:10:46.025519] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-11-03T17:10:46.025600] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-11-03T17:10:46.027073] [DEBUG] [LOCAL ] ALK: Trimmed 77054 records to 53086 (keeping 200 days of data) [2025-11-03T17:10:46.132977] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T17:10:46.336141] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-11-03T17:10:46.358815] [DEBUG] [LOCAL ] ALK: Primary data saved (53086 records). [2025-11-03T17:10:46.358906] [INFO ] [MAIN ] ALK: Full history saved. [2025-11-03T17:10:46.358981] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALK took 31.1s. Estimated remaining: 4h 54m 35s. Rate: 7.7 symbols/min [2025-11-03T17:10:46.525136] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:46.564203] [DEBUG] [LOCAL ] ALLE: Loaded 44193 existing records from primary storage. [2025-11-03T17:10:46.564478] [INFO ] [MAIN ] ALLE: Loaded 44193 existing records. [2025-11-03T17:10:46.741741] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:46.742039] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-11-03T17:10:46.742146] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-11-03T17:10:46.742476] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-11-03T17:10:46.742517] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-11-03T17:10:47.054852] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T17:10:47.134915] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-11. [2025-11-03T17:10:47.134838] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:47.844172] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T17:10:47.934819] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-11-03T17:10:48.734821] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-11. [2025-11-03T17:10:48.748705] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-11 (1.61 seconds). [2025-11-03T17:10:48.749980] [INFO ] [REMOTE ] ALEX: Full fetch complete (44817 records). [2025-11-03T17:10:48.750056] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-11-03T17:10:49.120538] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-11-03T17:10:49.120613] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-11-03T17:10:49.121120] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-11-03T17:10:49.121176] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-11-03T17:10:49.122165] [DEBUG] [LOCAL ] ALEX: Trimmed 44817 records to 30367 (keeping 200 days of data) [2025-11-03T17:10:49.302598] [DEBUG] [LOCAL ] ALEX: Primary data saved (30367 records). [2025-11-03T17:10:49.302763] [INFO ] [MAIN ] ALEX: Full history saved. [2025-11-03T17:10:49.302857] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALEX took 36.5s. Estimated remaining: 4h 52m 17s. Rate: 7.8 symbols/min [2025-11-03T17:10:49.481604] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:49.511139] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-11-03T17:10:49.545102] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-11-03T17:10:49.567388] [DEBUG] [LOCAL ] ALLY: Loaded 53965 existing records from primary storage. [2025-11-03T17:10:49.567716] [INFO ] [MAIN ] ALLY: Loaded 53965 existing records. [2025-11-03T17:10:49.761898] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:49.762142] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-11-03T17:10:49.762221] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-11-03T17:10:49.762633] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-11-03T17:10:49.762738] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-11-03T17:10:49.860775] [DEBUG] [REMOTE ] ALIT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:10:49.863738] [WARN ] [REMOTE ] ALIT: No data returned for month 2025-11 [2025-11-03T17:10:49.869439] [FATAL] [REMOTE ] ALIT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:10:49.885011] [FATAL] [MAIN ] ALIT: Failed to fetch primary data. [2025-11-03T17:10:49.926990] [WARN ] [MAIN ] ALIT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:10:49.960445] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-11-03T17:10:50.016543] [DEBUG] [LOCAL ] ALIT: No primary data file found to delete. [2025-11-03T17:10:50.058111] [INFO ] [LOCAL ] ALIT: Starting deletion of derivative data. [2025-11-03T17:10:50.097696] [DEBUG] [LOCAL ] ALIT: Deleted derivative data file. [2025-11-03T17:10:50.108437] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALIT took 37.3s. Estimated remaining: 4h 49m 5s. Rate: 7.9 symbols/min [2025-11-03T17:10:50.336813] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-11-03T17:10:50.345262] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:50.451265] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:10:50.512322] [DEBUG] [LOCAL ] ALSN: Loaded 43706 existing records from primary storage. [2025-11-03T17:10:50.512822] [INFO ] [MAIN ] ALSN: Loaded 43706 existing records. [2025-11-03T17:10:50.799965] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:10:50.800413] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-11-03T17:10:50.800496] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-11-03T17:10:50.801278] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-11-03T17:10:50.801469] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-11-03T17:10:51.146509] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-11-03T17:10:51.146594] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-11-03T17:10:51.323488] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:10:51.850398] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T17:10:51.934854] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-11-03T17:10:52.734821] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-11-03T17:10:52.831277] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-11-03T17:10:53.255245] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T17:10:53.534910] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-11-03T17:10:53.907022] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:10:54.334862] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-11-03T17:10:54.731309] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:10:55.134849] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-11-03T17:10:55.675787] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T17:10:55.934862] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-11-03T17:10:56.272522] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:10:56.734891] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-11-03T17:10:57.521553] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-11-03T17:10:57.534821] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-11-03T17:10:58.052567] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T17:10:58.334910] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-11-03T17:10:59.006390] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T17:10:59.134880] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-11-03T17:10:59.549356] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:10:59.934865] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-11-03T17:11:00.333395] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T17:11:00.734894] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-11-03T17:11:01.473367] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-11-03T17:11:01.534908] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-11-03T17:11:02.137816] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T17:11:02.334891] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-11. [2025-11-03T17:11:02.730349] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T17:11:03.134877] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-11-03T17:11:03.696014] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-11 (1.36 seconds). [2025-11-03T17:11:03.697511] [INFO ] [REMOTE ] ALL: Full fetch complete (72220 records). [2025-11-03T17:11:03.697668] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-11-03T17:11:03.941430] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-11-03T17:11:04.088477] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-11-03T17:11:04.088582] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-11-03T17:11:04.090065] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-11-03T17:11:04.090130] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-11-03T17:11:04.091572] [DEBUG] [LOCAL ] ALL: Trimmed 72220 records to 49337 (keeping 200 days of data) [2025-11-03T17:11:04.392091] [DEBUG] [LOCAL ] ALL: Primary data saved (49337 records). [2025-11-03T17:11:04.392257] [INFO ] [MAIN ] ALL: Full history saved. [2025-11-03T17:11:04.393862] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALL took 28.7s. Estimated remaining: 4h 51m 54s. Rate: 7.8 symbols/min [2025-11-03T17:11:04.567762] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:04.599037] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T17:11:04.624393] [DEBUG] [LOCAL ] ALTG: Loaded 22968 existing records from primary storage. [2025-11-03T17:11:04.624619] [INFO ] [MAIN ] ALTG: Loaded 22968 existing records. [2025-11-03T17:11:04.734949] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-11-03T17:11:04.827166] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:11:04.827388] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-11-03T17:11:04.827451] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-11-03T17:11:04.827710] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-11-03T17:11:04.827776] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-11-03T17:11:05.199204] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:05.225277] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T17:11:05.534852] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-11-03T17:11:06.230601] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T17:11:06.334813] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-11-03T17:11:06.434616] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T17:11:07.134881] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-11-03T17:11:07.503407] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T17:11:07.934887] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-11-03T17:11:07.960271] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T17:11:08.734891] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-11-03T17:11:08.966171] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T17:11:09.534889] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-11-03T17:11:10.142025] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T17:11:10.334891] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-11-03T17:11:10.643143] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T17:11:11.134912] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-11-03T17:11:11.561317] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:11:11.934854] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-11-03T17:11:12.149181] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T17:11:12.734861] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-11-03T17:11:13.128218] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T17:11:13.534846] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-11. [2025-11-03T17:11:13.814862] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T17:11:14.334953] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-11-03T17:11:14.476287] [DEBUG] [REMOTE ] ALLE: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:11:14.476594] [WARN ] [REMOTE ] ALLE: No data returned for month 2025-11 [2025-11-03T17:11:14.476716] [FATAL] [REMOTE ] ALLE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:11:14.476827] [FATAL] [MAIN ] ALLE: Failed to fetch primary data. [2025-11-03T17:11:14.476921] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:11:14.477011] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-11-03T17:11:14.477122] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-11-03T17:11:14.477182] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-11-03T17:11:14.477326] [DEBUG] [LOCAL ] ALLE: Deleted derivative data file. [2025-11-03T17:11:14.478360] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 28.1s. Estimated remaining: 4h 52m 50s. Rate: 7.8 symbols/min [2025-11-03T17:11:14.657391] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:14.668024] [DEBUG] [LOCAL ] ALUR: Loaded 9155 existing records from primary storage. [2025-11-03T17:11:14.668239] [INFO ] [MAIN ] ALUR: Loaded 9155 existing records. [2025-11-03T17:11:14.850034] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:11:14.850342] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-11-03T17:11:14.850396] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-11-03T17:11:14.850622] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-11-03T17:11:14.850727] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-11-03T17:11:15.139951] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-11-03T17:11:15.223408] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:15.913839] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-11-03T17:11:15.934818] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-11-03T17:11:16.055560] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T17:11:16.734870] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-11-03T17:11:17.253624] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T17:11:17.534877] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-11-03T17:11:17.868672] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T17:11:18.334849] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-11-03T17:11:18.766911] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T17:11:19.134835] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-11-03T17:11:19.268047] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T17:11:19.913093] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T17:11:19.934817] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-11-03T17:11:20.669032] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T17:11:20.734897] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-11-03T17:11:21.534858] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-11-03T17:11:22.028880] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T17:11:22.065006] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-11-03T17:11:22.334862] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-11-03T17:11:23.134923] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-11-03T17:11:23.819309] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T17:11:23.868153] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T17:11:23.934838] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-11. [2025-11-03T17:11:24.734853] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-11-03T17:11:25.005332] [DEBUG] [REMOTE ] ALLY: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:11:25.005636] [WARN ] [REMOTE ] ALLY: No data returned for month 2025-11 [2025-11-03T17:11:25.005745] [FATAL] [REMOTE ] ALLY: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:11:25.005861] [FATAL] [MAIN ] ALLY: Failed to fetch primary data. [2025-11-03T17:11:25.005940] [WARN ] [MAIN ] ALLY: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:11:25.006026] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-11-03T17:11:25.006103] [DEBUG] [LOCAL ] ALLY: No primary data file found to delete. [2025-11-03T17:11:25.006154] [INFO ] [LOCAL ] ALLY: Starting deletion of derivative data. [2025-11-03T17:11:25.006590] [DEBUG] [LOCAL ] ALLY: Deleted derivative data file. [2025-11-03T17:11:25.006719] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALLY took 35.7s. Estimated remaining: 4h 53m 55s. Rate: 7.8 symbols/min [2025-11-03T17:11:25.177501] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:25.216983] [DEBUG] [LOCAL ] ALV: Loaded 42598 existing records from primary storage. [2025-11-03T17:11:25.217331] [INFO ] [MAIN ] ALV: Loaded 42598 existing records. [2025-11-03T17:11:25.400021] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:11:25.400240] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-11-03T17:11:25.400290] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-11-03T17:11:25.400850] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-11-03T17:11:25.400911] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-11-03T17:11:25.543300] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-11-03T17:11:25.758283] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:26.020517] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:11:26.334875] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-11-03T17:11:26.393546] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T17:11:27.134858] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-11-03T17:11:27.703911] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:11:27.934828] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-11-03T17:11:28.001737] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-11-03T17:11:28.734849] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-11-03T17:11:29.074676] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T17:11:29.534856] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-11-03T17:11:30.006366] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T17:11:30.334864] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-11-03T17:11:30.530664] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-11-03T17:11:31.134909] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-11-03T17:11:31.533614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T17:11:31.934848] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-11-03T17:11:32.488996] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T17:11:32.489469] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-11-03T17:11:32.734869] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-11-03T17:11:33.350589] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T17:11:33.534858] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-11-03T17:11:34.334861] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-11-03T17:11:34.506841] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T17:11:34.935238] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T17:11:35.134865] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-11-03T17:11:35.934913] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-11-03T17:11:36.163718] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T17:11:36.734901] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-11. [2025-11-03T17:11:37.427131] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T17:11:37.534934] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-11-03T17:11:38.183295] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-11-03T17:11:38.334865] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-11-03T17:11:38.776380] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-11 (2.04 seconds). [2025-11-03T17:11:38.778048] [INFO ] [REMOTE ] ALSN: Full fetch complete (63089 records). [2025-11-03T17:11:38.778152] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-11-03T17:11:39.147754] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-11-03T17:11:39.203186] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-11-03T17:11:39.203257] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-11-03T17:11:39.203903] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-11-03T17:11:39.203965] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-11-03T17:11:39.205177] [DEBUG] [LOCAL ] ALSN: Trimmed 63089 records to 43010 (keeping 200 days of data) [2025-11-03T17:11:39.464067] [DEBUG] [LOCAL ] ALSN: Primary data saved (43010 records). [2025-11-03T17:11:39.464186] [INFO ] [MAIN ] ALSN: Full history saved. [2025-11-03T17:11:39.464260] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALSN took 49.3s. Estimated remaining: 4h 56m 39s. Rate: 7.7 symbols/min [2025-11-03T17:11:39.635159] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:39.661813] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T17:11:39.673371] [DEBUG] [LOCAL ] ALX: Loaded 7743 existing records from primary storage. [2025-11-03T17:11:39.674080] [INFO ] [MAIN ] ALX: Loaded 7743 existing records. [2025-11-03T17:11:39.781104] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T17:11:39.859085] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:11:39.859299] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-11-03T17:11:39.859356] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-11-03T17:11:39.859516] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-11-03T17:11:39.859556] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-11-03T17:11:39.940047] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-11. [2025-11-03T17:11:40.206899] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:40.734863] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-11-03T17:11:40.747965] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T17:11:40.748824] [INFO ] [REMOTE ] ALUR: Full fetch complete (17802 records). [2025-11-03T17:11:40.748906] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-11-03T17:11:41.122097] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-11-03T17:11:41.122180] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-11-03T17:11:41.122486] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-11-03T17:11:41.122527] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-11-03T17:11:41.123094] [DEBUG] [LOCAL ] ALUR: Trimmed 17802 records to 8943 (keeping 200 days of data) [2025-11-03T17:11:41.172841] [DEBUG] [LOCAL ] ALUR: Primary data saved (8943 records). [2025-11-03T17:11:41.172972] [INFO ] [MAIN ] ALUR: Full history saved. [2025-11-03T17:11:41.173049] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALUR took 26.7s. Estimated remaining: 4h 53m 57s. Rate: 7.7 symbols/min [2025-11-03T17:11:41.344347] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:41.392096] [DEBUG] [LOCAL ] AM: Loaded 52518 existing records from primary storage. [2025-11-03T17:11:41.392411] [INFO ] [MAIN ] AM: Loaded 52518 existing records. [2025-11-03T17:11:41.542915] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-11-03T17:11:41.572321] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:11:41.573537] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-11-03T17:11:41.573600] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-11-03T17:11:41.587784] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-11-03T17:11:41.587932] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-11-03T17:11:41.602197] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T17:11:41.956039] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:42.334834] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-11-03T17:11:42.985956] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-11-03T17:11:43.008394] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T17:11:43.134848] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-11. [2025-11-03T17:11:43.654456] [DEBUG] [REMOTE ] ALTG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:11:43.654807] [WARN ] [REMOTE ] ALTG: No data returned for month 2025-11 [2025-11-03T17:11:43.654894] [FATAL] [REMOTE ] ALTG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:11:43.654975] [FATAL] [MAIN ] ALTG: Failed to fetch primary data. [2025-11-03T17:11:43.655037] [WARN ] [MAIN ] ALTG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:11:43.655108] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-11-03T17:11:43.655169] [DEBUG] [LOCAL ] ALTG: No primary data file found to delete. [2025-11-03T17:11:43.655206] [INFO ] [LOCAL ] ALTG: Starting deletion of derivative data. [2025-11-03T17:11:43.655353] [DEBUG] [LOCAL ] ALTG: Deleted derivative data file. [2025-11-03T17:11:43.655419] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALTG took 39.3s. Estimated remaining: 4h 51m 37s. Rate: 7.8 symbols/min [2025-11-03T17:11:43.825126] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:43.858239] [DEBUG] [LOCAL ] AMBC: Loaded 35793 existing records from primary storage. [2025-11-03T17:11:43.858530] [INFO ] [MAIN ] AMBC: Loaded 35793 existing records. [2025-11-03T17:11:43.939942] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-11-03T17:11:44.093922] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:11:44.094137] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-11-03T17:11:44.094184] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-11-03T17:11:44.094411] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-11-03T17:11:44.094451] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-11-03T17:11:44.450334] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:44.453078] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T17:11:44.734847] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-11-03T17:11:45.099946] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T17:11:45.534920] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-11-03T17:11:46.334862] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-11-03T17:11:46.755033] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T17:11:46.971154] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T17:11:47.134867] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-11-03T17:11:47.934860] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-11-03T17:11:48.699625] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T17:11:48.734813] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-11-03T17:11:49.112326] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T17:11:49.534845] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-11-03T17:11:49.973434] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:11:50.334838] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-11-03T17:11:50.461324] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T17:11:51.134862] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-11-03T17:11:51.689237] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:11:51.934827] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-11-03T17:11:52.038524] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-11-03T17:11:52.734936] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-11-03T17:11:53.076439] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-11-03T17:11:53.189230] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:11:53.534880] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-11-03T17:11:54.334829] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-11-03T17:11:54.746704] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T17:11:54.887872] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T17:11:55.134910] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-11-03T17:11:55.717042] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T17:11:55.934883] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-11. [2025-11-03T17:11:56.734905] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-11-03T17:11:57.534861] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-11-03T17:11:57.603909] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T17:11:57.605341] [INFO ] [REMOTE ] ALV: Full fetch complete (62395 records). [2025-11-03T17:11:57.605488] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-11-03T17:11:58.005376] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-11-03T17:11:58.005626] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-11-03T17:11:58.006369] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-11-03T17:11:58.006471] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-11-03T17:11:58.008440] [DEBUG] [LOCAL ] ALV: Trimmed 62395 records to 41813 (keeping 200 days of data) [2025-11-03T17:11:58.089182] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:11:58.168200] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-11-03T17:11:58.310436] [DEBUG] [LOCAL ] ALV: Primary data saved (41813 records). [2025-11-03T17:11:58.310571] [INFO ] [MAIN ] ALV: Full history saved. [2025-11-03T17:11:58.310672] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALV took 33.3s. Estimated remaining: 4h 54m 22s. Rate: 7.7 symbols/min [2025-11-03T17:11:58.340112] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-11-03T17:11:58.479212] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:11:58.479395] [DEBUG] [LOCAL ] AMBP: No existing data file found in primary storage. [2025-11-03T17:11:58.479433] [WARN ] [MAIN ] AMBP: No existing data found, performing full refresh instead. [2025-11-03T17:11:58.479537] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-11-03T17:11:58.479578] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-11-03T17:11:58.479618] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-11-03T17:11:58.479719] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-11-03T17:11:58.847421] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:11:59.134852] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-11-03T17:11:59.796591] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T17:11:59.934819] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-11-03T17:12:00.153520] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T17:12:00.734892] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-11-03T17:12:01.211205] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-11-03T17:12:01.371866] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T17:12:01.534839] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-11-03T17:12:02.334866] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-11-03T17:12:02.831634] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T17:12:02.849613] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T17:12:03.134854] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-11-03T17:12:03.934904] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-11-03T17:12:04.300499] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T17:12:04.734852] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-11-03T17:12:05.327128] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T17:12:05.405836] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T17:12:05.534827] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-11-03T17:12:06.334888] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-11-03T17:12:06.761485] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T17:12:07.134964] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-11. [2025-11-03T17:12:07.709987] [DEBUG] [REMOTE ] ALX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:12:07.713807] [WARN ] [REMOTE ] ALX: No data returned for month 2025-11 [2025-11-03T17:12:07.716390] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T17:12:07.716484] [FATAL] [REMOTE ] ALX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:12:07.716733] [FATAL] [MAIN ] ALX: Failed to fetch primary data. [2025-11-03T17:12:07.725886] [WARN ] [MAIN ] ALX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:12:07.726707] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-11-03T17:12:07.726782] [DEBUG] [LOCAL ] ALX: No primary data file found to delete. [2025-11-03T17:12:07.726822] [INFO ] [LOCAL ] ALX: Starting deletion of derivative data. [2025-11-03T17:12:07.727039] [DEBUG] [LOCAL ] ALX: Deleted derivative data file. [2025-11-03T17:12:07.727174] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. ALX took 28.3s. Estimated remaining: 4h 54m 54s. Rate: 7.7 symbols/min [2025-11-03T17:12:07.917745] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:07.917901] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-11-03T17:12:07.917937] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-11-03T17:12:07.918043] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-11-03T17:12:07.918084] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-11-03T17:12:07.918130] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-11-03T17:12:07.918168] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-11-03T17:12:07.939959] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-11-03T17:12:08.275430] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:08.734885] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-11-03T17:12:09.179440] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:12:09.534832] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-11-03T17:12:09.630009] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T17:12:10.334845] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-11-03T17:12:10.992101] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T17:12:11.134825] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-11-03T17:12:11.471819] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T17:12:11.934870] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-11-03T17:12:12.460895] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T17:12:12.734817] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-11-03T17:12:12.885095] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:12:12.885381] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-11-03T17:12:12.885469] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:12:12.885532] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-11-03T17:12:12.885594] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:12:12.885695] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-11-03T17:12:12.885772] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-11-03T17:12:12.885808] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-11-03T17:12:12.885846] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-11-03T17:12:12.885892] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. AMBQ took 5.2s. Estimated remaining: 4h 53m 43s. Rate: 7.7 symbols/min [2025-11-03T17:12:13.078521] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:13.080469] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T17:12:13.131132] [DEBUG] [LOCAL ] AMC: Loaded 54548 existing records from primary storage. [2025-11-03T17:12:13.131428] [INFO ] [MAIN ] AMC: Loaded 54548 existing records. [2025-11-03T17:12:13.303239] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:12:13.303422] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-11-03T17:12:13.303469] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-11-03T17:12:13.303839] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-11-03T17:12:13.303896] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-11-03T17:12:13.540033] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-11-03T17:12:13.650433] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:14.334882] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-11-03T17:12:14.756080] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T17:12:15.134875] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-11. [2025-11-03T17:12:15.508981] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T17:12:15.935013] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-11-03T17:12:16.734954] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-11-03T17:12:17.220078] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-11 (2.09 seconds). [2025-11-03T17:12:17.222150] [INFO ] [REMOTE ] AM: Full fetch complete (75644 records). [2025-11-03T17:12:17.222292] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-11-03T17:12:17.540136] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-11-03T17:12:17.633097] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-11-03T17:12:17.633337] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-11-03T17:12:17.634214] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-11-03T17:12:17.634467] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-11-03T17:12:17.654272] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T17:12:17.661432] [DEBUG] [LOCAL ] AM: Trimmed 75644 records to 51756 (keeping 200 days of data) [2025-11-03T17:12:17.968611] [DEBUG] [LOCAL ] AM: Primary data saved (51756 records). [2025-11-03T17:12:17.968991] [INFO ] [MAIN ] AM: Full history saved. [2025-11-03T17:12:17.969737] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AM took 36.8s. Estimated remaining: 4h 52m 31s. Rate: 7.8 symbols/min [2025-11-03T17:12:18.139409] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:18.176342] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-11-03T17:12:18.220850] [DEBUG] [LOCAL ] AMCR: Loaded 54450 existing records from primary storage. [2025-11-03T17:12:18.221145] [INFO ] [MAIN ] AMCR: Loaded 54450 existing records. [2025-11-03T17:12:18.340024] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-11-03T17:12:18.397906] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:12:18.398103] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-11-03T17:12:18.398148] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-11-03T17:12:18.399007] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-11-03T17:12:18.399064] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-11-03T17:12:18.755602] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:18.840471] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:12:19.134872] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-11-03T17:12:19.538969] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T17:12:19.934946] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-11-03T17:12:20.734916] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-11. [2025-11-03T17:12:20.828432] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-11-03T17:12:21.534819] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-11-03T17:12:21.573276] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T17:12:22.010260] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T17:12:22.011402] [INFO ] [REMOTE ] AMBC: Full fetch complete (51778 records). [2025-11-03T17:12:22.011487] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-11-03T17:12:22.339959] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-11-03T17:12:22.406400] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-11-03T17:12:22.406480] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-11-03T17:12:22.407027] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-11-03T17:12:22.407114] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-11-03T17:12:22.408247] [DEBUG] [LOCAL ] AMBC: Trimmed 51778 records to 35170 (keeping 200 days of data) [2025-11-03T17:12:22.603451] [DEBUG] [LOCAL ] AMBC: Primary data saved (35170 records). [2025-11-03T17:12:22.603592] [INFO ] [MAIN ] AMBC: Full history saved. [2025-11-03T17:12:22.604407] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AMBC took 38.9s. Estimated remaining: 4h 51m 10s. Rate: 7.8 symbols/min [2025-11-03T17:12:22.785276] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:22.832049] [DEBUG] [LOCAL ] AME: Loaded 49063 existing records from primary storage. [2025-11-03T17:12:22.832374] [INFO ] [MAIN ] AME: Loaded 49063 existing records. [2025-11-03T17:12:23.010491] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:12:23.010757] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-11-03T17:12:23.010807] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-11-03T17:12:23.011280] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-11-03T17:12:23.011320] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-11-03T17:12:23.139931] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-11-03T17:12:23.391565] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:23.422419] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-11-03T17:12:23.914022] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-11-03T17:12:23.934825] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-11-03T17:12:24.451476] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T17:12:24.734914] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-11-03T17:12:25.117106] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:12:25.534886] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-11-03T17:12:26.147456] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:12:26.334907] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-11-03T17:12:27.134841] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-11-03T17:12:27.302799] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-11-03T17:12:27.515227] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T17:12:27.934922] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-11-03T17:12:28.644813] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-11-03T17:12:28.734902] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-11-03T17:12:29.341772] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T17:12:29.534983] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-11-03T17:12:29.926447] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T17:12:30.334960] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-11-03T17:12:31.134886] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-11-03T17:12:31.509778] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-11-03T17:12:31.829870] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-11-03T17:12:31.934874] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-11-03T17:12:32.174616] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T17:12:32.734861] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-11-03T17:12:33.534848] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-11-03T17:12:33.709749] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-11-03T17:12:33.970138] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T17:12:34.334846] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-11-03T17:12:34.882266] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:12:35.134834] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-11-03T17:12:35.592731] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T17:12:35.934884] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-11-03T17:12:36.734826] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-11. [2025-11-03T17:12:36.805376] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-11-03T17:12:37.167446] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:12:37.534911] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-11-03T17:12:37.606173] [DEBUG] [REMOTE ] AMBP: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:12:37.606390] [WARN ] [REMOTE ] AMBP: No data returned for month 2025-11 [2025-11-03T17:12:37.606486] [FATAL] [REMOTE ] AMBP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:12:37.606580] [FATAL] [MAIN ] AMBP: Failed to fetch primary data. [2025-11-03T17:12:37.606621] [WARN ] [MAIN ] AMBP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:12:37.606714] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-11-03T17:12:37.606780] [DEBUG] [LOCAL ] AMBP: No primary data file found to delete. [2025-11-03T17:12:37.606817] [INFO ] [LOCAL ] AMBP: Starting deletion of derivative data. [2025-11-03T17:12:37.606857] [DEBUG] [LOCAL ] AMBP: No derivative data file found to delete. [2025-11-03T17:12:37.606903] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AMBP took 39.3s. Estimated remaining: 4h 53m 54s. Rate: 7.7 symbols/min [2025-11-03T17:12:37.783551] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:37.802042] [DEBUG] [LOCAL ] AMG: Loaded 19885 existing records from primary storage. [2025-11-03T17:12:37.802302] [INFO ] [MAIN ] AMG: Loaded 19885 existing records. [2025-11-03T17:12:37.975389] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:12:37.975572] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-11-03T17:12:37.975618] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-11-03T17:12:37.975909] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-11-03T17:12:37.975960] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-11-03T17:12:38.325965] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:38.334806] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-11-03T17:12:38.690550] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-11-03T17:12:39.134870] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-11-03T17:12:39.423225] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T17:12:39.934828] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-11-03T17:12:40.419092] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T17:12:40.622733] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T17:12:40.734826] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-11-03T17:12:41.536259] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-11-03T17:12:41.539938] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T17:12:42.334850] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-11-03T17:12:42.780043] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T17:12:43.134867] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-11-03T17:12:43.651936] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T17:12:43.934939] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-11-03T17:12:44.734910] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-11-03T17:12:45.152323] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-11-03T17:12:45.194117] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T17:12:45.534818] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-11-03T17:12:45.622041] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:12:46.334869] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-11-03T17:12:47.134826] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-11-03T17:12:47.185280] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-11-03T17:12:47.885093] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:12:47.934867] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-11-03T17:12:48.210381] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-11-03T17:12:48.734888] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-11-03T17:12:49.103865] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T17:12:49.534862] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-11-03T17:12:50.309967] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T17:12:50.334816] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-11-03T17:12:50.409092] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T17:12:51.143394] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-11-03T17:12:51.145145] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T17:12:51.934818] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-11-03T17:12:52.463133] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T17:12:52.734927] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-11. [2025-11-03T17:12:53.534888] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-11. [2025-11-03T17:12:53.696264] [DEBUG] [REMOTE ] AME: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:12:53.707139] [WARN ] [REMOTE ] AME: No data returned for month 2025-11 [2025-11-03T17:12:53.708885] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-11-03T17:12:53.707790] [FATAL] [REMOTE ] AME: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:12:53.719938] [FATAL] [MAIN ] AME: Failed to fetch primary data. [2025-11-03T17:12:53.720173] [WARN ] [MAIN ] AME: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:12:53.720280] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-11-03T17:12:53.720379] [DEBUG] [LOCAL ] AME: No primary data file found to delete. [2025-11-03T17:12:53.720849] [INFO ] [LOCAL ] AME: Starting deletion of derivative data. [2025-11-03T17:12:53.721071] [DEBUG] [LOCAL ] AME: Deleted derivative data file. [2025-11-03T17:12:53.721900] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AME took 31.1s. Estimated remaining: 4h 56m 59s. Rate: 7.6 symbols/min [2025-11-03T17:12:53.888081] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:53.916724] [DEBUG] [REMOTE ] AMCR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:12:53.917030] [WARN ] [REMOTE ] AMCR: No data returned for month 2025-11 [2025-11-03T17:12:53.917146] [FATAL] [REMOTE ] AMCR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:12:53.917228] [FATAL] [MAIN ] AMCR: Failed to fetch primary data. [2025-11-03T17:12:53.917296] [WARN ] [MAIN ] AMCR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:12:53.917370] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-11-03T17:12:53.917434] [DEBUG] [LOCAL ] AMCR: No primary data file found to delete. [2025-11-03T17:12:53.917470] [INFO ] [LOCAL ] AMCR: Starting deletion of derivative data. [2025-11-03T17:12:53.917634] [DEBUG] [LOCAL ] AMCR: Deleted derivative data file. [2025-11-03T17:12:53.918123] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMCR took 35.9s. Estimated remaining: 4h 53m 56s. Rate: 7.7 symbols/min [2025-11-03T17:12:54.039886] [DEBUG] [LOCAL ] AMH: Loaded 52570 existing records from primary storage. [2025-11-03T17:12:54.050891] [INFO ] [MAIN ] AMH: Loaded 52570 existing records. [2025-11-03T17:12:54.217271] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:12:54.219818] [DEBUG] [LOCAL ] AMN: No existing data file found in primary storage. [2025-11-03T17:12:54.219890] [WARN ] [MAIN ] AMN: No existing data found, performing full refresh instead. [2025-11-03T17:12:54.220254] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-11-03T17:12:54.220321] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-11-03T17:12:54.241137] [DEBUG] [LOCAL ] AMN: No primary data file found to delete. [2025-11-03T17:12:54.271708] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-11-03T17:12:54.358372] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-11-03T17:12:54.382911] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:12:54.406765] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-11-03T17:12:54.407179] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-11-03T17:12:54.423138] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-11-03T17:12:54.433600] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-11-03T17:12:54.971729] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:55.080805] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:12:55.134882] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-11-03T17:12:55.934917] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-11-03T17:12:56.434551] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T17:12:56.528319] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-11-03T17:12:56.550891] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T17:12:56.734897] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-11-03T17:12:57.486041] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-11-03T17:12:57.534832] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-11-03T17:12:58.247934] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T17:12:58.334861] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-11. [2025-11-03T17:12:59.134877] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-11-03T17:12:59.365571] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T17:12:59.366932] [INFO ] [REMOTE ] AMG: Full fetch complete (29449 records). [2025-11-03T17:12:59.367019] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-11-03T17:12:59.758869] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-11-03T17:12:59.758949] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-11-03T17:12:59.759311] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-11-03T17:12:59.759353] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-11-03T17:12:59.760121] [DEBUG] [LOCAL ] AMG: Trimmed 29449 records to 19579 (keeping 200 days of data) [2025-11-03T17:12:59.876993] [DEBUG] [LOCAL ] AMG: Primary data saved (19579 records). [2025-11-03T17:12:59.877155] [INFO ] [MAIN ] AMG: Full history saved. [2025-11-03T17:12:59.877242] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AMG took 22.3s. Estimated remaining: 4h 53m 7s. Rate: 7.7 symbols/min [2025-11-03T17:12:59.939970] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-11. [2025-11-03T17:13:00.050230] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:00.050422] [DEBUG] [LOCAL ] AMP: No existing data file found in primary storage. [2025-11-03T17:13:00.050487] [WARN ] [MAIN ] AMP: No existing data found, performing full refresh instead. [2025-11-03T17:13:00.050632] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-11-03T17:13:00.050732] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-11-03T17:13:00.050801] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-11-03T17:13:00.050837] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-11-03T17:13:00.431324] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:00.458449] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T17:13:00.734826] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-11-03T17:13:01.461618] [DEBUG] [REMOTE ] AMC: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:13:01.461978] [WARN ] [REMOTE ] AMC: No data returned for month 2025-11 [2025-11-03T17:13:01.462066] [FATAL] [REMOTE ] AMC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:13:01.462143] [FATAL] [MAIN ] AMC: Failed to fetch primary data. [2025-11-03T17:13:01.462195] [WARN ] [MAIN ] AMC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:13:01.462287] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-11-03T17:13:01.462363] [DEBUG] [LOCAL ] AMC: No primary data file found to delete. [2025-11-03T17:13:01.462411] [INFO ] [LOCAL ] AMC: Starting deletion of derivative data. [2025-11-03T17:13:01.462628] [DEBUG] [LOCAL ] AMC: Deleted derivative data file. [2025-11-03T17:13:01.463463] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AMC took 48.6s. Estimated remaining: 4h 50m 40s. Rate: 7.8 symbols/min [2025-11-03T17:13:01.544138] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-11-03T17:13:01.682814] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:01.737117] [DEBUG] [LOCAL ] AMPX: Loaded 53343 existing records from primary storage. [2025-11-03T17:13:01.737453] [INFO ] [MAIN ] AMPX: Loaded 53343 existing records. [2025-11-03T17:13:01.944987] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:13:01.945392] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-11-03T17:13:01.945542] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-11-03T17:13:01.946035] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-11-03T17:13:01.946097] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-11-03T17:13:02.277825] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T17:13:02.335569] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-11-03T17:13:02.368070] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:02.797007] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T17:13:03.134861] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-11-03T17:13:03.383957] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T17:13:03.934865] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-11-03T17:13:04.364143] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T17:13:04.734871] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-11-03T17:13:04.977854] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:13:05.534846] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-11-03T17:13:06.266175] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-11-03T17:13:06.334817] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-11-03T17:13:06.633206] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T17:13:07.134873] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-11-03T17:13:07.786738] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-11-03T17:13:07.934848] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-11-03T17:13:08.081907] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T17:13:08.734869] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-11-03T17:13:09.119910] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:13:09.534889] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-11-03T17:13:10.138188] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T17:13:10.334871] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-11-03T17:13:10.582148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T17:13:11.134877] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-11-03T17:13:11.788399] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T17:13:11.934843] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-11-03T17:13:12.501195] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T17:13:12.734868] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-11-03T17:13:13.008814] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T17:13:13.534924] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-11-03T17:13:14.334868] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-11-03T17:13:14.596216] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T17:13:15.134880] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-11-03T17:13:15.453506] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-11-03T17:13:15.539041] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T17:13:15.934846] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-11-03T17:13:16.284416] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T17:13:16.734926] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-11-03T17:13:17.163493] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:13:17.534930] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-11-03T17:13:17.855497] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T17:13:18.334840] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-11-03T17:13:18.414361] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T17:13:19.134859] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-11-03T17:13:19.536412] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T17:13:19.934865] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-11-03T17:13:20.228701] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T17:13:20.734924] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-11-03T17:13:20.888587] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T17:13:21.534876] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-11-03T17:13:21.839977] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:13:22.334905] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-11-03T17:13:22.675809] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T17:13:23.134891] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-11. [2025-11-03T17:13:23.497696] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T17:13:23.934899] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-11-03T17:13:24.058560] [DEBUG] [REMOTE ] AMP: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:13:24.058975] [WARN ] [REMOTE ] AMP: No data returned for month 2025-11 [2025-11-03T17:13:24.059078] [FATAL] [REMOTE ] AMP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:13:24.059182] [FATAL] [MAIN ] AMP: Failed to fetch primary data. [2025-11-03T17:13:24.059269] [WARN ] [MAIN ] AMP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:13:24.059383] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-11-03T17:13:24.059486] [DEBUG] [LOCAL ] AMP: No primary data file found to delete. [2025-11-03T17:13:24.059561] [INFO ] [LOCAL ] AMP: Starting deletion of derivative data. [2025-11-03T17:13:24.059680] [DEBUG] [LOCAL ] AMP: No derivative data file found to delete. [2025-11-03T17:13:24.059757] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMP took 24.2s. Estimated remaining: 4h 56m 3s. Rate: 7.6 symbols/min [2025-11-03T17:13:24.245491] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:24.280000] [DEBUG] [LOCAL ] AMPY: Loaded 39929 existing records from primary storage. [2025-11-03T17:13:24.280299] [INFO ] [MAIN ] AMPY: Loaded 39929 existing records. [2025-11-03T17:13:24.456076] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:13:24.456336] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-11-03T17:13:24.456410] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-11-03T17:13:24.456706] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-11-03T17:13:24.456767] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-11-03T17:13:24.740424] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-11-03T17:13:24.828744] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:25.034205] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T17:13:25.534862] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-11-03T17:13:26.280813] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T17:13:26.334897] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-11-03T17:13:26.772186] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T17:13:27.134826] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-11. [2025-11-03T17:13:27.153461] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T17:13:27.934869] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-11-03T17:13:28.681803] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T17:13:28.734853] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-11-03T17:13:28.802122] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T17:13:28.803381] [INFO ] [REMOTE ] AMN: Full fetch complete (60153 records). [2025-11-03T17:13:28.803501] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-11-03T17:13:29.178510] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-11-03T17:13:29.178584] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-11-03T17:13:29.179184] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-11-03T17:13:29.179245] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-11-03T17:13:29.180353] [DEBUG] [LOCAL ] AMN: Trimmed 60153 records to 41342 (keeping 200 days of data) [2025-11-03T17:13:29.410380] [DEBUG] [LOCAL ] AMN: Primary data saved (41342 records). [2025-11-03T17:13:29.410543] [INFO ] [MAIN ] AMN: Full history saved. [2025-11-03T17:13:29.410635] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMN took 35.5s. Estimated remaining: 4h 55m 1s. Rate: 7.7 symbols/min [2025-11-03T17:13:29.550254] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-11-03T17:13:29.583764] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:29.612562] [DEBUG] [LOCAL ] AMR: Loaded 28626 existing records from primary storage. [2025-11-03T17:13:29.612870] [INFO ] [MAIN ] AMR: Loaded 28626 existing records. [2025-11-03T17:13:29.796605] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:13:29.796923] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-11-03T17:13:29.796984] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-11-03T17:13:29.797274] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-11-03T17:13:29.797344] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-11-03T17:13:29.908465] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T17:13:30.186784] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:30.334814] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-11-03T17:13:31.134833] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-11-03T17:13:31.259378] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T17:13:31.353711] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-11-03T17:13:31.934859] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-11-03T17:13:32.404417] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:13:32.734837] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-11-03T17:13:32.784348] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T17:13:33.534895] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-11-03T17:13:33.855030] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-11-03T17:13:34.334860] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-11-03T17:13:34.834328] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T17:13:35.134900] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-11-03T17:13:35.280769] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T17:13:35.934874] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-11-03T17:13:36.088805] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-11-03T17:13:36.734855] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-11-03T17:13:37.534843] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-11-03T17:13:37.839897] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-11-03T17:13:37.876481] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T17:13:38.334813] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-11-03T17:13:38.508802] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T17:13:39.134855] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-11-03T17:13:39.924225] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-11-03T17:13:39.936496] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-11-03T17:13:40.559062] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:13:40.734875] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-11-03T17:13:40.937234] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-11-03T17:13:41.534858] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-11. [2025-11-03T17:13:42.334849] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-11-03T17:13:42.879955] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-11-03T17:13:43.131438] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T17:13:43.139460] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-11-03T17:13:43.272051] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-11 (1.74 seconds). [2025-11-03T17:13:43.273693] [INFO ] [REMOTE ] AMH: Full fetch complete (75162 records). [2025-11-03T17:13:43.273803] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-11-03T17:13:43.696979] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-11-03T17:13:43.697076] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-11-03T17:13:43.697822] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-11-03T17:13:43.697883] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-11-03T17:13:43.699241] [DEBUG] [LOCAL ] AMH: Trimmed 75162 records to 51849 (keeping 200 days of data) [2025-11-03T17:13:43.935330] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-11. [2025-11-03T17:13:44.009761] [DEBUG] [LOCAL ] AMH: Primary data saved (51849 records). [2025-11-03T17:13:44.009899] [INFO ] [MAIN ] AMH: Full history saved. [2025-11-03T17:13:44.011174] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMH took 50.3s. Estimated remaining: 4h 57m 20s. Rate: 7.6 symbols/min [2025-11-03T17:13:44.193706] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:44.222282] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T17:13:44.264049] [DEBUG] [LOCAL ] AMRC: Loaded 38646 existing records from primary storage. [2025-11-03T17:13:44.264474] [INFO ] [MAIN ] AMRC: Loaded 38646 existing records. [2025-11-03T17:13:44.442433] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:13:44.442637] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-11-03T17:13:44.442749] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-11-03T17:13:44.443065] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-11-03T17:13:44.443121] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-11-03T17:13:44.740053] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-11-03T17:13:44.810279] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:45.534843] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-11-03T17:13:45.668211] [DEBUG] [REMOTE ] AMPX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:13:45.668504] [WARN ] [REMOTE ] AMPX: No data returned for month 2025-11 [2025-11-03T17:13:45.668590] [FATAL] [REMOTE ] AMPX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:13:45.668707] [FATAL] [MAIN ] AMPX: Failed to fetch primary data. [2025-11-03T17:13:45.668775] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:13:45.668846] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-11-03T17:13:45.668909] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-11-03T17:13:45.668945] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-11-03T17:13:45.669108] [DEBUG] [LOCAL ] AMPX: Deleted derivative data file. [2025-11-03T17:13:45.669966] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPX took 44.2s. Estimated remaining: 4h 54m 58s. Rate: 7.7 symbols/min [2025-11-03T17:13:45.843547] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:45.843769] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-11-03T17:13:45.843815] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-11-03T17:13:45.843921] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-11-03T17:13:45.843963] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-11-03T17:13:45.844005] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-11-03T17:13:45.844037] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-11-03T17:13:46.239280] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:46.240831] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T17:13:46.334806] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-11-03T17:13:46.473838] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T17:13:47.134892] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-11-03T17:13:47.283386] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:13:47.283748] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-11-03T17:13:47.283836] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:13:47.283881] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-11-03T17:13:47.283937] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:13:47.284009] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-11-03T17:13:47.284076] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-11-03T17:13:47.284112] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-11-03T17:13:47.284150] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-11-03T17:13:47.284194] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 1.6s. Estimated remaining: 4h 52m 38s. Rate: 7.7 symbols/min [2025-11-03T17:13:47.453852] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:47.454006] [DEBUG] [LOCAL ] AMT: No existing data file found in primary storage. [2025-11-03T17:13:47.454043] [WARN ] [MAIN ] AMT: No existing data found, performing full refresh instead. [2025-11-03T17:13:47.454151] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-11-03T17:13:47.454233] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-11-03T17:13:47.454306] [DEBUG] [LOCAL ] AMT: No primary data file found to delete. [2025-11-03T17:13:47.454340] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-11-03T17:13:47.818942] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:47.852082] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T17:13:47.934851] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-11-03T17:13:48.734869] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-11-03T17:13:49.397417] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T17:13:49.534811] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-11-03T17:13:49.666889] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T17:13:50.334947] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-11-03T17:13:50.818193] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T17:13:51.021455] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T17:13:51.134832] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-11-03T17:13:51.934919] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-11-03T17:13:52.312588] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T17:13:52.734859] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-11-03T17:13:52.975846] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:13:53.534903] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-11-03T17:13:54.134599] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T17:13:54.334880] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-11-03T17:13:55.134896] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-11-03T17:13:55.260560] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-11-03T17:13:55.497045] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T17:13:55.934905] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-11-03T17:13:56.291876] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T17:13:56.734893] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-11. [2025-11-03T17:13:56.989203] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T17:13:57.534840] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-11-03T17:13:58.334832] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-11-03T17:13:58.505420] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-11 (1.77 seconds). [2025-11-03T17:13:58.507296] [INFO ] [REMOTE ] AMPY: Full fetch complete (54000 records). [2025-11-03T17:13:58.507412] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-11-03T17:13:58.911633] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:13:58.937314] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-11-03T17:13:58.937396] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-11-03T17:13:58.938130] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-11-03T17:13:58.938211] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-11-03T17:13:58.939400] [DEBUG] [LOCAL ] AMPY: Trimmed 54000 records to 39267 (keeping 200 days of data) [2025-11-03T17:13:59.141819] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-11-03T17:13:59.157931] [DEBUG] [LOCAL ] AMPY: Primary data saved (39267 records). [2025-11-03T17:13:59.158247] [INFO ] [MAIN ] AMPY: Full history saved. [2025-11-03T17:13:59.158437] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMPY took 35.1s. Estimated remaining: 4h 53m 57s. Rate: 7.7 symbols/min [2025-11-03T17:13:59.280962] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T17:13:59.348774] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:13:59.367418] [DEBUG] [LOCAL ] AMTB: Loaded 20951 existing records from primary storage. [2025-11-03T17:13:59.367669] [INFO ] [MAIN ] AMTB: Loaded 20951 existing records. [2025-11-03T17:13:59.541493] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:13:59.541728] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-11-03T17:13:59.541787] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-11-03T17:13:59.541983] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-11-03T17:13:59.542023] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-11-03T17:13:59.914617] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:13:59.934810] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-11-03T17:14:00.734897] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-11-03T17:14:00.947432] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-11-03T17:14:01.144732] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T17:14:01.534849] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-11-03T17:14:01.876226] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T17:14:02.254588] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T17:14:02.334822] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-11-03T17:14:03.081784] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T17:14:03.134828] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-11-03T17:14:03.934846] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-11-03T17:14:04.263624] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T17:14:04.735546] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-11-03T17:14:04.738325] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-11-03T17:14:05.534898] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-11-03T17:14:06.108390] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T17:14:06.334863] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-11. [2025-11-03T17:14:06.618969] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-11-03T17:14:07.134897] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-11. [2025-11-03T17:14:07.934877] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-11-03T17:14:08.145198] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T17:14:08.146382] [INFO ] [REMOTE ] AMRC: Full fetch complete (54647 records). [2025-11-03T17:14:08.146453] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-11-03T17:14:08.540157] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-11-03T17:14:08.540297] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-11-03T17:14:08.540909] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-11-03T17:14:08.540972] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-11-03T17:14:08.542073] [DEBUG] [LOCAL ] AMRC: Trimmed 54647 records to 37937 (keeping 200 days of data) [2025-11-03T17:14:08.628585] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-11 (1.49 seconds). [2025-11-03T17:14:08.635170] [INFO ] [REMOTE ] AMR: Full fetch complete (40540 records). [2025-11-03T17:14:08.643785] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-11-03T17:14:08.737089] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-11-03T17:14:09.130663] [DEBUG] [LOCAL ] AMRC: Primary data saved (37937 records). [2025-11-03T17:14:09.140591] [INFO ] [MAIN ] AMRC: Full history saved. [2025-11-03T17:14:09.159825] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMRC took 25.1s. Estimated remaining: 4h 54m 35s. Rate: 7.7 symbols/min [2025-11-03T17:14:09.202222] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-11-03T17:14:09.225987] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-11-03T17:14:09.241343] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-11-03T17:14:09.247267] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-11-03T17:14:09.275038] [DEBUG] [LOCAL ] AMR: Trimmed 40540 records to 28188 (keeping 200 days of data) [2025-11-03T17:14:09.397044] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:09.458755] [DEBUG] [LOCAL ] AMTD: Loaded 4228 existing records from primary storage. [2025-11-03T17:14:09.460785] [INFO ] [MAIN ] AMTD: Loaded 4228 existing records. [2025-11-03T17:14:09.695110] [DEBUG] [LOCAL ] AMR: Primary data saved (28188 records). [2025-11-03T17:14:09.715415] [INFO ] [MAIN ] AMR: Full history saved. [2025-11-03T17:14:09.715260] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:14:09.715565] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMR took 40.3s. Estimated remaining: 4h 51m 57s. Rate: 7.7 symbols/min [2025-11-03T17:14:09.726597] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-11-03T17:14:09.825944] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-11-03T17:14:09.850043] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-11-03T17:14:09.850393] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-11-03T17:14:09.863689] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T17:14:09.881074] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-11-03T17:14:09.926776] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-11-03T17:14:10.057748] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:10.352508] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:10.347099] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-11-03T17:14:10.355811] [DEBUG] [LOCAL ] AMTM: Loaded 50734 existing records from primary storage. [2025-11-03T17:14:10.356206] [INFO ] [MAIN ] AMTM: Loaded 50734 existing records. [2025-11-03T17:14:10.546983] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:14:10.547247] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-11-03T17:14:10.547301] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-11-03T17:14:10.548180] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-11-03T17:14:10.548238] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-11-03T17:14:10.876170] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T17:14:10.936118] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:11.134865] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-11-03T17:14:11.934823] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-11-03T17:14:11.995174] [DEBUG] [REMOTE ] AMTB: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-11-03T17:14:11.995399] [WARN ] [REMOTE ] AMTB: No data returned for month 2025-07 [2025-11-03T17:14:11.995489] [FATAL] [REMOTE ] AMTB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:14:11.995586] [FATAL] [MAIN ] AMTB: Failed to fetch primary data. [2025-11-03T17:14:11.995681] [WARN ] [MAIN ] AMTB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:14:11.995751] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-11-03T17:14:11.995812] [DEBUG] [LOCAL ] AMTB: No primary data file found to delete. [2025-11-03T17:14:11.995848] [INFO ] [LOCAL ] AMTB: Starting deletion of derivative data. [2025-11-03T17:14:11.996011] [DEBUG] [LOCAL ] AMTB: Deleted derivative data file. [2025-11-03T17:14:11.996094] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMTB took 12.8s. Estimated remaining: 4h 49m 56s. Rate: 7.8 symbols/min [2025-11-03T17:14:12.165538] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:12.196217] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-11-03T17:14:12.210826] [DEBUG] [LOCAL ] AMWL: Loaded 10163 existing records from primary storage. [2025-11-03T17:14:12.211033] [INFO ] [MAIN ] AMWL: Loaded 10163 existing records. [2025-11-03T17:14:12.382214] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:14:12.382396] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-11-03T17:14:12.382442] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-11-03T17:14:12.382700] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-11-03T17:14:12.382756] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-11-03T17:14:12.736610] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-11-03T17:14:12.741730] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:12.771263] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T17:14:13.360158] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T17:14:13.534837] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-11-03T17:14:14.236561] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T17:14:14.334851] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-11-03T17:14:14.757042] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-11-03T17:14:15.134859] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-11-03T17:14:15.745783] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T17:14:15.934845] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-11-03T17:14:16.734878] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-11-03T17:14:17.072922] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-11-03T17:14:17.402065] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-11-03T17:14:17.534874] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-11-03T17:14:17.886887] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T17:14:18.334933] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-11-03T17:14:18.671425] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T17:14:19.134888] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-11-03T17:14:19.617782] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T17:14:19.934867] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-11-03T17:14:20.734858] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-11-03T17:14:21.449961] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T17:14:21.534831] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-11-03T17:14:22.180819] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T17:14:22.334844] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-11-03T17:14:23.072753] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-11-03T17:14:23.134812] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-11-03T17:14:23.739446] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T17:14:23.934843] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-11-03T17:14:24.677839] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T17:14:24.734845] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-11-03T17:14:25.167713] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:14:25.534935] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-11-03T17:14:26.245108] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T17:14:26.280622] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T17:14:26.334813] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-11-03T17:14:26.846867] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T17:14:27.134857] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-11-03T17:14:27.625741] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T17:14:27.934864] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-11. [2025-11-03T17:14:28.734852] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-11-03T17:14:29.090570] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T17:14:29.092055] [INFO ] [REMOTE ] AMT: Full fetch complete (76160 records). [2025-11-03T17:14:29.092152] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-11-03T17:14:29.401174] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T17:14:29.494997] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-11-03T17:14:29.495076] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-11-03T17:14:29.495810] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-11-03T17:14:29.495874] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-11-03T17:14:29.497254] [DEBUG] [LOCAL ] AMT: Trimmed 76160 records to 52404 (keeping 200 days of data) [2025-11-03T17:14:29.551293] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-11-03T17:14:29.831228] [DEBUG] [LOCAL ] AMT: Primary data saved (52404 records). [2025-11-03T17:14:29.831361] [INFO ] [MAIN ] AMT: Full history saved. [2025-11-03T17:14:29.831438] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMT took 42.5s. Estimated remaining: 4h 53m 14s. Rate: 7.7 symbols/min [2025-11-03T17:14:30.006587] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:30.051493] [DEBUG] [LOCAL ] AMX: Loaded 49781 existing records from primary storage. [2025-11-03T17:14:30.051915] [INFO ] [MAIN ] AMX: Loaded 49781 existing records. [2025-11-03T17:14:30.173722] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T17:14:30.242041] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:14:30.242248] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-11-03T17:14:30.242295] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-11-03T17:14:30.243190] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-11-03T17:14:30.243249] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-11-03T17:14:30.340148] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-11-03T17:14:30.594141] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:30.896123] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T17:14:31.134858] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-11-03T17:14:31.640294] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T17:14:31.934860] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-11-03T17:14:32.420202] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-11-03T17:14:32.734903] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-11-03T17:14:33.534914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-11-03T17:14:33.970989] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T17:14:34.122945] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-11-03T17:14:34.334885] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-11-03T17:14:35.136869] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-11-03T17:14:35.143739] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T17:14:35.934943] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-11. [2025-11-03T17:14:36.304012] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:14:36.734856] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-11-03T17:14:37.145016] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-11 (1.21 seconds). [2025-11-03T17:14:37.145849] [INFO ] [REMOTE ] AMWL: Full fetch complete (14885 records). [2025-11-03T17:14:37.145916] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-11-03T17:14:37.248444] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T17:14:37.546586] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-11-03T17:14:37.560400] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-11-03T17:14:37.560506] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-11-03T17:14:37.560886] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-11-03T17:14:37.560952] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-11-03T17:14:37.561914] [DEBUG] [LOCAL ] AMWL: Trimmed 14885 records to 10165 (keeping 200 days of data) [2025-11-03T17:14:37.623229] [DEBUG] [LOCAL ] AMWL: Primary data saved (10165 records). [2025-11-03T17:14:37.623430] [INFO ] [MAIN ] AMWL: Full history saved. [2025-11-03T17:14:37.623535] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMWL took 25.6s. Estimated remaining: 4h 53m 6s. Rate: 7.7 symbols/min [2025-11-03T17:14:37.809447] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:37.843388] [DEBUG] [LOCAL ] AN: Loaded 31287 existing records from primary storage. [2025-11-03T17:14:37.843786] [INFO ] [MAIN ] AN: Loaded 31287 existing records. [2025-11-03T17:14:38.056157] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:14:38.058067] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-11-03T17:14:38.058135] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-11-03T17:14:38.059264] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-11-03T17:14:38.059327] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-11-03T17:14:38.344486] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-11-03T17:14:38.451057] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:38.869186] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T17:14:38.941260] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-11-03T17:14:39.134819] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-11-03T17:14:39.934859] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-11-03T17:14:40.462225] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:14:40.734857] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-11-03T17:14:41.409675] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T17:14:41.534832] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-11-03T17:14:41.657824] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T17:14:42.334906] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-11-03T17:14:42.699488] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T17:14:43.134910] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-11. [2025-11-03T17:14:43.415120] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T17:14:43.934913] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-11-03T17:14:44.088104] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-11 (0.95 seconds). [2025-11-03T17:14:44.089032] [INFO ] [REMOTE ] AMTD: Full fetch complete (5726 records). [2025-11-03T17:14:44.089099] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-11-03T17:14:44.448730] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-11-03T17:14:44.448808] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-11-03T17:14:44.448966] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-11-03T17:14:44.449002] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-11-03T17:14:44.449355] [DEBUG] [LOCAL ] AMTD: Trimmed 5726 records to 4393 (keeping 200 days of data) [2025-11-03T17:14:44.473372] [DEBUG] [LOCAL ] AMTD: Primary data saved (4393 records). [2025-11-03T17:14:44.473436] [INFO ] [MAIN ] AMTD: Full history saved. [2025-11-03T17:14:44.473501] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMTD took 35.3s. Estimated remaining: 4h 52m 40s. Rate: 7.7 symbols/min [2025-11-03T17:14:44.641231] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:44.641413] [DEBUG] [LOCAL ] ANET: No existing data file found in primary storage. [2025-11-03T17:14:44.641452] [WARN ] [MAIN ] ANET: No existing data found, performing full refresh instead. [2025-11-03T17:14:44.641561] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-11-03T17:14:44.641603] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-11-03T17:14:44.641709] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-11-03T17:14:44.641790] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-11-03T17:14:44.740461] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-11-03T17:14:44.994695] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:45.271972] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T17:14:45.534906] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-11-03T17:14:46.051358] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T17:14:46.334857] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-11-03T17:14:46.788327] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T17:14:47.134910] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-11-03T17:14:47.636223] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T17:14:47.934883] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-11-03T17:14:48.399371] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T17:14:48.734862] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-11-03T17:14:49.467172] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T17:14:49.534818] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-11. [2025-11-03T17:14:50.051721] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:14:50.334899] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-11-03T17:14:51.134863] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-11-03T17:14:51.447447] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-11 (1.91 seconds). [2025-11-03T17:14:51.448825] [INFO ] [REMOTE ] AMTM: Full fetch complete (73232 records). [2025-11-03T17:14:51.448910] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-11-03T17:14:51.760242] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-11-03T17:14:51.897244] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-11-03T17:14:51.897348] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-11-03T17:14:51.898173] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-11-03T17:14:51.898236] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-11-03T17:14:51.899615] [DEBUG] [LOCAL ] AMTM: Trimmed 73232 records to 49911 (keeping 200 days of data) [2025-11-03T17:14:51.947371] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-11-03T17:14:52.180877] [DEBUG] [LOCAL ] AMTM: Primary data saved (49911 records). [2025-11-03T17:14:52.181017] [INFO ] [MAIN ] AMTM: Full history saved. [2025-11-03T17:14:52.181128] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMTM took 42.5s. Estimated remaining: 4h 52m 30s. Rate: 7.7 symbols/min [2025-11-03T17:14:52.355859] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:14:52.378500] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T17:14:52.426563] [DEBUG] [LOCAL ] ANF: Loaded 52712 existing records from primary storage. [2025-11-03T17:14:52.426893] [INFO ] [MAIN ] ANF: Loaded 52712 existing records. [2025-11-03T17:14:52.602003] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:14:52.602207] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-11-03T17:14:52.602261] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-11-03T17:14:52.603079] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-11-03T17:14:52.603149] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-11-03T17:14:52.741897] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-11-03T17:14:52.962598] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:14:53.534870] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-11-03T17:14:53.833051] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-11-03T17:14:53.876467] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:14:54.334849] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-11-03T17:14:55.118539] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T17:14:55.134813] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-11-03T17:14:55.934833] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-11-03T17:14:56.106314] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-11-03T17:14:56.420742] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T17:14:56.734905] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-11-03T17:14:56.863306] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T17:14:57.534892] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-11-03T17:14:58.248760] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T17:14:58.334816] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-11. [2025-11-03T17:14:59.066536] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-11-03T17:14:59.134893] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-11-03T17:14:59.934926] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-11-03T17:15:00.059332] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-11 (1.72 seconds). [2025-11-03T17:15:00.060749] [INFO ] [REMOTE ] AMX: Full fetch complete (71092 records). [2025-11-03T17:15:00.060858] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-11-03T17:15:00.456860] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-11-03T17:15:00.456966] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-11-03T17:15:00.457793] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-11-03T17:15:00.457875] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-11-03T17:15:00.459528] [DEBUG] [LOCAL ] AMX: Trimmed 71092 records to 48982 (keeping 200 days of data) [2025-11-03T17:15:00.580553] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T17:15:00.738694] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-11-03T17:15:00.792790] [DEBUG] [LOCAL ] AMX: Primary data saved (48982 records). [2025-11-03T17:15:00.793380] [INFO ] [MAIN ] AMX: Full history saved. [2025-11-03T17:15:00.794380] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AMX took 31.0s. Estimated remaining: 4h 52m 38s. Rate: 7.7 symbols/min [2025-11-03T17:15:00.921583] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-11-03T17:15:00.999564] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:00.999791] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-11-03T17:15:00.999840] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-11-03T17:15:00.999951] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-11-03T17:15:01.000035] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-11-03T17:15:01.000087] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-11-03T17:15:01.000123] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-11-03T17:15:01.382373] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:01.534823] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-11-03T17:15:02.334914] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-11-03T17:15:02.508803] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:15:02.509267] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-11-03T17:15:02.509363] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:15:02.509411] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-11-03T17:15:02.509473] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:15:02.509549] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-11-03T17:15:02.509624] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-11-03T17:15:02.509697] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-11-03T17:15:02.509754] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-11-03T17:15:02.509810] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. ANGX took 1.7s. Estimated remaining: 4h 50m 33s. Rate: 7.7 symbols/min [2025-11-03T17:15:02.691828] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:02.692066] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-11-03T17:15:02.692105] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-11-03T17:15:02.692257] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-11-03T17:15:02.692300] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-11-03T17:15:02.692395] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-11-03T17:15:02.692433] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-11-03T17:15:03.106351] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:03.137428] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-11-03T17:15:03.140153] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-11-03T17:15:03.180134] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-11-03T17:15:03.934864] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-11-03T17:15:04.423238] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:15:04.734827] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-11-03T17:15:05.537756] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-11-03T17:15:05.541439] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T17:15:05.564361] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T17:15:06.334824] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-11-03T17:15:07.134871] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-11-03T17:15:07.235577] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-11-03T17:15:07.604249] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-11-03T17:15:07.934875] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-11-03T17:15:08.467362] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T17:15:08.734869] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-11-03T17:15:09.520214] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-11-03T17:15:09.534835] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-11-03T17:15:09.811814] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-11-03T17:15:10.271425] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T17:15:10.334853] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-11-03T17:15:11.134837] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-11-03T17:15:11.307990] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T17:15:11.934844] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-11-03T17:15:12.562629] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T17:15:12.734963] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-11-03T17:15:12.901728] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T17:15:13.534887] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-11-03T17:15:14.334843] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-11. [2025-11-03T17:15:14.410459] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-11-03T17:15:15.051969] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-11-03T17:15:15.134861] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-11-03T17:15:15.742129] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T17:15:15.743260] [INFO ] [REMOTE ] AN: Full fetch complete (47158 records). [2025-11-03T17:15:15.743337] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-11-03T17:15:15.940098] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-11-03T17:15:16.117448] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-11-03T17:15:16.117542] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-11-03T17:15:16.118083] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-11-03T17:15:16.118145] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-11-03T17:15:16.119102] [DEBUG] [LOCAL ] AN: Trimmed 47158 records to 30690 (keeping 200 days of data) [2025-11-03T17:15:16.297142] [DEBUG] [LOCAL ] AN: Primary data saved (30690 records). [2025-11-03T17:15:16.297279] [INFO ] [MAIN ] AN: Full history saved. [2025-11-03T17:15:16.297356] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. AN took 38.7s. Estimated remaining: 4h 52m 21s. Rate: 7.7 symbols/min [2025-11-03T17:15:16.734832] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-11-03T17:15:16.785822] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-11-03T17:15:17.010110] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T17:15:17.534849] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-11-03T17:15:18.185234] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T17:15:18.334868] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-11. [2025-11-03T17:15:18.690227] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-11-03T17:15:19.134900] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-11-03T17:15:19.934857] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-11-03T17:15:20.468778] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-11 (2.13 seconds). [2025-11-03T17:15:20.470925] [INFO ] [REMOTE ] ANF: Full fetch complete (75751 records). [2025-11-03T17:15:20.471173] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-11-03T17:15:20.911389] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-11-03T17:15:20.911582] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-11-03T17:15:20.912461] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-11-03T17:15:20.912550] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-11-03T17:15:20.931962] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T17:15:20.938763] [DEBUG] [LOCAL ] ANF: Trimmed 75751 records to 51968 (keeping 200 days of data) [2025-11-03T17:15:20.939398] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-11-03T17:15:21.249937] [DEBUG] [LOCAL ] ANF: Primary data saved (51968 records). [2025-11-03T17:15:21.250342] [INFO ] [MAIN ] ANF: Full history saved. [2025-11-03T17:15:21.250446] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANF took 29.1s. Estimated remaining: 4h 51m 19s. Rate: 7.7 symbols/min [2025-11-03T17:15:21.286417] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-11-03T17:15:21.534897] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-11-03T17:15:21.687354] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T17:15:22.334993] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-11-03T17:15:22.982885] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-11-03T17:15:23.134909] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-11-03T17:15:23.690311] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-11-03T17:15:23.716464] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T17:15:23.934860] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-11-03T17:15:24.734890] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-11-03T17:15:25.857428] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-11-03T17:15:25.869772] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-11. [2025-11-03T17:15:25.919506] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T17:15:26.334925] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-11. [2025-11-03T17:15:27.444106] [DEBUG] [REMOTE ] ANET: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:15:27.444557] [WARN ] [REMOTE ] ANET: No data returned for month 2025-11 [2025-11-03T17:15:27.444686] [FATAL] [REMOTE ] ANET: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:15:27.444792] [FATAL] [MAIN ] ANET: Failed to fetch primary data. [2025-11-03T17:15:27.444861] [WARN ] [MAIN ] ANET: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:15:27.444945] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-11-03T17:15:27.445029] [DEBUG] [LOCAL ] ANET: No primary data file found to delete. [2025-11-03T17:15:27.445094] [INFO ] [LOCAL ] ANET: Starting deletion of derivative data. [2025-11-03T17:15:27.445235] [DEBUG] [LOCAL ] ANET: No derivative data file found to delete. [2025-11-03T17:15:27.445306] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANET took 43.0s. Estimated remaining: 4h 50m 41s. Rate: 7.7 symbols/min [2025-11-03T17:15:28.297994] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-11 (1.96 seconds). [2025-11-03T17:15:28.299139] [INFO ] [REMOTE ] ANRO: Full fetch complete (31464 records). [2025-11-03T17:15:28.299209] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-11-03T17:15:28.683900] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-11-03T17:15:28.683978] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-11-03T17:15:28.684526] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-11-03T17:15:28.684611] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-11-03T17:15:28.685831] [DEBUG] [LOCAL ] ANRO: Trimmed 31464 records to 20292 (keeping 200 days of data) [2025-11-03T17:15:28.799770] [DEBUG] [LOCAL ] ANRO: Primary data saved (20292 records). [2025-11-03T17:15:28.799894] [INFO ] [MAIN ] ANRO: Full history saved. [2025-11-03T17:15:28.799959] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANRO took 26.3s. Estimated remaining: 4h 48m 34s. Rate: 7.8 symbols/min [2025-11-03T17:15:29.538445] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:29.574093] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:29.581140] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:29.586789] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-11-03T17:15:29.586986] [DEBUG] [LOCAL ] ANVS: No existing data file found in primary storage. [2025-11-03T17:15:29.612118] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-11-03T17:15:29.626926] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-11-03T17:15:29.682296] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-11-03T17:15:29.687806] [WARN ] [MAIN ] ANVS: No existing data found, performing full refresh instead. [2025-11-03T17:15:29.687600] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:29.687712] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-11-03T17:15:29.688636] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-11-03T17:15:29.688320] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-11-03T17:15:29.694549] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-11-03T17:15:29.725142] [DEBUG] [LOCAL ] ANVS: No primary data file found to delete. [2025-11-03T17:15:29.725510] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-11-03T17:15:29.799479] [DEBUG] [LOCAL ] AOMR: Loaded 16135 existing records from primary storage. [2025-11-03T17:15:29.829949] [INFO ] [MAIN ] AOMR: Loaded 16135 existing records. [2025-11-03T17:15:30.110697] [DEBUG] [LOCAL ] AOD: Loaded 30795 existing records from primary storage. [2025-11-03T17:15:30.213165] [INFO ] [MAIN ] AOD: Loaded 30795 existing records. [2025-11-03T17:15:30.382943] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:15:30.460693] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-11-03T17:15:30.563599] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-11-03T17:15:30.696087] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-11-03T17:15:30.711817] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-11-03T17:15:30.890597] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:15:30.951528] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-11-03T17:15:30.977030] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-11-03T17:15:31.004822] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-11-03T17:15:30.986623] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:31.014130] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-11-03T17:15:31.029853] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-11-03T17:15:31.218621] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:31.267180] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-11-03T17:15:31.301088] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:15:31.358103] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-11-03T17:15:31.373957] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:15:31.391197] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-11-03T17:15:31.417169] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:15:31.460886] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-11-03T17:15:31.468220] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-11-03T17:15:31.488024] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-11-03T17:15:31.513876] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-11-03T17:15:31.575558] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 2.8s. Estimated remaining: 4h 46m 54s. Rate: 7.8 symbols/min [2025-11-03T17:15:31.629247] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:31.676873] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-11-03T17:15:31.879013] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:31.899505] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-11-03T17:15:31.901055] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:31.940808] [DEBUG] [LOCAL ] AON: Loaded 45556 existing records from primary storage. [2025-11-03T17:15:31.941084] [INFO ] [MAIN ] AON: Loaded 45556 existing records. [2025-11-03T17:15:32.131970] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:15:32.132174] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-11-03T17:15:32.132232] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-11-03T17:15:32.132981] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-11-03T17:15:32.133039] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-11-03T17:15:32.442785] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T17:15:32.474377] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-11-03T17:15:32.507384] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:32.507780] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-11-03T17:15:32.524706] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T17:15:32.530486] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-11-03T17:15:32.878360] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T17:15:32.885398] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-11-03T17:15:33.185744] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T17:15:33.534840] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-11-03T17:15:33.563040] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T17:15:33.672375] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-11-03T17:15:33.782385] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T17:15:34.206700] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T17:15:34.334839] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-11-03T17:15:35.136687] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-11-03T17:15:35.138962] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-11-03T17:15:35.934855] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-11-03T17:15:36.419274] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T17:15:36.734891] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-11-03T17:15:36.988283] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T17:15:37.534850] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-11-03T17:15:38.038607] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T17:15:38.334826] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-11-03T17:15:38.498860] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T17:15:39.134858] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-11-03T17:15:39.177633] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T17:15:39.733141] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-11-03T17:15:39.934852] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-11-03T17:15:40.734830] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-11-03T17:15:40.799112] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-11-03T17:15:41.534240] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T17:15:41.540093] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-11-03T17:15:42.116237] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T17:15:42.334861] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-11-03T17:15:42.996388] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-11-03T17:15:43.134877] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-11-03T17:15:43.934872] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-11-03T17:15:44.074702] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T17:15:44.734905] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-11-03T17:15:45.540035] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-11-03T17:15:45.562352] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-11-03T17:15:45.598418] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T17:15:46.334827] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-11-03T17:15:46.452599] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T17:15:47.134859] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-11-03T17:15:47.632381] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:15:47.934846] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-11-03T17:15:48.023353] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T17:15:48.734862] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-11-03T17:15:49.061892] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T17:15:49.320679] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T17:15:49.534865] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-11-03T17:15:50.334859] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-11-03T17:15:50.825351] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T17:15:51.134860] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-11-03T17:15:51.351960] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T17:15:51.934871] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-11. [2025-11-03T17:15:52.065096] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T17:15:52.734862] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-11-03T17:15:52.758992] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T17:15:52.760133] [INFO ] [REMOTE ] AOMR: Full fetch complete (23253 records). [2025-11-03T17:15:52.760222] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-11-03T17:15:53.127864] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-11-03T17:15:53.127942] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-11-03T17:15:53.128254] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-11-03T17:15:53.128294] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-11-03T17:15:53.128930] [DEBUG] [LOCAL ] AOMR: Trimmed 23253 records to 15954 (keeping 200 days of data) [2025-11-03T17:15:53.223106] [DEBUG] [LOCAL ] AOMR: Primary data saved (15954 records). [2025-11-03T17:15:53.223292] [INFO ] [MAIN ] AOMR: Full history saved. [2025-11-03T17:15:53.223396] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. AOMR took 24.4s. Estimated remaining: 4h 51m 4s. Rate: 7.7 symbols/min [2025-11-03T17:15:53.411518] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:53.439139] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T17:15:53.454502] [DEBUG] [LOCAL ] AORT: Loaded 28994 existing records from primary storage. [2025-11-03T17:15:53.454824] [INFO ] [MAIN ] AORT: Loaded 28994 existing records. [2025-11-03T17:15:53.539976] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-11-03T17:15:53.641201] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:15:53.641436] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-11-03T17:15:53.641484] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-11-03T17:15:53.642026] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-11-03T17:15:53.642082] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-11-03T17:15:53.992409] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:15:54.334833] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-11-03T17:15:54.363812] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-11-03T17:15:55.134851] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-11-03T17:15:55.323131] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:15:55.934877] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-11-03T17:15:56.262616] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-11-03T17:15:56.734895] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-11-03T17:15:57.311729] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:15:57.534878] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-11. [2025-11-03T17:15:57.710784] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T17:15:58.334912] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-11-03T17:15:59.134854] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-11-03T17:15:59.181621] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-11 (1.65 seconds). [2025-11-03T17:15:59.182579] [INFO ] [REMOTE ] ANVS: Full fetch complete (36596 records). [2025-11-03T17:15:59.182688] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-11-03T17:15:59.556900] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-11-03T17:15:59.557106] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-11-03T17:15:59.557637] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-11-03T17:15:59.557750] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-11-03T17:15:59.558931] [DEBUG] [LOCAL ] ANVS: Trimmed 36596 records to 24154 (keeping 200 days of data) [2025-11-03T17:15:59.694779] [DEBUG] [LOCAL ] ANVS: Primary data saved (24154 records). [2025-11-03T17:15:59.695025] [INFO ] [MAIN ] ANVS: Full history saved. [2025-11-03T17:15:59.695133] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. ANVS took 30.9s. Estimated remaining: 4h 50m 32s. Rate: 7.7 symbols/min [2025-11-03T17:15:59.906313] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-11-03T17:15:59.908854] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:15:59.938341] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-11-03T17:15:59.949128] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-11-03T17:15:59.990845] [DEBUG] [LOCAL ] AOS: Loaded 49272 existing records from primary storage. [2025-11-03T17:15:59.991147] [INFO ] [MAIN ] AOS: Loaded 49272 existing records. [2025-11-03T17:16:00.166398] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:00.166610] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-11-03T17:16:00.166688] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-11-03T17:16:00.167470] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-11-03T17:16:00.167528] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-11-03T17:16:00.521909] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:00.734886] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-11-03T17:16:01.225730] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T17:16:01.534956] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-11-03T17:16:01.989072] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:16:02.334892] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-11-03T17:16:02.695607] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T17:16:03.134831] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-11-03T17:16:03.239691] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-11-03T17:16:03.934865] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-11-03T17:16:04.465678] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T17:16:04.734994] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-11-03T17:16:04.891773] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T17:16:05.534922] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-11-03T17:16:05.920975] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T17:16:06.334874] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-11-03T17:16:06.801120] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T17:16:07.134857] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-11. [2025-11-03T17:16:07.370327] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T17:16:07.934855] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-11-03T17:16:08.630199] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T17:16:08.734876] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-11-03T17:16:09.099066] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-11 (1.96 seconds). [2025-11-03T17:16:09.100543] [INFO ] [REMOTE ] AON: Full fetch complete (65524 records). [2025-11-03T17:16:09.100673] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-11-03T17:16:09.506886] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-11-03T17:16:09.506979] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-11-03T17:16:09.507679] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-11-03T17:16:09.507744] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-11-03T17:16:09.509041] [DEBUG] [LOCAL ] AON: Trimmed 65524 records to 44957 (keeping 200 days of data) [2025-11-03T17:16:09.564216] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-11. [2025-11-03T17:16:09.795170] [DEBUG] [LOCAL ] AON: Primary data saved (44957 records). [2025-11-03T17:16:09.809105] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T17:16:09.808432] [INFO ] [MAIN ] AON: Full history saved. [2025-11-03T17:16:09.814724] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. AON took 38.2s. Estimated remaining: 4h 51m 7s. Rate: 7.7 symbols/min [2025-11-03T17:16:09.980116] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:09.987904] [DEBUG] [LOCAL ] AP: Loaded 7602 existing records from primary storage. [2025-11-03T17:16:09.988078] [INFO ] [MAIN ] AP: Loaded 7602 existing records. [2025-11-03T17:16:10.158601] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:10.158857] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-11-03T17:16:10.158906] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-11-03T17:16:10.159119] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-11-03T17:16:10.159158] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-11-03T17:16:10.345160] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-11-03T17:16:10.509021] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:10.979044] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T17:16:10.980163] [INFO ] [REMOTE ] AOD: Full fetch complete (44324 records). [2025-11-03T17:16:10.980271] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-11-03T17:16:11.163470] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-11-03T17:16:11.416981] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-11-03T17:16:11.417085] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-11-03T17:16:11.417609] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-11-03T17:16:11.417681] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-11-03T17:16:11.418724] [DEBUG] [LOCAL ] AOD: Trimmed 44324 records to 30300 (keeping 200 days of data) [2025-11-03T17:16:11.595339] [DEBUG] [LOCAL ] AOD: Primary data saved (30300 records). [2025-11-03T17:16:11.595507] [INFO ] [MAIN ] AOD: Full history saved. [2025-11-03T17:16:11.595604] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AOD took 42.8s. Estimated remaining: 4h 49m 11s. Rate: 7.7 symbols/min [2025-11-03T17:16:11.772616] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:11.811504] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T17:16:11.848714] [DEBUG] [LOCAL ] APAM: Loaded 35757 existing records from primary storage. [2025-11-03T17:16:11.849056] [INFO ] [MAIN ] APAM: Loaded 35757 existing records. [2025-11-03T17:16:11.944914] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-11-03T17:16:12.027552] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:12.027846] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-11-03T17:16:12.027896] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-11-03T17:16:12.028691] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-11-03T17:16:12.028751] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-11-03T17:16:12.431298] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:12.436572] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-11-03T17:16:12.457175] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T17:16:12.734861] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-11-03T17:16:13.118367] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-11-03T17:16:13.534895] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-11-03T17:16:13.598584] [DEBUG] [REMOTE ] AP: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-11-03T17:16:13.598930] [WARN ] [REMOTE ] AP: No data returned for month 2025-03 [2025-11-03T17:16:13.599018] [FATAL] [REMOTE ] AP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:16:13.599115] [FATAL] [MAIN ] AP: Failed to fetch primary data. [2025-11-03T17:16:13.599181] [WARN ] [MAIN ] AP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:16:13.599252] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-11-03T17:16:13.599314] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-11-03T17:16:13.599350] [INFO ] [LOCAL ] AP: Starting deletion of derivative data. [2025-11-03T17:16:13.599515] [DEBUG] [LOCAL ] AP: Deleted derivative data file. [2025-11-03T17:16:13.599597] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AP took 3.8s. Estimated remaining: 4h 47m 21s. Rate: 7.8 symbols/min [2025-11-03T17:16:13.767707] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:13.806766] [DEBUG] [LOCAL ] APD: Loaded 45984 existing records from primary storage. [2025-11-03T17:16:13.807126] [INFO ] [MAIN ] APD: Loaded 45984 existing records. [2025-11-03T17:16:13.982965] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:13.983121] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-11-03T17:16:13.983168] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-11-03T17:16:13.983963] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-11-03T17:16:13.984021] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-11-03T17:16:14.349898] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-11-03T17:16:14.354696] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:15.134915] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-11-03T17:16:15.784616] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T17:16:15.934838] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-11-03T17:16:16.691759] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T17:16:16.734820] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-11-03T17:16:17.043738] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:16:17.534858] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-11-03T17:16:18.104194] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T17:16:18.334862] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-11-03T17:16:18.553061] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:16:19.134833] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-11-03T17:16:19.807954] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T17:16:19.934844] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-11-03T17:16:20.240774] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T17:16:20.734852] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-11-03T17:16:21.224079] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T17:16:21.534855] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-11-03T17:16:21.994124] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T17:16:22.334836] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-11-03T17:16:22.544211] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T17:16:23.134844] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-11. [2025-11-03T17:16:23.511169] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T17:16:23.863437] [DEBUG] [REMOTE ] AORT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:16:23.863771] [WARN ] [REMOTE ] AORT: No data returned for month 2025-11 [2025-11-03T17:16:23.863856] [FATAL] [REMOTE ] AORT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:16:23.863931] [FATAL] [MAIN ] AORT: Failed to fetch primary data. [2025-11-03T17:16:23.863998] [WARN ] [MAIN ] AORT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:16:23.864067] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-11-03T17:16:23.864130] [DEBUG] [LOCAL ] AORT: No primary data file found to delete. [2025-11-03T17:16:23.864166] [INFO ] [LOCAL ] AORT: Starting deletion of derivative data. [2025-11-03T17:16:23.864359] [DEBUG] [LOCAL ] AORT: Deleted derivative data file. [2025-11-03T17:16:23.864441] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AORT took 30.6s. Estimated remaining: 4h 47m 59s. Rate: 7.8 symbols/min [2025-11-03T17:16:23.939976] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-11-03T17:16:24.031375] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:24.031530] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-11-03T17:16:24.031566] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-11-03T17:16:24.031698] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-11-03T17:16:24.031751] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-11-03T17:16:24.031794] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-11-03T17:16:24.031825] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-11-03T17:16:24.371711] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:24.734847] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-11-03T17:16:25.215576] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T17:16:25.534833] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-11-03T17:16:26.047438] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T17:16:26.334895] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-11-03T17:16:26.688980] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T17:16:27.134867] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-11-03T17:16:27.846902] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-11-03T17:16:27.934833] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-11-03T17:16:28.428383] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T17:16:28.734855] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-11-03T17:16:29.455368] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T17:16:29.534839] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-11-03T17:16:30.080681] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T17:16:30.334858] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-11-03T17:16:30.732836] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T17:16:31.134849] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-11-03T17:16:31.557812] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T17:16:31.934864] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-11-03T17:16:32.341593] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T17:16:32.734842] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-11-03T17:16:32.885596] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T17:16:33.534854] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-11-03T17:16:34.011594] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:16:34.334841] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-11-03T17:16:34.459235] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T17:16:35.134839] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-11-03T17:16:35.664372] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T17:16:35.934847] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-11-03T17:16:36.506417] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T17:16:36.734840] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-11-03T17:16:37.264809] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:16:37.534810] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-11-03T17:16:38.074231] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-11-03T17:16:38.334845] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-11. [2025-11-03T17:16:39.134837] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-11-03T17:16:39.240679] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-11-03T17:16:39.838366] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-11 (1.50 seconds). [2025-11-03T17:16:39.839502] [INFO ] [REMOTE ] APAM: Full fetch complete (51995 records). [2025-11-03T17:16:39.839584] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-11-03T17:16:39.943992] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-11-03T17:16:40.226055] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-11-03T17:16:40.226135] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-11-03T17:16:40.226689] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-11-03T17:16:40.226751] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-11-03T17:16:40.227891] [DEBUG] [LOCAL ] APAM: Trimmed 51995 records to 35143 (keeping 200 days of data) [2025-11-03T17:16:40.439965] [DEBUG] [LOCAL ] APAM: Primary data saved (35143 records). [2025-11-03T17:16:40.440362] [INFO ] [MAIN ] APAM: Full history saved. [2025-11-03T17:16:40.440529] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. APAM took 28.8s. Estimated remaining: 4h 50m 26s. Rate: 7.7 symbols/min [2025-11-03T17:16:40.610989] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:40.645365] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T17:16:40.702879] [DEBUG] [LOCAL ] APH: Loaded 54471 existing records from primary storage. [2025-11-03T17:16:40.703202] [INFO ] [MAIN ] APH: Loaded 54471 existing records. [2025-11-03T17:16:40.744948] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-11. [2025-11-03T17:16:40.881692] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:40.881926] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-11-03T17:16:40.881975] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-11-03T17:16:40.882928] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-11-03T17:16:40.882985] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-11-03T17:16:41.231217] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:41.534825] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-11-03T17:16:41.628678] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T17:16:41.754056] [DEBUG] [REMOTE ] AOS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:16:41.754524] [WARN ] [REMOTE ] AOS: No data returned for month 2025-11 [2025-11-03T17:16:41.754631] [FATAL] [REMOTE ] AOS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:16:41.754958] [FATAL] [MAIN ] AOS: Failed to fetch primary data. [2025-11-03T17:16:41.755289] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:16:41.755429] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-11-03T17:16:41.755580] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-11-03T17:16:41.755773] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-11-03T17:16:41.756215] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-11-03T17:16:41.756312] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. AOS took 42.1s. Estimated remaining: 4h 48m 26s. Rate: 7.8 symbols/min [2025-11-03T17:16:41.934939] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:41.981397] [DEBUG] [LOCAL ] APLE: Loaded 52657 existing records from primary storage. [2025-11-03T17:16:41.981740] [INFO ] [MAIN ] APLE: Loaded 52657 existing records. [2025-11-03T17:16:42.162977] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:42.163182] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-11-03T17:16:42.163230] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-11-03T17:16:42.164320] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-11-03T17:16:42.164379] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-11-03T17:16:42.343305] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-11-03T17:16:42.538300] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:43.112496] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T17:16:43.134871] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-11-03T17:16:43.617379] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:16:43.934925] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-11-03T17:16:44.622976] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T17:16:44.734831] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-11-03T17:16:45.004037] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T17:16:45.534870] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-11-03T17:16:46.192403] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T17:16:46.334857] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-11-03T17:16:47.097294] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T17:16:47.134822] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-11-03T17:16:47.823688] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T17:16:47.934845] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-11-03T17:16:48.550325] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T17:16:48.734871] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-11-03T17:16:49.534863] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-11-03T17:16:49.754133] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-11-03T17:16:49.997860] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T17:16:50.334891] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-11-03T17:16:51.075197] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T17:16:51.134832] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-11-03T17:16:51.752313] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T17:16:51.934949] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-11-03T17:16:52.545069] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T17:16:52.734894] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-11-03T17:16:53.144302] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T17:16:53.534859] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-11. [2025-11-03T17:16:54.204520] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T17:16:54.334852] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-11-03T17:16:54.478087] [DEBUG] [REMOTE ] APG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:16:54.478349] [WARN ] [REMOTE ] APG: No data returned for month 2025-11 [2025-11-03T17:16:54.478450] [FATAL] [REMOTE ] APG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:16:54.478572] [FATAL] [MAIN ] APG: Failed to fetch primary data. [2025-11-03T17:16:54.478681] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:16:54.478772] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-11-03T17:16:54.478851] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-11-03T17:16:54.478890] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-11-03T17:16:54.478929] [DEBUG] [LOCAL ] APG: No derivative data file found to delete. [2025-11-03T17:16:54.478973] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APG took 30.6s. Estimated remaining: 4h 49m 44s. Rate: 7.7 symbols/min [2025-11-03T17:16:54.685716] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:16:54.741018] [DEBUG] [LOCAL ] APO: Loaded 54146 existing records from primary storage. [2025-11-03T17:16:54.741356] [INFO ] [MAIN ] APO: Loaded 54146 existing records. [2025-11-03T17:16:54.959731] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:16:54.959989] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-11-03T17:16:54.960084] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-11-03T17:16:54.960956] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-11-03T17:16:54.961014] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-11-03T17:16:55.140285] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-11-03T17:16:55.362423] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:16:55.638094] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:16:55.934859] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-11-03T17:16:56.506527] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T17:16:56.734876] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-11-03T17:16:57.317908] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T17:16:57.534895] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-11-03T17:16:58.321233] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-11-03T17:16:58.334816] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-11-03T17:16:58.806922] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T17:16:59.134850] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-11. [2025-11-03T17:16:59.745935] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T17:16:59.934852] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-11-03T17:17:00.734877] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-11-03T17:17:00.992148] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-11 (1.86 seconds). [2025-11-03T17:17:00.993578] [INFO ] [REMOTE ] APD: Full fetch complete (67226 records). [2025-11-03T17:17:00.993686] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-11-03T17:17:01.377944] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-11-03T17:17:01.378044] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-11-03T17:17:01.378725] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-11-03T17:17:01.378786] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-11-03T17:17:01.380019] [DEBUG] [LOCAL ] APD: Trimmed 67226 records to 45308 (keeping 200 days of data) [2025-11-03T17:17:01.558444] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-11-03T17:17:01.686308] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-11-03T17:17:01.743886] [DEBUG] [LOCAL ] APD: Primary data saved (45308 records). [2025-11-03T17:17:01.744023] [INFO ] [MAIN ] APD: Full history saved. [2025-11-03T17:17:01.745066] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APD took 48.1s. Estimated remaining: 4h 49m 28s. Rate: 7.7 symbols/min [2025-11-03T17:17:01.922081] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:01.922250] [DEBUG] [LOCAL ] APOS: No existing data file found in primary storage. [2025-11-03T17:17:01.922288] [WARN ] [MAIN ] APOS: No existing data found, performing full refresh instead. [2025-11-03T17:17:01.922405] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-11-03T17:17:01.922464] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-11-03T17:17:01.922506] [DEBUG] [LOCAL ] APOS: No primary data file found to delete. [2025-11-03T17:17:01.922538] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-11-03T17:17:02.291806] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:02.334849] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-11-03T17:17:02.481402] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T17:17:02.892842] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-11-03T17:17:03.117292] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T17:17:03.134818] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-11-03T17:17:03.934858] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-11-03T17:17:04.368886] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-11-03T17:17:04.596792] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T17:17:04.734849] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-11-03T17:17:05.534829] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-11-03T17:17:05.997230] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-11-03T17:17:06.035582] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:17:06.334911] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-11. [2025-11-03T17:17:06.560771] [DEBUG] [REMOTE ] APH: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:17:06.561091] [WARN ] [REMOTE ] APH: No data returned for month 2025-11 [2025-11-03T17:17:06.561178] [FATAL] [REMOTE ] APH: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:17:06.561278] [FATAL] [MAIN ] APH: Failed to fetch primary data. [2025-11-03T17:17:06.561343] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:17:06.561414] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-11-03T17:17:06.561477] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-11-03T17:17:06.561513] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-11-03T17:17:06.561687] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-11-03T17:17:06.562300] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 26.1s. Estimated remaining: 4h 48m 30s. Rate: 7.7 symbols/min [2025-11-03T17:17:06.729861] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:06.730048] [DEBUG] [LOCAL ] APTV: No existing data file found in primary storage. [2025-11-03T17:17:06.730086] [WARN ] [MAIN ] APTV: No existing data found, performing full refresh instead. [2025-11-03T17:17:06.730190] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-11-03T17:17:06.730230] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-11-03T17:17:06.730271] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-11-03T17:17:06.730302] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-11-03T17:17:07.091164] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:07.134936] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-11-03T17:17:07.934864] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-11-03T17:17:08.505395] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T17:17:08.734907] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-11-03T17:17:09.221394] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T17:17:09.433151] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T17:17:09.534812] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-11-03T17:17:10.334843] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-11-03T17:17:11.145048] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-11-03T17:17:11.166236] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T17:17:11.707266] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T17:17:11.934846] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-11-03T17:17:12.493331] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T17:17:12.734892] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-11-03T17:17:13.305997] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T17:17:13.383569] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T17:17:13.534848] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-11-03T17:17:14.013357] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T17:17:14.334855] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-11-03T17:17:15.134864] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-11-03T17:17:15.614976] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T17:17:15.934924] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-11-03T17:17:16.640030] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T17:17:16.734931] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-11-03T17:17:17.277813] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T17:17:17.534852] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-11-03T17:17:18.334918] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-11-03T17:17:18.394097] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-11-03T17:17:18.845320] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T17:17:19.001950] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T17:17:19.134855] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-11-03T17:17:19.934907] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-11-03T17:17:20.454927] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T17:17:20.734859] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-11-03T17:17:21.416223] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T17:17:21.534871] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-11-03T17:17:21.956996] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:17:22.334824] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-11-03T17:17:22.752563] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-11-03T17:17:23.001607] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T17:17:23.134889] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-11. [2025-11-03T17:17:23.934857] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-11-03T17:17:24.734947] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-11-03T17:17:25.432966] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-11 (2.30 seconds). [2025-11-03T17:17:25.434478] [INFO ] [REMOTE ] APLE: Full fetch complete (74836 records). [2025-11-03T17:17:25.434603] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-11-03T17:17:25.535735] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-11-03T17:17:25.783734] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-11-03T17:17:25.893590] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-11-03T17:17:25.894556] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-11-03T17:17:25.895420] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-11-03T17:17:25.895503] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-11-03T17:17:25.897213] [DEBUG] [LOCAL ] APLE: Trimmed 74836 records to 51889 (keeping 200 days of data) [2025-11-03T17:17:26.142463] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T17:17:26.165631] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T17:17:26.257233] [DEBUG] [LOCAL ] APLE: Primary data saved (51889 records). [2025-11-03T17:17:26.257359] [INFO ] [MAIN ] APLE: Full history saved. [2025-11-03T17:17:26.257432] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APLE took 44.5s. Estimated remaining: 4h 51m 43s. Rate: 7.7 symbols/min [2025-11-03T17:17:26.340023] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-11-03T17:17:26.429792] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:26.430030] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-11-03T17:17:26.430100] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-11-03T17:17:26.430242] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-11-03T17:17:26.430302] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-11-03T17:17:26.430373] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-11-03T17:17:26.430441] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-11-03T17:17:26.789596] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:27.134894] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-11-03T17:17:27.674551] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T17:17:27.934857] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-11-03T17:17:28.739935] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-11-03T17:17:28.756092] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T17:17:29.260495] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T17:17:29.534852] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-11-03T17:17:29.931565] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T17:17:30.334857] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-11. [2025-11-03T17:17:30.425116] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-11-03T17:17:31.134906] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-11-03T17:17:31.485504] [DEBUG] [REMOTE ] APO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:17:31.485817] [WARN ] [REMOTE ] APO: No data returned for month 2025-11 [2025-11-03T17:17:31.485918] [FATAL] [REMOTE ] APO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:17:31.486000] [FATAL] [MAIN ] APO: Failed to fetch primary data. [2025-11-03T17:17:31.486062] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:17:31.486151] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-11-03T17:17:31.486213] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-11-03T17:17:31.486248] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-11-03T17:17:31.486379] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-11-03T17:17:31.487051] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APO took 37.0s. Estimated remaining: 4h 50m 52s. Rate: 7.7 symbols/min [2025-11-03T17:17:31.654838] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:31.661045] [DEBUG] [LOCAL ] AQNB: Loaded 3713 existing records from primary storage. [2025-11-03T17:17:31.661248] [INFO ] [MAIN ] AQNB: Loaded 3713 existing records. [2025-11-03T17:17:31.837668] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:17:31.837883] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-11-03T17:17:31.837931] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-11-03T17:17:31.838103] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-11-03T17:17:31.838141] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-11-03T17:17:31.936762] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-11-03T17:17:32.217192] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:32.548087] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T17:17:32.734839] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-11-03T17:17:33.114690] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T17:17:33.148505] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-11-03T17:17:33.534849] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-11-03T17:17:34.334861] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-11. [2025-11-03T17:17:34.821280] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T17:17:35.034143] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T17:17:35.034912] [INFO ] [REMOTE ] APOS: Full fetch complete (10251 records). [2025-11-03T17:17:35.034980] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-11-03T17:17:35.135059] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-11. [2025-11-03T17:17:35.367366] [DEBUG] [REMOTE ] APTV: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:17:35.376924] [WARN ] [REMOTE ] APTV: No data returned for month 2025-11 [2025-11-03T17:17:35.399205] [FATAL] [REMOTE ] APTV: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:17:35.399350] [FATAL] [MAIN ] APTV: Failed to fetch primary data. [2025-11-03T17:17:35.399456] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:17:35.399568] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-11-03T17:17:35.399715] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-11-03T17:17:35.399881] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-11-03T17:17:35.400128] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-11-03T17:17:35.399832] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-11-03T17:17:35.400279] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-11-03T17:17:35.400202] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-11-03T17:17:35.400384] [DEBUG] [LOCAL ] APTV: No derivative data file found to delete. [2025-11-03T17:17:35.400467] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APTV took 28.8s. Estimated remaining: 4h 49m 39s. Rate: 7.7 symbols/min [2025-11-03T17:17:35.444825] [DEBUG] [LOCAL ] APOS: Trimmed 10251 records to 6771 (keeping 200 days of data) [2025-11-03T17:17:35.635041] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:35.641360] [DEBUG] [LOCAL ] APOS: Primary data saved (6771 records). [2025-11-03T17:17:35.641548] [INFO ] [MAIN ] APOS: Full history saved. [2025-11-03T17:17:35.641627] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. APOS took 33.9s. Estimated remaining: 4h 47m 28s. Rate: 7.8 symbols/min [2025-11-03T17:17:35.831447] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:35.832357] [DEBUG] [LOCAL ] ARCO: No existing data file found in primary storage. [2025-11-03T17:17:35.846193] [WARN ] [MAIN ] ARCO: No existing data found, performing full refresh instead. [2025-11-03T17:17:35.846383] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-11-03T17:17:35.846478] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-11-03T17:17:35.846560] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-11-03T17:17:35.847349] [DEBUG] [LOCAL ] AR: Loaded 54367 existing records from primary storage. [2025-11-03T17:17:35.847434] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-11-03T17:17:35.878944] [INFO ] [MAIN ] AR: Loaded 54367 existing records. [2025-11-03T17:17:35.940085] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-11-03T17:17:36.213043] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:17:36.237677] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-11-03T17:17:36.275315] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-11-03T17:17:36.308159] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-11-03T17:17:36.308231] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-11-03T17:17:36.546608] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:36.739919] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-11-03T17:17:36.776108] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:37.056573] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T17:17:37.233980] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T17:17:37.534886] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-11-03T17:17:37.917930] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-11-03T17:17:38.334880] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-11-03T17:17:38.733905] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-11-03T17:17:39.134855] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-11-03T17:17:39.573425] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T17:17:39.934875] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-11-03T17:17:40.734927] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-11-03T17:17:41.357183] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T17:17:41.534862] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-11-03T17:17:42.077543] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T17:17:42.334902] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-11-03T17:17:42.780167] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T17:17:43.134915] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-11-03T17:17:43.486101] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T17:17:43.712146] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T17:17:43.934951] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-11-03T17:17:44.734862] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-11-03T17:17:45.226025] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T17:17:45.534839] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-11-03T17:17:46.255665] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T17:17:46.334809] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-11-03T17:17:46.821985] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:17:47.134900] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-11-03T17:17:47.821367] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T17:17:47.934829] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-11-03T17:17:48.500169] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T17:17:48.734948] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-11-03T17:17:49.324787] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T17:17:49.534822] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-11-03T17:17:49.903887] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-11-03T17:17:50.228118] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T17:17:50.334826] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-11-03T17:17:51.134870] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-11-03T17:17:51.940786] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-11-03T17:17:51.966354] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-11-03T17:17:52.311415] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-11-03T17:17:52.575392] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T17:17:52.734824] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-11-03T17:17:53.534860] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-11-03T17:17:53.874228] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:17:54.172506] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T17:17:54.334858] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-11-03T17:17:55.134866] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-11-03T17:17:55.426069] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T17:17:55.893714] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T17:17:55.934813] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-11. [2025-11-03T17:17:56.734856] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-11. [2025-11-03T17:17:57.033953] [DEBUG] [REMOTE ] AQNB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:17:57.034283] [WARN ] [REMOTE ] AQNB: No data returned for month 2025-11 [2025-11-03T17:17:57.034384] [FATAL] [REMOTE ] AQNB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:17:57.034503] [FATAL] [MAIN ] AQNB: Failed to fetch primary data. [2025-11-03T17:17:57.034574] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:17:57.034670] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-11-03T17:17:57.034757] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-11-03T17:17:57.034838] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-11-03T17:17:57.035037] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-11-03T17:17:57.035126] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. AQNB took 25.5s. Estimated remaining: 4h 51m 2s. Rate: 7.7 symbols/min [2025-11-03T17:17:57.244592] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:57.260983] [DEBUG] [LOCAL ] ARDC: Loaded 15064 existing records from primary storage. [2025-11-03T17:17:57.261266] [INFO ] [MAIN ] ARDC: Loaded 15064 existing records. [2025-11-03T17:17:57.480486] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:17:57.480739] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-11-03T17:17:57.480793] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-11-03T17:17:57.481178] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-11-03T17:17:57.481255] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-11-03T17:17:57.541415] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-11-03T17:17:57.854132] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-11 (1.92 seconds). [2025-11-03T17:17:57.889559] [INFO ] [REMOTE ] AQN: Full fetch complete (75247 records). [2025-11-03T17:17:57.892922] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:57.893160] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-11-03T17:17:58.273967] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-11-03T17:17:58.274051] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-11-03T17:17:58.274794] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-11-03T17:17:58.274858] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-11-03T17:17:58.276291] [DEBUG] [LOCAL ] AQN: Trimmed 75247 records to 51512 (keeping 200 days of data) [2025-11-03T17:17:58.359253] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-11-03T17:17:58.573152] [DEBUG] [LOCAL ] AQN: Primary data saved (51512 records). [2025-11-03T17:17:58.573428] [INFO ] [MAIN ] AQN: Full history saved. [2025-11-03T17:17:58.573525] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 32.3s. Estimated remaining: 4h 49m 13s. Rate: 7.7 symbols/min [2025-11-03T17:17:58.760758] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:17:58.787794] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T17:17:58.819190] [DEBUG] [LOCAL ] ARDT: Loaded 27660 existing records from primary storage. [2025-11-03T17:17:58.819473] [INFO ] [MAIN ] ARDT: Loaded 27660 existing records. [2025-11-03T17:17:58.998190] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:17:58.998426] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-11-03T17:17:58.998474] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-11-03T17:17:58.998996] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-11-03T17:17:58.999054] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-11-03T17:17:59.140023] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-11-03T17:17:59.352058] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:17:59.819573] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T17:17:59.934852] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-11-03T17:17:59.983856] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T17:18:00.734875] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-11-03T17:18:01.187039] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T17:18:01.534887] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-11-03T17:18:02.343449] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-11-03T17:18:02.388621] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-11-03T17:18:02.841584] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T17:18:03.006554] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-11-03T17:18:03.134910] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-11-03T17:18:03.934873] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-11-03T17:18:04.241738] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:18:04.734858] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-11-03T17:18:05.166677] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:18:05.534884] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-11-03T17:18:06.229308] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T17:18:06.334816] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-11-03T17:18:06.443410] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T17:18:07.067545] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T17:18:07.134882] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-11-03T17:18:07.795455] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T17:18:07.934883] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-11-03T17:18:08.734858] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-11-03T17:18:09.053309] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-11-03T17:18:09.534889] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-11-03T17:18:09.581282] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T17:18:10.293142] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T17:18:10.334828] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-11-03T17:18:11.134835] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-11-03T17:18:11.245929] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-11-03T17:18:11.733604] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-11-03T17:18:11.934820] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-11-03T17:18:12.734881] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-11-03T17:18:13.271787] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T17:18:13.532319] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T17:18:13.536697] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-11-03T17:18:14.334913] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-11-03T17:18:14.612520] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T17:18:15.134864] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-11-03T17:18:15.195552] [DEBUG] [REMOTE ] ARDT: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-11-03T17:18:15.196071] [WARN ] [REMOTE ] ARDT: No data returned for month 2025-05 [2025-11-03T17:18:15.196199] [FATAL] [REMOTE ] ARDT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:18:15.196294] [FATAL] [MAIN ] ARDT: Failed to fetch primary data. [2025-11-03T17:18:15.196358] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:18:15.196458] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-11-03T17:18:15.196548] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-11-03T17:18:15.196588] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-11-03T17:18:15.197030] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-11-03T17:18:15.197320] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. ARDT took 16.6s. Estimated remaining: 4h 51m 26s. Rate: 7.6 symbols/min [2025-11-03T17:18:15.365711] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:15.409742] [DEBUG] [LOCAL ] ARE: Loaded 51640 existing records from primary storage. [2025-11-03T17:18:15.410057] [INFO ] [MAIN ] ARE: Loaded 51640 existing records. [2025-11-03T17:18:15.581032] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:15.581237] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-11-03T17:18:15.581284] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-11-03T17:18:15.582121] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-11-03T17:18:15.582177] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-11-03T17:18:15.935199] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:15.935600] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-11-03T17:18:15.987347] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-11-03T17:18:16.557145] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T17:18:16.734827] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-11-03T17:18:17.534861] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-11-03T17:18:17.876027] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T17:18:18.334892] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-11-03T17:18:18.715497] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T17:18:18.894625] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T17:18:19.134874] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-11. [2025-11-03T17:18:19.934854] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-11. [2025-11-03T17:18:20.006101] [DEBUG] [REMOTE ] ARCO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:18:20.006441] [WARN ] [REMOTE ] ARCO: No data returned for month 2025-11 [2025-11-03T17:18:20.006522] [FATAL] [REMOTE ] ARCO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:18:20.006596] [FATAL] [MAIN ] ARCO: Failed to fetch primary data. [2025-11-03T17:18:20.006684] [WARN ] [MAIN ] ARCO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:18:20.006760] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-11-03T17:18:20.006841] [DEBUG] [LOCAL ] ARCO: No primary data file found to delete. [2025-11-03T17:18:20.006878] [INFO ] [LOCAL ] ARCO: Starting deletion of derivative data. [2025-11-03T17:18:20.006916] [DEBUG] [LOCAL ] ARCO: No derivative data file found to delete. [2025-11-03T17:18:20.006960] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. ARCO took 44.4s. Estimated remaining: 4h 50m 30s. Rate: 7.7 symbols/min [2025-11-03T17:18:20.176074] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:20.200961] [DEBUG] [REMOTE ] AR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:18:20.201293] [WARN ] [REMOTE ] AR: No data returned for month 2025-11 [2025-11-03T17:18:20.201395] [FATAL] [REMOTE ] AR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:18:20.201473] [FATAL] [MAIN ] AR: Failed to fetch primary data. [2025-11-03T17:18:20.201509] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:18:20.201545] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-11-03T17:18:20.201600] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-11-03T17:18:20.201634] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-11-03T17:18:20.201838] [DEBUG] [LOCAL ] AR: Deleted derivative data file. [2025-11-03T17:18:20.202418] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. AR took 44.8s. Estimated remaining: 4h 48m 22s. Rate: 7.7 symbols/min [2025-11-03T17:18:20.343846] [DEBUG] [LOCAL ] ARES: Loaded 50339 existing records from primary storage. [2025-11-03T17:18:20.372129] [INFO ] [MAIN ] ARES: Loaded 50339 existing records. [2025-11-03T17:18:20.473458] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:20.586219] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:20.586537] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-11-03T17:18:20.586696] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-11-03T17:18:20.588324] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-11-03T17:18:20.588384] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-11-03T17:18:20.737679] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-11-03T17:18:20.787872] [DEBUG] [LOCAL ] ARI: Loaded 43685 existing records from primary storage. [2025-11-03T17:18:20.811515] [INFO ] [MAIN ] ARI: Loaded 43685 existing records. [2025-11-03T17:18:21.131247] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:21.150512] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:21.150704] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-11-03T17:18:21.150762] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-11-03T17:18:21.151432] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-11-03T17:18:21.151488] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-11-03T17:18:21.498245] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:21.534874] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-11-03T17:18:22.087777] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T17:18:22.334854] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-11-03T17:18:22.806034] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T17:18:23.134858] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-11-03T17:18:23.759069] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T17:18:23.934906] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-11-03T17:18:24.583290] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T17:18:24.734890] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-11-03T17:18:25.116233] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T17:18:25.534883] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-11-03T17:18:26.343378] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-11-03T17:18:26.349600] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T17:18:26.708512] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:18:27.134854] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-11-03T17:18:27.551686] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:18:27.934909] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-11-03T17:18:28.328410] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T17:18:28.734853] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-11-03T17:18:29.293341] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T17:18:29.534857] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-11-03T17:18:30.092052] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T17:18:30.334900] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-11-03T17:18:30.922268] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:18:31.132585] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-11-03T17:18:31.136692] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-11-03T17:18:31.934850] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-11-03T17:18:32.594219] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T17:18:32.734857] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-11. [2025-11-03T17:18:33.331444] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T17:18:33.534856] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-11-03T17:18:33.704399] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T17:18:33.705332] [INFO ] [REMOTE ] ARDC: Full fetch complete (21708 records). [2025-11-03T17:18:33.705416] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-11-03T17:18:34.086948] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-11-03T17:18:34.087052] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-11-03T17:18:34.087441] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-11-03T17:18:34.087483] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-11-03T17:18:34.088296] [DEBUG] [LOCAL ] ARDC: Trimmed 21708 records to 14885 (keeping 200 days of data) [2025-11-03T17:18:34.177369] [DEBUG] [LOCAL ] ARDC: Primary data saved (14885 records). [2025-11-03T17:18:34.177505] [INFO ] [MAIN ] ARDC: Full history saved. [2025-11-03T17:18:34.177586] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDC took 37.1s. Estimated remaining: 4h 49m 51s. Rate: 7.7 symbols/min [2025-11-03T17:18:34.341500] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-11-03T17:18:34.362119] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:34.410889] [DEBUG] [LOCAL ] ARLO: Loaded 44201 existing records from primary storage. [2025-11-03T17:18:34.411227] [INFO ] [MAIN ] ARLO: Loaded 44201 existing records. [2025-11-03T17:18:34.605042] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:34.605313] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-11-03T17:18:34.605390] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-11-03T17:18:34.606346] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-11-03T17:18:34.606423] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-11-03T17:18:34.994523] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:35.093778] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T17:18:35.134848] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-11-03T17:18:35.780071] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-11-03T17:18:35.934855] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-11-03T17:18:36.498264] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T17:18:36.734910] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-11-03T17:18:37.168674] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T17:18:37.534928] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-11-03T17:18:38.113661] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T17:18:38.334851] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-11-03T17:18:38.818377] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T17:18:39.134883] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-11. [2025-11-03T17:18:39.599210] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T17:18:39.934894] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-11-03T17:18:40.185259] [DEBUG] [REMOTE ] ARE: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:18:40.185542] [WARN ] [REMOTE ] ARE: No data returned for month 2025-11 [2025-11-03T17:18:40.185629] [FATAL] [REMOTE ] ARE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:18:40.185748] [FATAL] [MAIN ] ARE: Failed to fetch primary data. [2025-11-03T17:18:40.185815] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:18:40.185885] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-11-03T17:18:40.185948] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-11-03T17:18:40.185983] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-11-03T17:18:40.186120] [DEBUG] [LOCAL ] ARE: Deleted derivative data file. [2025-11-03T17:18:40.186186] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 25.0s. Estimated remaining: 4h 49m 15s. Rate: 7.7 symbols/min [2025-11-03T17:18:40.352026] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:40.395606] [DEBUG] [LOCAL ] ARMK: Loaded 50977 existing records from primary storage. [2025-11-03T17:18:40.395921] [INFO ] [MAIN ] ARMK: Loaded 50977 existing records. [2025-11-03T17:18:40.578130] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:40.578328] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-11-03T17:18:40.578393] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-11-03T17:18:40.579185] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-11-03T17:18:40.579247] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-11-03T17:18:40.744198] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-11-03T17:18:40.953146] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:41.293253] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T17:18:41.534915] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-11-03T17:18:41.935019] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T17:18:42.334852] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-11-03T17:18:42.672361] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T17:18:43.134896] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-11-03T17:18:43.734301] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T17:18:43.934838] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-11-03T17:18:44.426511] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T17:18:44.734887] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-11-03T17:18:45.374896] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T17:18:45.534876] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-11-03T17:18:46.002631] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T17:18:46.334862] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-11-03T17:18:47.134827] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-11-03T17:18:47.175024] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T17:18:47.487889] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T17:18:47.934850] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-11. [2025-11-03T17:18:48.399915] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T17:18:48.734911] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-11-03T17:18:49.535089] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-11-03T17:18:49.824078] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T17:18:49.827100] [INFO ] [REMOTE ] ARES: Full fetch complete (72032 records). [2025-11-03T17:18:49.827384] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-11-03T17:18:50.150747] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T17:18:50.356730] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-11-03T17:18:50.431888] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-11-03T17:18:50.432005] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-11-03T17:18:50.432776] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-11-03T17:18:50.432840] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-11-03T17:18:50.434231] [DEBUG] [LOCAL ] ARES: Trimmed 72032 records to 49578 (keeping 200 days of data) [2025-11-03T17:18:50.762929] [DEBUG] [LOCAL ] ARES: Primary data saved (49578 records). [2025-11-03T17:18:50.763498] [INFO ] [MAIN ] ARES: Full history saved. [2025-11-03T17:18:50.764260] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARES took 30.8s. Estimated remaining: 4h 49m 50s. Rate: 7.7 symbols/min [2025-11-03T17:18:50.765325] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T17:18:50.944814] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:50.987505] [DEBUG] [LOCAL ] AROC: Loaded 49760 existing records from primary storage. [2025-11-03T17:18:50.987818] [INFO ] [MAIN ] AROC: Loaded 49760 existing records. [2025-11-03T17:18:51.137803] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-11-03T17:18:51.165284] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:51.165540] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-11-03T17:18:51.165586] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-11-03T17:18:51.166436] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-11-03T17:18:51.166498] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-11-03T17:18:51.524880] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:51.554261] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T17:18:51.934948] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-11-03T17:18:52.378157] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T17:18:52.734894] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-11-03T17:18:53.032676] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T17:18:53.534903] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-11-03T17:18:53.882180] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T17:18:54.334830] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-11-03T17:18:54.561611] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T17:18:55.134954] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-11-03T17:18:55.589008] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T17:18:55.934918] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-11. [2025-11-03T17:18:56.574238] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T17:18:56.729770] [DEBUG] [REMOTE ] ARI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:18:56.730104] [WARN ] [REMOTE ] ARI: No data returned for month 2025-11 [2025-11-03T17:18:56.730241] [FATAL] [REMOTE ] ARI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:18:56.730336] [FATAL] [MAIN ] ARI: Failed to fetch primary data. [2025-11-03T17:18:56.730400] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:18:56.730453] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-11-03T17:18:56.730572] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-11-03T17:18:56.730675] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-11-03T17:18:56.731443] [DEBUG] [LOCAL ] ARI: Deleted derivative data file. [2025-11-03T17:18:56.732201] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARI took 36.5s. Estimated remaining: 4h 49m 14s. Rate: 7.7 symbols/min [2025-11-03T17:18:56.743420] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-11-03T17:18:56.904209] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:18:56.952860] [DEBUG] [LOCAL ] ARR: Loaded 52795 existing records from primary storage. [2025-11-03T17:18:56.953152] [INFO ] [MAIN ] ARR: Loaded 52795 existing records. [2025-11-03T17:18:57.129029] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:18:57.129219] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-11-03T17:18:57.129265] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-11-03T17:18:57.130091] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-11-03T17:18:57.130148] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-11-03T17:18:57.501883] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:18:57.534814] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-11-03T17:18:58.046009] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T17:18:58.334897] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-11-03T17:18:59.114765] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T17:18:59.134834] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-11-03T17:18:59.550101] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:18:59.934895] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-11-03T17:19:00.222802] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T17:19:00.734867] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-11-03T17:19:01.168125] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:19:01.534895] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-11-03T17:19:02.166219] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T17:19:02.334863] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-11-03T17:19:02.747097] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T17:19:03.134851] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-11-03T17:19:03.573850] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T17:19:03.934874] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-11-03T17:19:04.583229] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-11-03T17:19:04.734841] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-11-03T17:19:05.325566] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:19:05.534867] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-11-03T17:19:06.080221] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:19:06.334845] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-11-03T17:19:07.094721] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T17:19:07.134826] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-11-03T17:19:07.722563] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T17:19:07.934833] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-11-03T17:19:08.353847] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T17:19:08.734837] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-11-03T17:19:09.443098] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T17:19:09.534819] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-11. [2025-11-03T17:19:09.942670] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T17:19:10.334867] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-11-03T17:19:11.134872] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-11-03T17:19:11.333254] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-11 (1.80 seconds). [2025-11-03T17:19:11.334782] [INFO ] [REMOTE ] ARMK: Full fetch complete (72945 records). [2025-11-03T17:19:11.334875] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-11-03T17:19:11.750264] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-11-03T17:19:11.750357] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-11-03T17:19:11.751139] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-11-03T17:19:11.751211] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-11-03T17:19:11.752787] [DEBUG] [LOCAL ] ARMK: Trimmed 72945 records to 50273 (keeping 200 days of data) [2025-11-03T17:19:11.936032] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-11-03T17:19:12.084967] [DEBUG] [LOCAL ] ARMK: Primary data saved (50273 records). [2025-11-03T17:19:12.095887] [INFO ] [MAIN ] ARMK: Full history saved. [2025-11-03T17:19:12.096216] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARMK took 31.9s. Estimated remaining: 4h 51m 1s. Rate: 7.6 symbols/min [2025-11-03T17:19:12.109277] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-11-03T17:19:12.288522] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:12.321728] [DEBUG] [LOCAL ] ARW: Loaded 33516 existing records from primary storage. [2025-11-03T17:19:12.322023] [INFO ] [MAIN ] ARW: Loaded 33516 existing records. [2025-11-03T17:19:12.502981] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:12.503265] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-11-03T17:19:12.503330] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-11-03T17:19:12.504009] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-11-03T17:19:12.504082] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-11-03T17:19:12.743967] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-11-03T17:19:12.759426] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-11-03T17:19:12.921149] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:13.405801] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-11-03T17:19:13.534888] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-11. [2025-11-03T17:19:14.140690] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T17:19:14.334839] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-11-03T17:19:14.428053] [DEBUG] [REMOTE ] ARLO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:19:14.428371] [WARN ] [REMOTE ] ARLO: No data returned for month 2025-11 [2025-11-03T17:19:14.428459] [FATAL] [REMOTE ] ARLO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:19:14.428558] [FATAL] [MAIN ] ARLO: Failed to fetch primary data. [2025-11-03T17:19:14.428638] [WARN ] [MAIN ] ARLO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:19:14.428751] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-11-03T17:19:14.428827] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-11-03T17:19:14.428876] [INFO ] [LOCAL ] ARLO: Starting deletion of derivative data. [2025-11-03T17:19:14.429096] [DEBUG] [LOCAL ] ARLO: Deleted derivative data file. [2025-11-03T17:19:14.429811] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARLO took 40.3s. Estimated remaining: 4h 49m 30s. Rate: 7.7 symbols/min [2025-11-03T17:19:14.604279] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:14.604488] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-11-03T17:19:14.604528] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-11-03T17:19:14.604662] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-11-03T17:19:14.604729] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-11-03T17:19:14.604811] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-11-03T17:19:14.604862] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-11-03T17:19:14.983208] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:15.134827] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-11-03T17:19:15.360975] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:19:15.361262] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-11-03T17:19:15.361347] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:19:15.361425] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-11-03T17:19:15.361491] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:19:15.361566] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-11-03T17:19:15.361630] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-11-03T17:19:15.361703] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-11-03T17:19:15.361755] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-11-03T17:19:15.361801] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. ARX took 0.9s. Estimated remaining: 4h 47m 38s. Rate: 7.7 symbols/min [2025-11-03T17:19:15.532477] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:15.582319] [DEBUG] [LOCAL ] AS: Loaded 53973 existing records from primary storage. [2025-11-03T17:19:15.582706] [INFO ] [MAIN ] AS: Loaded 53973 existing records. [2025-11-03T17:19:15.758400] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:15.759237] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-11-03T17:19:15.759341] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-11-03T17:19:15.776845] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-11-03T17:19:15.776924] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-11-03T17:19:15.853859] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T17:19:15.942847] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-11-03T17:19:16.140165] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:16.734899] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-11-03T17:19:17.086010] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:19:17.534860] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-11-03T17:19:18.110892] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:19:18.334856] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-11-03T17:19:18.540678] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T17:19:19.134908] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-11-03T17:19:19.640480] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T17:19:19.934899] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-11-03T17:19:20.575286] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-11-03T17:19:20.734860] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-11-03T17:19:20.875289] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-11-03T17:19:21.534863] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-11-03T17:19:22.009078] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T17:19:22.334912] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-11-03T17:19:23.104909] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T17:19:23.134852] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-11-03T17:19:23.617078] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T17:19:23.934868] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-11-03T17:19:24.582037] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-11-03T17:19:24.734864] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-11-03T17:19:25.534898] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-11-03T17:19:25.758536] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-11-03T17:19:25.875012] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:19:26.334876] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-11-03T17:19:26.669452] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T17:19:27.134891] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-11-03T17:19:27.794685] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T17:19:27.900815] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T17:19:27.934808] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-11-03T17:19:28.734883] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-11-03T17:19:29.033172] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-11-03T17:19:29.534899] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-11-03T17:19:30.334830] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-11. [2025-11-03T17:19:30.399745] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-11-03T17:19:31.123576] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T17:19:31.135352] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-11-03T17:19:31.934826] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-11-03T17:19:32.142735] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T17:19:32.734849] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-11-03T17:19:32.879830] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-11 (2.55 seconds). [2025-11-03T17:19:32.881284] [INFO ] [REMOTE ] AROC: Full fetch complete (71475 records). [2025-11-03T17:19:32.881399] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-11-03T17:19:33.295562] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-11-03T17:19:33.295688] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-11-03T17:19:33.296446] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-11-03T17:19:33.296509] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-11-03T17:19:33.298048] [DEBUG] [LOCAL ] AROC: Trimmed 71475 records to 49018 (keeping 200 days of data) [2025-11-03T17:19:33.535491] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-11. [2025-11-03T17:19:33.612948] [DEBUG] [LOCAL ] AROC: Primary data saved (49018 records). [2025-11-03T17:19:33.613097] [INFO ] [MAIN ] AROC: Full history saved. [2025-11-03T17:19:33.613881] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. AROC took 42.8s. Estimated remaining: 4h 50m 6s. Rate: 7.6 symbols/min [2025-11-03T17:19:33.823698] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:33.826982] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-11-03T17:19:33.853197] [DEBUG] [LOCAL ] ASA: Loaded 16149 existing records from primary storage. [2025-11-03T17:19:33.853448] [INFO ] [MAIN ] ASA: Loaded 16149 existing records. [2025-11-03T17:19:34.041893] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:34.042128] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-11-03T17:19:34.042179] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-11-03T17:19:34.042532] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-11-03T17:19:34.042592] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-11-03T17:19:34.342785] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-11-03T17:19:34.447961] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-11-03T17:19:34.453401] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:35.134945] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-11-03T17:19:35.821573] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T17:19:35.886394] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T17:19:35.934848] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-11-03T17:19:36.069142] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-11 (2.53 seconds). [2025-11-03T17:19:36.070798] [INFO ] [REMOTE ] ARR: Full fetch complete (75510 records). [2025-11-03T17:19:36.070939] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-11-03T17:19:36.466864] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-11-03T17:19:36.466939] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-11-03T17:19:36.467709] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-11-03T17:19:36.467770] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-11-03T17:19:36.469118] [DEBUG] [LOCAL ] ARR: Trimmed 75510 records to 52017 (keeping 200 days of data) [2025-11-03T17:19:36.740084] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-11-03T17:19:36.785433] [DEBUG] [LOCAL ] ARR: Primary data saved (52017 records). [2025-11-03T17:19:36.785580] [INFO ] [MAIN ] ARR: Full history saved. [2025-11-03T17:19:36.786152] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. ARR took 40.1s. Estimated remaining: 4h 48m 49s. Rate: 7.7 symbols/min [2025-11-03T17:19:36.973923] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:37.028190] [DEBUG] [LOCAL ] ASAN: Loaded 53470 existing records from primary storage. [2025-11-03T17:19:37.028563] [INFO ] [MAIN ] ASAN: Loaded 53470 existing records. [2025-11-03T17:19:37.209026] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:37.209425] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-11-03T17:19:37.209493] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-11-03T17:19:37.210293] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-11-03T17:19:37.210352] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-11-03T17:19:37.321353] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T17:19:37.427818] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T17:19:37.540039] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-11-03T17:19:37.626793] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:38.334845] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-11-03T17:19:38.865901] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T17:19:38.905623] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-11-03T17:19:39.134912] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-11-03T17:19:39.796581] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T17:19:39.934873] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-11. [2025-11-03T17:19:40.734895] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-11-03T17:19:41.347471] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T17:19:41.405591] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-11 (1.47 seconds). [2025-11-03T17:19:41.407099] [INFO ] [REMOTE ] ARW: Full fetch complete (48980 records). [2025-11-03T17:19:41.407192] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-11-03T17:19:41.540069] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-11-03T17:19:41.905314] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-11-03T17:19:41.905428] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-11-03T17:19:41.906372] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-11-03T17:19:41.906453] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-11-03T17:19:41.907883] [DEBUG] [LOCAL ] ARW: Trimmed 48980 records to 33027 (keeping 200 days of data) [2025-11-03T17:19:42.210445] [DEBUG] [LOCAL ] ARW: Primary data saved (33027 records). [2025-11-03T17:19:42.210717] [INFO ] [MAIN ] ARW: Full history saved. [2025-11-03T17:19:42.210910] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ARW took 30.1s. Estimated remaining: 4h 48m 6s. Rate: 7.7 symbols/min [2025-11-03T17:19:42.342632] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-11-03T17:19:42.342529] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T17:19:42.463990] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:42.515776] [DEBUG] [LOCAL ] ASB: Loaded 50417 existing records from primary storage. [2025-11-03T17:19:42.516146] [INFO ] [MAIN ] ASB: Loaded 50417 existing records. [2025-11-03T17:19:42.716383] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:42.716604] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-11-03T17:19:42.716681] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-11-03T17:19:42.717525] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-11-03T17:19:42.717583] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-11-03T17:19:43.077209] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:43.134863] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-11-03T17:19:43.934840] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-11-03T17:19:43.968461] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-11-03T17:19:44.343030] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T17:19:44.569051] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-11-03T17:19:44.734870] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-11-03T17:19:45.534908] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-11-03T17:19:46.340020] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-11-03T17:19:46.360170] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-11-03T17:19:46.668681] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T17:19:47.134837] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-11-03T17:19:47.163934] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-11-03T17:19:47.934857] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-11-03T17:19:48.525867] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T17:19:48.734872] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-11-03T17:19:49.326694] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T17:19:49.534891] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-11-03T17:19:50.198934] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T17:19:50.334838] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-11-03T17:19:50.404727] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T17:19:51.134890] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-11-03T17:19:51.682035] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:19:51.934866] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-11-03T17:19:52.019233] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T17:19:52.734862] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-11. [2025-11-03T17:19:53.328158] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T17:19:53.534875] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-11. [2025-11-03T17:19:53.879602] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T17:19:53.880790] [INFO ] [REMOTE ] ASA: Full fetch complete (21230 records). [2025-11-03T17:19:53.880866] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-11-03T17:19:54.287935] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-11-03T17:19:54.288017] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-11-03T17:19:54.288332] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-11-03T17:19:54.288371] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-11-03T17:19:54.289036] [DEBUG] [LOCAL ] ASA: Trimmed 21230 records to 15954 (keeping 200 days of data) [2025-11-03T17:19:54.354056] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-11-03T17:19:54.382021] [DEBUG] [LOCAL ] ASA: Primary data saved (15954 records). [2025-11-03T17:19:54.382279] [INFO ] [MAIN ] ASA: Full history saved. [2025-11-03T17:19:54.382368] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. ASA took 20.8s. Estimated remaining: 4h 49m 2s. Rate: 7.7 symbols/min [2025-11-03T17:19:54.552285] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:54.557017] [DEBUG] [LOCAL ] ASBA: Loaded 3535 existing records from primary storage. [2025-11-03T17:19:54.557174] [INFO ] [MAIN ] ASBA: Loaded 3535 existing records. [2025-11-03T17:19:54.731689] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:54.731908] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-11-03T17:19:54.731958] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-11-03T17:19:54.732145] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-11-03T17:19:54.732200] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-11-03T17:19:55.135485] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:55.135620] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-11-03T17:19:55.453289] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-11 (1.92 seconds). [2025-11-03T17:19:55.454870] [INFO ] [REMOTE ] AS: Full fetch complete (76977 records). [2025-11-03T17:19:55.454979] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-11-03T17:19:55.856954] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-11-03T17:19:55.857240] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-11-03T17:19:55.858518] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-11-03T17:19:55.858769] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-11-03T17:19:55.888224] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-11-03T17:19:55.898205] [DEBUG] [LOCAL ] AS: Trimmed 76977 records to 53208 (keeping 200 days of data) [2025-11-03T17:19:55.964344] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-11-03T17:19:56.225898] [DEBUG] [LOCAL ] AS: Primary data saved (53208 records). [2025-11-03T17:19:56.226071] [INFO ] [MAIN ] AS: Full history saved. [2025-11-03T17:19:56.226822] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. AS took 40.9s. Estimated remaining: 4h 47m 28s. Rate: 7.7 symbols/min [2025-11-03T17:19:56.437710] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:19:56.445932] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T17:19:56.446968] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T17:19:56.492837] [DEBUG] [LOCAL ] ASC: Loaded 37397 existing records from primary storage. [2025-11-03T17:19:56.493153] [INFO ] [MAIN ] ASC: Loaded 37397 existing records. [2025-11-03T17:19:56.665091] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:19:56.665329] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-11-03T17:19:56.665419] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-11-03T17:19:56.666079] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-11-03T17:19:56.666137] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-11-03T17:19:56.739961] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-11-03T17:19:57.024238] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:19:57.534852] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-11-03T17:19:57.960153] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T17:19:58.334886] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-11-03T17:19:58.883371] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:19:59.134877] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-11-03T17:19:59.630859] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T17:19:59.934902] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-11-03T17:20:00.370498] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T17:20:00.374215] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T17:20:00.734826] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-11-03T17:20:01.199343] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-11-03T17:20:01.534875] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-11-03T17:20:02.334898] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-11-03T17:20:03.134901] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-11-03T17:20:03.135918] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-11-03T17:20:03.688117] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:20:03.934918] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-11-03T17:20:04.180766] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T17:20:04.734878] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-11-03T17:20:05.278567] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T17:20:05.534828] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-11-03T17:20:06.187322] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T17:20:06.334846] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-11-03T17:20:06.641050] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T17:20:07.134887] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-11-03T17:20:07.811465] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T17:20:07.934819] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-11-03T17:20:08.439962] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T17:20:08.734846] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-11-03T17:20:09.278696] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T17:20:09.424543] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T17:20:09.534833] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-11-03T17:20:10.334856] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-11-03T17:20:10.865537] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T17:20:11.134856] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-11-03T17:20:11.699169] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T17:20:11.934877] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-11-03T17:20:12.734840] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-11. [2025-11-03T17:20:12.937815] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-11-03T17:20:13.410628] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T17:20:13.534844] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-11-03T17:20:14.334856] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-11-03T17:20:14.722669] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-11-03T17:20:15.134904] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-11-03T17:20:15.452363] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-11-03T17:20:15.495982] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T17:20:15.934901] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-11-03T17:20:16.328378] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T17:20:16.678178] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-11 (3.94 seconds). [2025-11-03T17:20:16.679684] [INFO ] [REMOTE ] ASB: Full fetch complete (72419 records). [2025-11-03T17:20:16.679816] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-11-03T17:20:16.740182] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-11-03T17:20:17.081911] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-11-03T17:20:17.082003] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-11-03T17:20:17.082736] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-11-03T17:20:17.082799] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-11-03T17:20:17.084170] [DEBUG] [LOCAL ] ASB: Trimmed 72419 records to 49668 (keeping 200 days of data) [2025-11-03T17:20:17.370209] [DEBUG] [LOCAL ] ASB: Primary data saved (49668 records). [2025-11-03T17:20:17.370333] [INFO ] [MAIN ] ASB: Full history saved. [2025-11-03T17:20:17.370411] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASB took 35.2s. Estimated remaining: 4h 50m 32s. Rate: 7.6 symbols/min [2025-11-03T17:20:17.559701] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-11-03T17:20:17.564958] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:17.589274] [DEBUG] [LOCAL ] ASG: Loaded 19290 existing records from primary storage. [2025-11-03T17:20:17.589591] [INFO ] [MAIN ] ASG: Loaded 19290 existing records. [2025-11-03T17:20:17.780373] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:20:17.780730] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-11-03T17:20:17.780815] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-11-03T17:20:17.781303] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-11-03T17:20:17.781366] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-11-03T17:20:18.059931] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T17:20:18.148907] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T17:20:18.187612] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:18.334818] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-11-03T17:20:19.134868] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-11-03T17:20:19.369809] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T17:20:19.934860] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-11. [2025-11-03T17:20:20.242767] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:20:20.734859] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-11-03T17:20:21.204598] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T17:20:21.534846] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-11-03T17:20:22.192748] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T17:20:22.194489] [INFO ] [REMOTE ] ASAN: Full fetch complete (76609 records). [2025-11-03T17:20:22.194595] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-11-03T17:20:22.339933] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-11-03T17:20:22.614713] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-11-03T17:20:22.614912] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-11-03T17:20:22.615757] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-11-03T17:20:22.615834] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-11-03T17:20:22.637769] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T17:20:22.636552] [DEBUG] [LOCAL ] ASAN: Trimmed 76609 records to 52708 (keeping 200 days of data) [2025-11-03T17:20:22.749417] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-11-03T17:20:22.954703] [DEBUG] [LOCAL ] ASAN: Primary data saved (52708 records). [2025-11-03T17:20:22.954840] [INFO ] [MAIN ] ASAN: Full history saved. [2025-11-03T17:20:22.954935] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASAN took 46.2s. Estimated remaining: 4h 49m 51s. Rate: 7.6 symbols/min [2025-11-03T17:20:23.130755] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:23.134894] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-11-03T17:20:23.152155] [DEBUG] [LOCAL ] ASGI: Loaded 22971 existing records from primary storage. [2025-11-03T17:20:23.152462] [INFO ] [MAIN ] ASGI: Loaded 22971 existing records. [2025-11-03T17:20:23.327333] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:20:23.327527] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-11-03T17:20:23.327576] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-11-03T17:20:23.328051] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-11-03T17:20:23.328108] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-11-03T17:20:23.675195] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:23.934829] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-11-03T17:20:24.331675] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T17:20:24.724757] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T17:20:24.734812] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-11-03T17:20:25.448793] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T17:20:25.534837] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-11-03T17:20:26.334812] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-11. [2025-11-03T17:20:26.553097] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T17:20:26.791842] [DEBUG] [REMOTE ] ASBA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:20:26.792146] [WARN ] [REMOTE ] ASBA: No data returned for month 2025-11 [2025-11-03T17:20:26.792236] [FATAL] [REMOTE ] ASBA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:20:26.792311] [FATAL] [MAIN ] ASBA: Failed to fetch primary data. [2025-11-03T17:20:26.792347] [WARN ] [MAIN ] ASBA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:20:26.792387] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-11-03T17:20:26.792441] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-11-03T17:20:26.792477] [INFO ] [LOCAL ] ASBA: Starting deletion of derivative data. [2025-11-03T17:20:26.792637] [DEBUG] [LOCAL ] ASBA: Deleted derivative data file. [2025-11-03T17:20:26.792751] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASBA took 32.4s. Estimated remaining: 4h 48m 46s. Rate: 7.7 symbols/min [2025-11-03T17:20:26.984941] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:26.985148] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-11-03T17:20:26.985188] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-11-03T17:20:26.985302] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-11-03T17:20:26.985344] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-11-03T17:20:26.985387] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-11-03T17:20:26.985419] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-11-03T17:20:27.141399] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-11. [2025-11-03T17:20:27.361422] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:27.934835] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-11-03T17:20:28.597430] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T17:20:28.599103] [INFO ] [REMOTE ] ASC: Full fetch complete (55553 records). [2025-11-03T17:20:28.599268] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-11-03T17:20:28.740048] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-11-03T17:20:29.046576] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T17:20:29.166214] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-11-03T17:20:29.166312] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-11-03T17:20:29.167225] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-11-03T17:20:29.167335] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-11-03T17:20:29.169021] [DEBUG] [LOCAL ] ASC: Trimmed 55553 records to 36778 (keeping 200 days of data) [2025-11-03T17:20:29.469474] [DEBUG] [LOCAL ] ASC: Primary data saved (36778 records). [2025-11-03T17:20:29.469771] [INFO ] [MAIN ] ASC: Full history saved. [2025-11-03T17:20:29.471030] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASC took 33.2s. Estimated remaining: 4h 47m 26s. Rate: 7.7 symbols/min [2025-11-03T17:20:29.512469] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T17:20:29.534900] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-11-03T17:20:30.334933] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-11-03T17:20:30.802295] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:20:31.094387] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T17:20:31.134807] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-11-03T17:20:31.934832] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-11-03T17:20:32.033817] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-11-03T17:20:32.605870] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T17:20:32.734913] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-11-03T17:20:33.432078] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T17:20:33.534819] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-11-03T17:20:34.275238] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T17:20:34.334809] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-11-03T17:20:35.134914] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-11-03T17:20:35.266680] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T17:20:35.934890] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-11-03T17:20:36.203109] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T17:20:36.672013] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T17:20:36.734832] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-11-03T17:20:37.534914] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-11-03T17:20:37.786256] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T17:20:38.236864] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T17:20:38.334850] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-11-03T17:20:39.085525] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T17:20:39.134910] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-11-03T17:20:39.829997] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T17:20:39.934835] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-11-03T17:20:40.591095] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T17:20:40.734897] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-11-03T17:20:41.534956] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-11-03T17:20:41.648974] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T17:20:42.334946] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-11. [2025-11-03T17:20:42.425326] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T17:20:42.906445] [DEBUG] [REMOTE ] ASG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:20:42.906777] [WARN ] [REMOTE ] ASG: No data returned for month 2025-11 [2025-11-03T17:20:42.906866] [FATAL] [REMOTE ] ASG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:20:42.906996] [FATAL] [MAIN ] ASG: Failed to fetch primary data. [2025-11-03T17:20:42.907068] [WARN ] [MAIN ] ASG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:20:42.907139] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-11-03T17:20:42.907216] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-11-03T17:20:42.907284] [INFO ] [LOCAL ] ASG: Starting deletion of derivative data. [2025-11-03T17:20:42.907427] [DEBUG] [LOCAL ] ASG: Deleted derivative data file. [2025-11-03T17:20:42.907497] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASG took 25.5s. Estimated remaining: 4h 48m 37s. Rate: 7.7 symbols/min [2025-11-03T17:20:43.134898] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-11-03T17:20:43.934916] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-11-03T17:20:44.195589] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:20:44.745010] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-11-03T17:20:44.746187] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T17:20:45.534881] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-11. [2025-11-03T17:20:45.963168] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T17:20:46.238865] [DEBUG] [REMOTE ] ASGI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:20:46.239174] [WARN ] [REMOTE ] ASGI: No data returned for month 2025-11 [2025-11-03T17:20:46.239260] [FATAL] [REMOTE ] ASGI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:20:46.239361] [FATAL] [MAIN ] ASGI: Failed to fetch primary data. [2025-11-03T17:20:46.239429] [WARN ] [MAIN ] ASGI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:20:46.239500] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-11-03T17:20:46.239564] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-11-03T17:20:46.239602] [INFO ] [LOCAL ] ASGI: Starting deletion of derivative data. [2025-11-03T17:20:46.239794] [DEBUG] [LOCAL ] ASGI: Deleted derivative data file. [2025-11-03T17:20:46.239877] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASGI took 23.3s. Estimated remaining: 4h 47m 26s. Rate: 7.7 symbols/min [2025-11-03T17:20:46.334889] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-11-03T17:20:47.412075] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T17:20:47.419398] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-11-03T17:20:48.377762] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T17:20:48.384586] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-11-03T17:20:49.402436] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T17:20:49.411265] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-11-03T17:20:50.481276] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T17:20:50.489604] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-11-03T17:20:51.566777] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T17:20:51.576993] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-11-03T17:20:52.729437] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T17:20:52.741010] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-11. [2025-11-03T17:20:53.627827] [DEBUG] [REMOTE ] ASGN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:20:53.628128] [WARN ] [REMOTE ] ASGN: No data returned for month 2025-11 [2025-11-03T17:20:53.628238] [FATAL] [REMOTE ] ASGN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:20:53.628330] [FATAL] [MAIN ] ASGN: Failed to fetch primary data. [2025-11-03T17:20:53.628381] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:20:53.628430] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-11-03T17:20:53.628502] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-11-03T17:20:53.628541] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-11-03T17:20:53.628580] [DEBUG] [LOCAL ] ASGN: No derivative data file found to delete. [2025-11-03T17:20:53.628627] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASGN took 26.8s. Estimated remaining: 4h 47m 12s. Rate: 7.7 symbols/min [2025-11-03T17:20:54.302378] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:54.339491] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:54.442587] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:54.439165] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:20:54.443181] [DEBUG] [LOCAL ] ASR: No existing data file found in primary storage. [2025-11-03T17:20:54.443243] [WARN ] [MAIN ] ASR: No existing data found, performing full refresh instead. [2025-11-03T17:20:54.443338] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-11-03T17:20:54.443386] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-11-03T17:20:54.443079] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-11-03T17:20:54.443614] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-11-03T17:20:54.443706] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-11-03T17:20:54.443527] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-11-03T17:20:54.488704] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-11-03T17:20:54.517484] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-11-03T17:20:54.568330] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-11-03T17:20:54.581585] [DEBUG] [LOCAL ] ASIX: Loaded 23138 existing records from primary storage. [2025-11-03T17:20:54.580786] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-11-03T17:20:54.598236] [INFO ] [MAIN ] ASIX: Loaded 23138 existing records. [2025-11-03T17:20:54.804596] [DEBUG] [LOCAL ] ASPN: Loaded 50465 existing records from primary storage. [2025-11-03T17:20:54.904255] [INFO ] [MAIN ] ASPN: Loaded 50465 existing records. [2025-11-03T17:20:55.268362] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:20:55.346876] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:55.361320] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-11-03T17:20:55.375796] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-11-03T17:20:55.416693] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-11-03T17:20:55.455485] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-11-03T17:20:55.482264] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-11-03T17:20:55.562208] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:20:55.581979] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-11-03T17:20:55.587217] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-11-03T17:20:55.640827] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-11-03T17:20:55.730373] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-11-03T17:20:55.752323] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:55.802237] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-11-03T17:20:56.240478] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:56.268289] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T17:20:56.308408] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-11-03T17:20:56.297725] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-11-03T17:20:56.400896] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:20:56.401244] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-11-03T17:20:56.844905] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-11-03T17:20:56.847109] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-11-03T17:20:57.116552] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T17:20:57.122634] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-11-03T17:20:57.149166] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T17:20:57.479449] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-11-03T17:20:57.534881] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-11-03T17:20:57.716940] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:20:57.735589] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T17:20:58.126163] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T17:20:58.334848] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-11-03T17:20:59.134869] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-11-03T17:20:59.475533] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:20:59.606270] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T17:20:59.934835] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-11-03T17:21:00.734819] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-11-03T17:21:00.875544] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T17:21:01.534903] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-11-03T17:21:01.870555] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:21:02.084933] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-11-03T17:21:02.334887] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-11-03T17:21:03.134863] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-11-03T17:21:03.191483] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-11-03T17:21:03.934875] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-11-03T17:21:04.263159] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T17:21:04.462542] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-11-03T17:21:04.734905] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-11-03T17:21:05.509718] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T17:21:05.534822] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-11-03T17:21:06.222792] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-11-03T17:21:06.334885] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-11-03T17:21:07.134836] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-11-03T17:21:07.671782] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T17:21:07.934909] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-11-03T17:21:08.308808] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T17:21:08.539342] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T17:21:08.734879] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-11-03T17:21:09.306440] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T17:21:09.534845] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-11-03T17:21:10.334859] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-11-03T17:21:10.852326] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T17:21:11.134835] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-11-03T17:21:11.170292] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-11-03T17:21:11.894267] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:21:11.934974] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-11-03T17:21:12.734889] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-11-03T17:21:13.034937] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T17:21:13.534858] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-11-03T17:21:13.704027] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T17:21:14.334924] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-11-03T17:21:14.940970] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T17:21:15.134851] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-11-03T17:21:15.479036] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T17:21:15.934914] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-11-03T17:21:16.446002] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T17:21:16.733573] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-11-03T17:21:16.738133] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-11-03T17:21:17.534920] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-11-03T17:21:17.800760] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T17:21:18.039703] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-11-03T17:21:18.334847] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-11. [2025-11-03T17:21:18.953327] [DEBUG] [REMOTE ] ASR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:21:18.953799] [WARN ] [REMOTE ] ASR: No data returned for month 2025-11 [2025-11-03T17:21:18.953900] [FATAL] [REMOTE ] ASR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:21:18.953999] [FATAL] [MAIN ] ASR: Failed to fetch primary data. [2025-11-03T17:21:18.954040] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:21:18.954126] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-11-03T17:21:18.954201] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-11-03T17:21:18.954241] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-11-03T17:21:18.954282] [DEBUG] [LOCAL ] ASR: No derivative data file found to delete. [2025-11-03T17:21:18.954336] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASR took 25.3s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-11-03T17:21:19.131228] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:21:19.134913] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-11-03T17:21:19.180979] [DEBUG] [LOCAL ] ASX: Loaded 53631 existing records from primary storage. [2025-11-03T17:21:19.181321] [INFO ] [MAIN ] ASX: Loaded 53631 existing records. [2025-11-03T17:21:19.363789] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:21:19.364062] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-11-03T17:21:19.364121] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-11-03T17:21:19.365079] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-11-03T17:21:19.365137] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-11-03T17:21:19.734116] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:21:19.934893] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-11-03T17:21:20.002194] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T17:21:20.734897] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-11. [2025-11-03T17:21:21.405035] [DEBUG] [REMOTE ] ASIX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:21:21.405338] [WARN ] [REMOTE ] ASIX: No data returned for month 2025-11 [2025-11-03T17:21:21.405439] [FATAL] [REMOTE ] ASIX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:21:21.405714] [FATAL] [MAIN ] ASIX: Failed to fetch primary data. [2025-11-03T17:21:21.405902] [WARN ] [MAIN ] ASIX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:21:21.406073] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-11-03T17:21:21.406147] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-11-03T17:21:21.421749] [INFO ] [LOCAL ] ASIX: Starting deletion of derivative data. [2025-11-03T17:21:21.432336] [DEBUG] [LOCAL ] ASIX: Deleted derivative data file. [2025-11-03T17:21:21.432879] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASIX took 27.8s. Estimated remaining: 4h 49m 43s. Rate: 7.6 symbols/min [2025-11-03T17:21:21.433885] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-11-03T17:21:21.541396] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-11-03T17:21:21.614726] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:21:21.648395] [DEBUG] [LOCAL ] ATEN: Loaded 37628 existing records from primary storage. [2025-11-03T17:21:21.648728] [INFO ] [MAIN ] ATEN: Loaded 37628 existing records. [2025-11-03T17:21:21.831624] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:21:21.831864] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-11-03T17:21:21.831914] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-11-03T17:21:21.832782] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-11-03T17:21:21.832841] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-11-03T17:21:22.202960] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:21:22.334836] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-11-03T17:21:23.134854] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-11-03T17:21:23.401180] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T17:21:23.441916] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-11-03T17:21:23.934830] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-11-03T17:21:24.128674] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:21:24.734861] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-11-03T17:21:25.033135] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-11-03T17:21:25.534876] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-11-03T17:21:26.177600] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T17:21:26.334828] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-11-03T17:21:26.642136] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T17:21:27.134832] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-11-03T17:21:27.468960] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T17:21:27.934844] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-11-03T17:21:28.327159] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:21:28.734864] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-11. [2025-11-03T17:21:29.371038] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T17:21:29.520115] [DEBUG] [REMOTE ] ASH: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:21:29.520464] [WARN ] [REMOTE ] ASH: No data returned for month 2025-11 [2025-11-03T17:21:29.520567] [FATAL] [REMOTE ] ASH: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:21:29.520705] [FATAL] [MAIN ] ASH: Failed to fetch primary data. [2025-11-03T17:21:29.520789] [WARN ] [MAIN ] ASH: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:21:29.520875] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-11-03T17:21:29.520974] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-11-03T17:21:29.521029] [INFO ] [LOCAL ] ASH: Starting deletion of derivative data. [2025-11-03T17:21:29.521097] [DEBUG] [LOCAL ] ASH: No derivative data file found to delete. [2025-11-03T17:21:29.521183] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASH took 35.9s. Estimated remaining: 4h 49m 37s. Rate: 7.6 symbols/min [2025-11-03T17:21:29.543560] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-11-03T17:21:29.692372] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:21:29.722186] [DEBUG] [LOCAL ] ATGE: Loaded 30394 existing records from primary storage. [2025-11-03T17:21:29.722438] [INFO ] [MAIN ] ATGE: Loaded 30394 existing records. [2025-11-03T17:21:29.898160] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:21:29.898387] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-11-03T17:21:29.898454] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-11-03T17:21:29.899010] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-11-03T17:21:29.899068] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-11-03T17:21:30.255572] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:21:30.334839] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-11. [2025-11-03T17:21:31.134841] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-11-03T17:21:31.308105] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-11-03T17:21:31.934853] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-11-03T17:21:32.231984] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T17:21:32.438134] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-11 (2.10 seconds). [2025-11-03T17:21:32.439710] [INFO ] [REMOTE ] ASPN: Full fetch complete (72591 records). [2025-11-03T17:21:32.439836] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-11-03T17:21:32.744534] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-11-03T17:21:32.851981] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-11-03T17:21:32.852054] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-11-03T17:21:32.852771] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-11-03T17:21:32.852832] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-11-03T17:21:32.854119] [DEBUG] [LOCAL ] ASPN: Trimmed 72591 records to 49745 (keeping 200 days of data) [2025-11-03T17:21:33.130860] [DEBUG] [LOCAL ] ASPN: Primary data saved (49745 records). [2025-11-03T17:21:33.130975] [INFO ] [MAIN ] ASPN: Full history saved. [2025-11-03T17:21:33.131076] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASPN took 39.5s. Estimated remaining: 4h 48m 32s. Rate: 7.6 symbols/min [2025-11-03T17:21:33.319801] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:21:33.347998] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-11-03T17:21:33.379982] [DEBUG] [LOCAL ] ATHM: Loaded 30988 existing records from primary storage. [2025-11-03T17:21:33.380246] [INFO ] [MAIN ] ATHM: Loaded 30988 existing records. [2025-11-03T17:21:33.534937] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-11-03T17:21:33.559866] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:21:33.560098] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-11-03T17:21:33.560153] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-11-03T17:21:33.560713] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-11-03T17:21:33.560773] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-11-03T17:21:33.954365] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:21:33.955776] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T17:21:34.334843] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-11-03T17:21:34.686879] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T17:21:35.134905] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-11-03T17:21:35.559346] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T17:21:35.934877] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-11-03T17:21:36.216481] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T17:21:36.734897] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-11-03T17:21:36.981888] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T17:21:37.534926] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-11-03T17:21:37.853561] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T17:21:38.334897] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-11-03T17:21:38.608073] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T17:21:39.134901] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-11-03T17:21:39.669676] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T17:21:39.934899] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-11-03T17:21:40.239272] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T17:21:40.734833] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-11-03T17:21:40.968189] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T17:21:41.534860] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-11-03T17:21:41.635860] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T17:21:42.334869] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-11-03T17:21:42.768273] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T17:21:43.134868] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-11-03T17:21:43.892205] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T17:21:43.934844] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-11-03T17:21:44.155109] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T17:21:44.734863] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-11-03T17:21:45.174557] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T17:21:45.515324] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-11-03T17:21:45.534816] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-11-03T17:21:46.334912] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-11-03T17:21:46.437277] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-11-03T17:21:47.134869] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-11-03T17:21:47.635345] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:21:47.934881] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-11-03T17:21:48.023491] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T17:21:48.734901] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-11-03T17:21:49.182859] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T17:21:49.534874] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-11-03T17:21:49.736146] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T17:21:50.334886] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-11-03T17:21:50.793162] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T17:21:51.134824] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-11. [2025-11-03T17:21:51.316979] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-11-03T17:21:51.934850] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-11-03T17:21:52.478244] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-11 (1.34 seconds). [2025-11-03T17:21:52.479499] [INFO ] [REMOTE ] ATGE: Full fetch complete (45624 records). [2025-11-03T17:21:52.479571] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-11-03T17:21:52.740835] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-11-03T17:21:52.858151] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-11-03T17:21:52.858241] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-11-03T17:21:52.858848] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-11-03T17:21:52.858913] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-11-03T17:21:52.859846] [DEBUG] [LOCAL ] ATGE: Trimmed 45624 records to 29912 (keeping 200 days of data) [2025-11-03T17:21:53.040454] [DEBUG] [LOCAL ] ATGE: Primary data saved (29912 records). [2025-11-03T17:21:53.040675] [INFO ] [MAIN ] ATGE: Full history saved. [2025-11-03T17:21:53.040780] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ATGE took 23.5s. Estimated remaining: 4h 51m 5s. Rate: 7.6 symbols/min [2025-11-03T17:21:53.231277] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:21:53.228860] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T17:21:53.245454] [DEBUG] [LOCAL ] ATHS: Loaded 6366 existing records from primary storage. [2025-11-03T17:21:53.245702] [INFO ] [MAIN ] ATHS: Loaded 6366 existing records. [2025-11-03T17:21:53.445693] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:21:53.445909] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-11-03T17:21:53.445956] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-11-03T17:21:53.446163] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-11-03T17:21:53.446202] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-11-03T17:21:53.542800] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-11-03T17:21:53.829223] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:21:53.846895] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T17:21:54.334887] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-11-03T17:21:55.044918] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T17:21:55.134820] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-11-03T17:21:55.194963] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T17:21:55.934859] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-11-03T17:21:56.395339] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T17:21:56.442986] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T17:21:56.734856] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-11-03T17:21:57.534936] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-11-03T17:21:58.098807] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T17:21:58.334866] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-11. [2025-11-03T17:21:58.591777] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T17:21:59.134858] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-11-03T17:21:59.244055] [DEBUG] [REMOTE ] ATEN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:21:59.244375] [WARN ] [REMOTE ] ATEN: No data returned for month 2025-11 [2025-11-03T17:21:59.244465] [FATAL] [REMOTE ] ATEN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:21:59.244549] [FATAL] [MAIN ] ATEN: Failed to fetch primary data. [2025-11-03T17:21:59.244611] [WARN ] [MAIN ] ATEN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:21:59.244725] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-11-03T17:21:59.244813] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-11-03T17:21:59.244856] [INFO ] [LOCAL ] ATEN: Starting deletion of derivative data. [2025-11-03T17:21:59.245032] [DEBUG] [LOCAL ] ATEN: Deleted derivative data file. [2025-11-03T17:21:59.245143] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATEN took 37.8s. Estimated remaining: 4h 50m 34s. Rate: 7.6 symbols/min [2025-11-03T17:21:59.431278] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:21:59.475960] [DEBUG] [LOCAL ] ATI: Loaded 52009 existing records from primary storage. [2025-11-03T17:21:59.476288] [INFO ] [MAIN ] ATI: Loaded 52009 existing records. [2025-11-03T17:21:59.648576] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:21:59.648781] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-11-03T17:21:59.648829] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-11-03T17:21:59.649585] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-11-03T17:21:59.649667] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-11-03T17:21:59.935111] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-11-03T17:22:00.003809] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:00.020033] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T17:22:00.734871] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-11-03T17:22:01.503661] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T17:22:01.534829] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-11-03T17:22:01.931689] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T17:22:02.039704] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T17:22:02.334884] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-11. [2025-11-03T17:22:03.134852] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-11-03T17:22:03.934909] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-11-03T17:22:04.436216] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:22:04.734895] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-11-03T17:22:04.887697] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-11-03T17:22:04.993802] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-11 (2.66 seconds). [2025-11-03T17:22:04.995362] [INFO ] [REMOTE ] ASX: Full fetch complete (76794 records). [2025-11-03T17:22:04.995491] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-11-03T17:22:05.316726] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T17:22:05.413054] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-11-03T17:22:05.413135] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-11-03T17:22:05.413882] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-11-03T17:22:05.413945] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-11-03T17:22:05.415320] [DEBUG] [LOCAL ] ASX: Trimmed 76794 records to 52847 (keeping 200 days of data) [2025-11-03T17:22:05.534949] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-11. [2025-11-03T17:22:05.724167] [DEBUG] [LOCAL ] ASX: Primary data saved (52847 records). [2025-11-03T17:22:05.724296] [INFO ] [MAIN ] ASX: Full history saved. [2025-11-03T17:22:05.725170] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ASX took 46.8s. Estimated remaining: 4h 50m 7s. Rate: 7.6 symbols/min [2025-11-03T17:22:05.898312] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:05.931064] [DEBUG] [LOCAL ] ATKR: Loaded 34723 existing records from primary storage. [2025-11-03T17:22:05.931335] [INFO ] [MAIN ] ATKR: Loaded 34723 existing records. [2025-11-03T17:22:06.112557] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:22:06.112811] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-11-03T17:22:06.112889] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-11-03T17:22:06.113586] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-11-03T17:22:06.113704] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-11-03T17:22:06.339972] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-11-03T17:22:06.480140] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:07.036296] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-11 (1.50 seconds). [2025-11-03T17:22:07.037634] [INFO ] [REMOTE ] ATHM: Full fetch complete (48738 records). [2025-11-03T17:22:07.037768] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-11-03T17:22:07.144517] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-11-03T17:22:07.496868] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-11-03T17:22:07.497057] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-11-03T17:22:07.497750] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-11-03T17:22:07.497815] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-11-03T17:22:07.498906] [DEBUG] [LOCAL ] ATHM: Trimmed 48738 records to 30148 (keeping 200 days of data) [2025-11-03T17:22:07.739797] [DEBUG] [LOCAL ] ATHM: Primary data saved (30148 records). [2025-11-03T17:22:07.740067] [INFO ] [MAIN ] ATHM: Full history saved. [2025-11-03T17:22:07.740293] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHM took 34.6s. Estimated remaining: 4h 48m 42s. Rate: 7.6 symbols/min [2025-11-03T17:22:07.746987] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:22:07.916849] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T17:22:07.940119] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-11-03T17:22:07.979037] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:08.013033] [DEBUG] [LOCAL ] ATMU: Loaded 38639 existing records from primary storage. [2025-11-03T17:22:08.013330] [INFO ] [MAIN ] ATMU: Loaded 38639 existing records. [2025-11-03T17:22:08.200636] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:22:08.200869] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-11-03T17:22:08.200917] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-11-03T17:22:08.201597] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-11-03T17:22:08.201694] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-11-03T17:22:08.518931] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T17:22:08.612198] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:08.734884] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-11-03T17:22:09.534856] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-11-03T17:22:09.871942] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T17:22:10.334900] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-11-03T17:22:10.850321] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:22:10.863091] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T17:22:11.134879] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-11-03T17:22:11.656852] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-11-03T17:22:11.934862] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-11-03T17:22:12.331763] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T17:22:12.734846] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-11-03T17:22:13.241372] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T17:22:13.534891] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-11-03T17:22:13.950405] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T17:22:14.334868] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-11. [2025-11-03T17:22:14.975016] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T17:22:14.975860] [INFO ] [REMOTE ] ATHS: Full fetch complete (9551 records). [2025-11-03T17:22:14.975931] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-11-03T17:22:15.138165] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-11-03T17:22:15.345313] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-11-03T17:22:15.345416] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-11-03T17:22:15.345674] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-11-03T17:22:15.345735] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-11-03T17:22:15.346136] [DEBUG] [LOCAL ] ATHS: Trimmed 9551 records to 6318 (keeping 200 days of data) [2025-11-03T17:22:15.382661] [DEBUG] [LOCAL ] ATHS: Primary data saved (6318 records). [2025-11-03T17:22:15.382767] [INFO ] [MAIN ] ATHS: Full history saved. [2025-11-03T17:22:15.382849] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHS took 22.3s. Estimated remaining: 4h 48m 31s. Rate: 7.6 symbols/min [2025-11-03T17:22:15.548701] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:15.585806] [DEBUG] [LOCAL ] ATO: Loaded 41804 existing records from primary storage. [2025-11-03T17:22:15.586082] [INFO ] [MAIN ] ATO: Loaded 41804 existing records. [2025-11-03T17:22:15.758563] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:22:15.758849] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-11-03T17:22:15.758896] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-11-03T17:22:15.759584] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-11-03T17:22:15.759639] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-11-03T17:22:15.945269] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-11-03T17:22:16.130467] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:16.300809] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T17:22:16.734875] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-11-03T17:22:17.494084] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-11-03T17:22:17.534858] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-11-03T17:22:17.830336] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T17:22:18.334854] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-11-03T17:22:18.914038] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T17:22:19.134854] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-11-03T17:22:19.392283] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T17:22:19.934866] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-11-03T17:22:20.256492] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:22:20.734929] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-11-03T17:22:20.963950] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T17:22:21.534851] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-11-03T17:22:21.964166] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T17:22:22.334834] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-11-03T17:22:22.499262] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T17:22:23.134849] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-11-03T17:22:23.767710] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T17:22:23.934854] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-11-03T17:22:24.268580] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T17:22:24.734954] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-11-03T17:22:25.241452] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T17:22:25.534944] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-11-03T17:22:25.744487] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T17:22:26.334872] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-11-03T17:22:26.679376] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T17:22:27.134854] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-11-03T17:22:27.482923] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T17:22:27.934860] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-11-03T17:22:28.727500] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-11-03T17:22:28.737961] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-11-03T17:22:29.233112] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T17:22:29.534870] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-11-03T17:22:29.709739] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T17:22:30.334991] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-11-03T17:22:30.478804] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T17:22:31.134866] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-11-03T17:22:31.629292] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:22:31.934867] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-11-03T17:22:32.574245] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T17:22:32.734847] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-11-03T17:22:33.000867] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T17:22:33.534855] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-11-03T17:22:34.086783] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T17:22:34.334882] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-11. [2025-11-03T17:22:34.607774] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T17:22:35.134899] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-11-03T17:22:35.246893] [DEBUG] [REMOTE ] ATI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:22:35.247233] [WARN ] [REMOTE ] ATI: No data returned for month 2025-11 [2025-11-03T17:22:35.247323] [FATAL] [REMOTE ] ATI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:22:35.247433] [FATAL] [MAIN ] ATI: Failed to fetch primary data. [2025-11-03T17:22:35.247512] [WARN ] [MAIN ] ATI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:22:35.247599] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-11-03T17:22:35.247708] [DEBUG] [LOCAL ] ATI: No primary data file found to delete. [2025-11-03T17:22:35.247771] [INFO ] [LOCAL ] ATI: Starting deletion of derivative data. [2025-11-03T17:22:35.248169] [DEBUG] [LOCAL ] ATI: Deleted derivative data file. [2025-11-03T17:22:35.248266] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATI took 36.0s. Estimated remaining: 4h 50m 58s. Rate: 7.5 symbols/min [2025-11-03T17:22:35.427414] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:35.458210] [DEBUG] [LOCAL ] ATR: Loaded 31136 existing records from primary storage. [2025-11-03T17:22:35.458466] [INFO ] [MAIN ] ATR: Loaded 31136 existing records. [2025-11-03T17:22:35.634693] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:22:35.634893] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-11-03T17:22:35.634939] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-11-03T17:22:35.635750] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-11-03T17:22:35.635806] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-11-03T17:22:35.937491] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-11-03T17:22:36.028098] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:36.078172] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T17:22:36.734897] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-11-03T17:22:37.055899] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T17:22:37.534868] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-11. [2025-11-03T17:22:37.877721] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T17:22:38.334869] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-11-03T17:22:39.032847] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-11 (1.50 seconds). [2025-11-03T17:22:39.034281] [INFO ] [REMOTE ] ATKR: Full fetch complete (52725 records). [2025-11-03T17:22:39.034375] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-11-03T17:22:39.139979] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-11-03T17:22:39.501709] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-11-03T17:22:39.501949] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-11-03T17:22:39.502752] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-11-03T17:22:39.502848] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-11-03T17:22:39.521192] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T17:22:39.528042] [DEBUG] [LOCAL ] ATKR: Trimmed 52725 records to 34077 (keeping 200 days of data) [2025-11-03T17:22:39.777027] [DEBUG] [LOCAL ] ATKR: Primary data saved (34077 records). [2025-11-03T17:22:39.777178] [INFO ] [MAIN ] ATKR: Full history saved. [2025-11-03T17:22:39.778020] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATKR took 34.1s. Estimated remaining: 4h 50m 6s. Rate: 7.6 symbols/min [2025-11-03T17:22:39.948002] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-11-03T17:22:39.982978] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:40.001325] [DEBUG] [LOCAL ] ATS: Loaded 16764 existing records from primary storage. [2025-11-03T17:22:40.001603] [INFO ] [MAIN ] ATS: Loaded 16764 existing records. [2025-11-03T17:22:40.221772] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:22:40.222089] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-11-03T17:22:40.222165] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-11-03T17:22:40.222769] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-11-03T17:22:40.222844] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-11-03T17:22:40.401305] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T17:22:40.644418] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:40.734896] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-11-03T17:22:40.839988] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-11-03T17:22:41.534859] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-11-03T17:22:41.680169] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T17:22:42.334860] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-11-03T17:22:42.555843] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T17:22:43.134877] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-11-03T17:22:43.540677] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T17:22:43.934832] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-11-03T17:22:44.086535] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T17:22:44.734848] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-11-03T17:22:45.160232] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T17:22:45.534862] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-11-03T17:22:45.710043] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T17:22:46.334875] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-11-03T17:22:46.787851] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T17:22:46.832905] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T17:22:47.134910] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-11-03T17:22:47.934885] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-11-03T17:22:48.470639] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T17:22:48.734823] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-11-03T17:22:48.794051] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T17:22:49.396293] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T17:22:49.534861] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-11-03T17:22:50.328359] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-11-03T17:22:50.334802] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-11-03T17:22:51.059180] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-11-03T17:22:51.134913] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-11-03T17:22:51.934830] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-11-03T17:22:51.967783] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-11-03T17:22:52.734922] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-11-03T17:22:52.994166] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-11-03T17:22:53.488381] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T17:22:53.534868] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-11-03T17:22:54.334915] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-11-03T17:22:54.856601] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T17:22:55.012735] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-11-03T17:22:55.134940] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-11-03T17:22:55.934897] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-11. [2025-11-03T17:22:56.331182] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T17:22:56.734926] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-11-03T17:22:57.365965] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T17:22:57.534927] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-11. [2025-11-03T17:22:57.573218] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-11 (1.64 seconds). [2025-11-03T17:22:57.575366] [INFO ] [REMOTE ] ATMU: Full fetch complete (56576 records). [2025-11-03T17:22:57.575508] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-11-03T17:22:58.014244] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-11-03T17:22:58.014370] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-11-03T17:22:58.015617] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-11-03T17:22:58.015742] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-11-03T17:22:58.018332] [DEBUG] [LOCAL ] ATMU: Trimmed 56576 records to 38044 (keeping 200 days of data) [2025-11-03T17:22:58.251257] [DEBUG] [LOCAL ] ATMU: Primary data saved (38044 records). [2025-11-03T17:22:58.251424] [INFO ] [MAIN ] ATMU: Full history saved. [2025-11-03T17:22:58.251523] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATMU took 50.5s. Estimated remaining: 4h 52m 13s. Rate: 7.5 symbols/min [2025-11-03T17:22:58.343510] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-11-03T17:22:58.441907] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:58.485713] [DEBUG] [LOCAL ] ATUS: Loaded 50702 existing records from primary storage. [2025-11-03T17:22:58.486039] [INFO ] [MAIN ] ATUS: Loaded 50702 existing records. [2025-11-03T17:22:58.661936] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:22:58.662141] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-11-03T17:22:58.662188] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-11-03T17:22:58.662901] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-11-03T17:22:58.662957] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-11-03T17:22:59.048550] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:22:59.097911] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-11 (1.56 seconds). [2025-11-03T17:22:59.099408] [INFO ] [REMOTE ] ATO: Full fetch complete (60537 records). [2025-11-03T17:22:59.099518] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-11-03T17:22:59.143268] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-11-03T17:22:59.485866] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-11-03T17:22:59.485948] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-11-03T17:22:59.486670] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-11-03T17:22:59.486738] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-11-03T17:22:59.487955] [DEBUG] [LOCAL ] ATO: Trimmed 60537 records to 41155 (keeping 200 days of data) [2025-11-03T17:22:59.739814] [DEBUG] [LOCAL ] ATO: Primary data saved (41155 records). [2025-11-03T17:22:59.739937] [INFO ] [MAIN ] ATO: Full history saved. [2025-11-03T17:22:59.740678] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATO took 44.4s. Estimated remaining: 4h 50m 42s. Rate: 7.5 symbols/min [2025-11-03T17:22:59.906150] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:22:59.934942] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-11-03T17:22:59.957196] [DEBUG] [LOCAL ] AU: Loaded 53848 existing records from primary storage. [2025-11-03T17:22:59.957517] [INFO ] [MAIN ] AU: Loaded 53848 existing records. [2025-11-03T17:23:00.130246] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:23:00.130499] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-11-03T17:23:00.130552] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-11-03T17:23:00.131390] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-11-03T17:23:00.131447] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-11-03T17:23:00.480229] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:00.734839] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-11-03T17:23:04.616796] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (5.47 seconds). [2025-11-03T17:23:04.620558] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-11. [2025-11-03T17:23:05.027184] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (6.68 seconds). [2025-11-03T17:23:05.033902] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-11-03T17:23:05.308632] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (5.37 seconds). [2025-11-03T17:23:05.318844] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-11-03T17:23:05.930281] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (5.20 seconds). [2025-11-03T17:23:05.941137] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-11-03T17:23:05.995210] [DEBUG] [REMOTE ] ATS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:23:05.995513] [WARN ] [REMOTE ] ATS: No data returned for month 2025-11 [2025-11-03T17:23:05.995622] [FATAL] [REMOTE ] ATS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:23:05.995933] [FATAL] [MAIN ] ATS: Failed to fetch primary data. [2025-11-03T17:23:05.996001] [WARN ] [MAIN ] ATS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:23:05.996068] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-11-03T17:23:05.996135] [DEBUG] [LOCAL ] ATS: No primary data file found to delete. [2025-11-03T17:23:05.996171] [INFO ] [LOCAL ] ATS: Starting deletion of derivative data. [2025-11-03T17:23:05.996331] [DEBUG] [LOCAL ] ATS: Deleted derivative data file. [2025-11-03T17:23:05.996426] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATS took 26.2s. Estimated remaining: 4h 50m 13s. Rate: 7.6 symbols/min [2025-11-03T17:23:06.178835] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:06.199707] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T17:23:06.207474] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-11-03T17:23:06.243502] [DEBUG] [LOCAL ] AUB: Loaded 46264 existing records from primary storage. [2025-11-03T17:23:06.243847] [INFO ] [MAIN ] AUB: Loaded 46264 existing records. [2025-11-03T17:23:06.434934] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:23:06.435328] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-11-03T17:23:06.435396] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-11-03T17:23:06.436258] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-11-03T17:23:06.436319] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-11-03T17:23:06.745525] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T17:23:06.772682] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-11-03T17:23:06.853677] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:06.853992] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-11-03T17:23:07.193384] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T17:23:07.200504] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-11-03T17:23:07.297731] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T17:23:07.934825] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-11-03T17:23:08.119603] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T17:23:08.160461] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-11-03T17:23:08.195210] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T17:23:08.734897] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-11. [2025-11-03T17:23:09.534825] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-11-03T17:23:09.541535] [DEBUG] [REMOTE ] ATR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:23:09.541797] [WARN ] [REMOTE ] ATR: No data returned for month 2025-11 [2025-11-03T17:23:09.541890] [FATAL] [REMOTE ] ATR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:23:09.542024] [FATAL] [MAIN ] ATR: Failed to fetch primary data. [2025-11-03T17:23:09.542107] [WARN ] [MAIN ] ATR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:23:09.542193] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-11-03T17:23:09.542281] [DEBUG] [LOCAL ] ATR: No primary data file found to delete. [2025-11-03T17:23:09.542330] [INFO ] [LOCAL ] ATR: Starting deletion of derivative data. [2025-11-03T17:23:09.542511] [DEBUG] [LOCAL ] ATR: Deleted derivative data file. [2025-11-03T17:23:09.542593] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATR took 34.3s. Estimated remaining: 4h 49m 10s. Rate: 7.6 symbols/min [2025-11-03T17:23:09.769581] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:09.772165] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-11-03T17:23:09.794849] [DEBUG] [LOCAL ] AUNA: Loaded 5526 existing records from primary storage. [2025-11-03T17:23:09.795063] [INFO ] [MAIN ] AUNA: Loaded 5526 existing records. [2025-11-03T17:23:09.987167] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:23:09.987431] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-11-03T17:23:09.987501] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-11-03T17:23:09.987752] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-11-03T17:23:09.987810] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-11-03T17:23:10.345827] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-11-03T17:23:10.350966] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:10.774425] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:23:11.134896] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-11-03T17:23:11.935003] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-11-03T17:23:12.026149] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-11-03T17:23:12.206905] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T17:23:12.734862] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-11-03T17:23:12.999749] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:23:13.311182] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-11-03T17:23:13.534921] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-11-03T17:23:14.334868] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-11-03T17:23:14.729072] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T17:23:14.818353] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T17:23:15.134867] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-11-03T17:23:15.934897] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-11-03T17:23:16.734911] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-11-03T17:23:16.944633] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-11-03T17:23:17.112299] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T17:23:17.154746] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T17:23:17.534895] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-11-03T17:23:18.334932] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-11-03T17:23:18.756251] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T17:23:19.134858] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-11-03T17:23:19.716082] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T17:23:19.934873] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-11-03T17:23:20.390061] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T17:23:20.734854] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-11-03T17:23:21.096630] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-11-03T17:23:21.534842] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-11-03T17:23:21.674975] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-11-03T17:23:21.945323] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T17:23:22.334868] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-11-03T17:23:23.134845] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-11-03T17:23:23.934850] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-11-03T17:23:24.005568] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-11-03T17:23:24.417840] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T17:23:24.657707] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T17:23:24.734850] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-11-03T17:23:25.120439] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T17:23:25.534858] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-11-03T17:23:26.334863] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-11-03T17:23:27.147543] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-11-03T17:23:27.157300] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-11-03T17:23:27.538804] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T17:23:27.675010] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T17:23:27.934843] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-11-03T17:23:28.734910] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-11-03T17:23:29.308987] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T17:23:29.534906] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-11-03T17:23:30.005329] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T17:23:30.190530] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T17:23:30.334873] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-11-03T17:23:30.841542] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T17:23:31.134891] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-11. [2025-11-03T17:23:31.897248] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-11 (0.76 seconds). [2025-11-03T17:23:31.897961] [INFO ] [REMOTE ] AUNA: Full fetch complete (7897 records). [2025-11-03T17:23:31.898027] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-11-03T17:23:31.940083] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-11-03T17:23:32.268246] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-11-03T17:23:32.268370] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-11-03T17:23:32.268601] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-11-03T17:23:32.268693] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-11-03T17:23:32.269107] [DEBUG] [LOCAL ] AUNA: Trimmed 7897 records to 5516 (keeping 200 days of data) [2025-11-03T17:23:32.298823] [DEBUG] [LOCAL ] AUNA: Primary data saved (5516 records). [2025-11-03T17:23:32.298934] [INFO ] [MAIN ] AUNA: Full history saved. [2025-11-03T17:23:32.299021] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. AUNA took 22.8s. Estimated remaining: 4h 52m 7s. Rate: 7.5 symbols/min [2025-11-03T17:23:32.465436] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:32.499789] [DEBUG] [LOCAL ] AVA: Loaded 38493 existing records from primary storage. [2025-11-03T17:23:32.500104] [INFO ] [MAIN ] AVA: Loaded 38493 existing records. [2025-11-03T17:23:32.680454] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:23:32.680689] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-11-03T17:23:32.680749] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-11-03T17:23:32.681512] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-11-03T17:23:32.681573] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-11-03T17:23:32.744621] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-11-03T17:23:33.056200] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:33.511757] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-11-03T17:23:33.534834] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-11-03T17:23:34.077865] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T17:23:34.334917] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-11-03T17:23:34.696146] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T17:23:35.134887] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-11-03T17:23:35.934840] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-11-03T17:23:36.137873] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-11-03T17:23:36.560448] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T17:23:36.734944] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-11. [2025-11-03T17:23:36.918716] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T17:23:37.534906] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-11-03T17:23:37.648409] [DEBUG] [REMOTE ] ATUS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:23:37.648799] [WARN ] [REMOTE ] ATUS: No data returned for month 2025-11 [2025-11-03T17:23:37.648887] [FATAL] [REMOTE ] ATUS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:23:37.648965] [FATAL] [MAIN ] ATUS: Failed to fetch primary data. [2025-11-03T17:23:37.649027] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:23:37.649103] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-11-03T17:23:37.649177] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-11-03T17:23:37.649220] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-11-03T17:23:37.649611] [DEBUG] [LOCAL ] ATUS: Deleted derivative data file. [2025-11-03T17:23:37.651073] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. ATUS took 39.4s. Estimated remaining: 4h 51m 26s. Rate: 7.5 symbols/min [2025-11-03T17:23:37.825513] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:37.839226] [DEBUG] [LOCAL ] AVAL: Loaded 8519 existing records from primary storage. [2025-11-03T17:23:37.839607] [INFO ] [MAIN ] AVAL: Loaded 8519 existing records. [2025-11-03T17:23:38.023711] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:23:38.024016] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-11-03T17:23:38.024069] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-11-03T17:23:38.024378] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-11-03T17:23:38.024437] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-11-03T17:23:38.347386] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-11. [2025-11-03T17:23:38.388048] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:38.767254] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T17:23:39.134895] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-11-03T17:23:39.691517] [DEBUG] [REMOTE ] AU: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:23:39.691906] [WARN ] [REMOTE ] AU: No data returned for month 2025-11 [2025-11-03T17:23:39.692011] [FATAL] [REMOTE ] AU: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:23:39.692109] [FATAL] [MAIN ] AU: Failed to fetch primary data. [2025-11-03T17:23:39.692185] [WARN ] [MAIN ] AU: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:23:39.692269] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-11-03T17:23:39.692347] [DEBUG] [LOCAL ] AU: No primary data file found to delete. [2025-11-03T17:23:39.692392] [INFO ] [LOCAL ] AU: Starting deletion of derivative data. [2025-11-03T17:23:39.692567] [DEBUG] [LOCAL ] AU: Deleted derivative data file. [2025-11-03T17:23:39.693677] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. AU took 40.0s. Estimated remaining: 4h 50m 5s. Rate: 7.5 symbols/min [2025-11-03T17:23:39.884246] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:39.896996] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-11-03T17:23:39.938480] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-11-03T17:23:39.940454] [DEBUG] [LOCAL ] AVB: Loaded 42559 existing records from primary storage. [2025-11-03T17:23:39.940838] [INFO ] [MAIN ] AVB: Loaded 42559 existing records. [2025-11-03T17:23:40.117418] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:23:40.117626] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-11-03T17:23:40.117710] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-11-03T17:23:40.118435] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-11-03T17:23:40.118492] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-11-03T17:23:40.463687] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:40.734888] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-11-03T17:23:41.187440] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T17:23:41.534900] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-11-03T17:23:42.061253] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T17:23:42.125066] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T17:23:42.334876] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-11-03T17:23:43.134890] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-11-03T17:23:43.449564] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-11-03T17:23:43.934862] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-11-03T17:23:44.306595] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:23:44.734900] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-11-03T17:23:45.330398] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T17:23:45.534875] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-11-03T17:23:46.025003] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:23:46.072195] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-11-03T17:23:46.334854] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-11-03T17:23:46.915978] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-11-03T17:23:47.134913] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-11-03T17:23:47.934880] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-11-03T17:23:48.420149] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T17:23:48.518338] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T17:23:48.734855] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-11. [2025-11-03T17:23:49.534905] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-11-03T17:23:49.758934] [DEBUG] [REMOTE ] AUB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:23:49.759226] [WARN ] [REMOTE ] AUB: No data returned for month 2025-11 [2025-11-03T17:23:49.759317] [FATAL] [REMOTE ] AUB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:23:49.759423] [FATAL] [MAIN ] AUB: Failed to fetch primary data. [2025-11-03T17:23:49.759491] [WARN ] [MAIN ] AUB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:23:49.759563] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-11-03T17:23:49.759626] [DEBUG] [LOCAL ] AUB: No primary data file found to delete. [2025-11-03T17:23:49.759701] [INFO ] [LOCAL ] AUB: Starting deletion of derivative data. [2025-11-03T17:23:49.759851] [DEBUG] [LOCAL ] AUB: Deleted derivative data file. [2025-11-03T17:23:49.760399] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. AUB took 43.8s. Estimated remaining: 4h 50m 23s. Rate: 7.5 symbols/min [2025-11-03T17:23:49.939470] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:49.939663] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-11-03T17:23:49.939721] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-11-03T17:23:49.939835] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-11-03T17:23:49.939879] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-11-03T17:23:49.939922] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-11-03T17:23:49.939962] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-11-03T17:23:50.310003] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:50.334812] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-11-03T17:23:50.684978] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:23:50.685260] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-11-03T17:23:50.685361] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:23:50.685432] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-11-03T17:23:50.685497] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:23:50.685567] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-11-03T17:23:50.685629] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-11-03T17:23:50.685700] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-11-03T17:23:50.685754] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-11-03T17:23:50.685801] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 0.9s. Estimated remaining: 4h 48m 49s. Rate: 7.6 symbols/min [2025-11-03T17:23:50.861153] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:23:50.893348] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:23:50.893829] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-11-03T17:23:50.893985] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-11-03T17:23:50.894115] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-11-03T17:23:50.894178] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-11-03T17:23:50.894575] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-11-03T17:23:50.894623] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-11-03T17:23:51.134911] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-11-03T17:23:51.258953] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:23:51.934859] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-11-03T17:23:52.483696] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T17:23:52.734866] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-11-03T17:23:53.053900] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:23:53.534903] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-11-03T17:23:54.021454] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T17:23:54.087275] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:23:54.334848] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-11-03T17:23:54.843011] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T17:23:55.134874] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-11-03T17:23:55.934871] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-11-03T17:23:56.225921] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T17:23:56.473700] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-11-03T17:23:56.734955] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-11-03T17:23:57.534905] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-11-03T17:23:57.807770] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T17:23:57.926335] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T17:23:58.334871] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-11-03T17:23:59.051770] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T17:23:59.134905] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-11-03T17:23:59.732583] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-11-03T17:23:59.934888] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-11. [2025-11-03T17:24:00.443385] [DEBUG] [REMOTE ] AVAL: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:24:00.443705] [WARN ] [REMOTE ] AVAL: No data returned for month 2025-11 [2025-11-03T17:24:00.443790] [FATAL] [REMOTE ] AVAL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:24:00.443867] [FATAL] [MAIN ] AVAL: Failed to fetch primary data. [2025-11-03T17:24:00.443904] [WARN ] [MAIN ] AVAL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:24:00.443941] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-11-03T17:24:00.443995] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-11-03T17:24:00.444029] [INFO ] [LOCAL ] AVAL: Starting deletion of derivative data. [2025-11-03T17:24:00.444196] [DEBUG] [LOCAL ] AVAL: Deleted derivative data file. [2025-11-03T17:24:00.444279] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AVAL took 22.8s. Estimated remaining: 4h 49m 3s. Rate: 7.6 symbols/min [2025-11-03T17:24:00.622423] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:00.622700] [DEBUG] [LOCAL ] AVK: No existing data file found in primary storage. [2025-11-03T17:24:00.622791] [WARN ] [MAIN ] AVK: No existing data found, performing full refresh instead. [2025-11-03T17:24:00.622874] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-11-03T17:24:00.622912] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-11-03T17:24:00.622953] [DEBUG] [LOCAL ] AVK: No primary data file found to delete. [2025-11-03T17:24:00.622985] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-11-03T17:24:00.739937] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-11-03T17:24:00.998633] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:01.535107] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-11-03T17:24:02.030661] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:24:02.334886] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-11-03T17:24:02.772995] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T17:24:03.134868] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-11. [2025-11-03T17:24:03.591970] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T17:24:03.934864] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-11-03T17:24:04.660744] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T17:24:04.662453] [INFO ] [REMOTE ] AVA: Full fetch complete (55592 records). [2025-11-03T17:24:04.662547] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-11-03T17:24:04.738929] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-11-03T17:24:05.049002] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:24:05.269750] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-11-03T17:24:05.269900] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-11-03T17:24:05.270983] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-11-03T17:24:05.271059] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-11-03T17:24:05.272963] [DEBUG] [LOCAL ] AVA: Trimmed 55592 records to 37952 (keeping 200 days of data) [2025-11-03T17:24:05.551929] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-11-03T17:24:05.602108] [DEBUG] [LOCAL ] AVA: Primary data saved (37952 records). [2025-11-03T17:24:05.602353] [INFO ] [MAIN ] AVA: Full history saved. [2025-11-03T17:24:05.602507] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVA took 33.3s. Estimated remaining: 4h 48m 22s. Rate: 7.6 symbols/min [2025-11-03T17:24:05.842819] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:05.882444] [DEBUG] [LOCAL ] AVNS: Loaded 33649 existing records from primary storage. [2025-11-03T17:24:05.882902] [INFO ] [MAIN ] AVNS: Loaded 33649 existing records. [2025-11-03T17:24:06.093691] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:06.094049] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-11-03T17:24:06.118412] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-11-03T17:24:06.119991] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:24:06.120036] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-11-03T17:24:06.123112] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-11-03T17:24:06.342569] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-11-03T17:24:06.500246] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:06.521528] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T17:24:07.031272] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T17:24:07.134841] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-11-03T17:24:07.867418] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T17:24:07.934861] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-11-03T17:24:08.734877] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-11-03T17:24:09.201074] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:24:09.534864] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-11-03T17:24:09.633929] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T17:24:10.334828] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-11-03T17:24:10.778617] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T17:24:11.069332] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T17:24:11.134887] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-11-03T17:24:11.934887] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-11-03T17:24:12.286763] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T17:24:12.734837] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-11-03T17:24:12.844035] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T17:24:13.534867] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-11-03T17:24:14.126208] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T17:24:14.246880] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T17:24:14.334852] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-11-03T17:24:15.134904] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-11-03T17:24:15.218122] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T17:24:15.934867] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-11-03T17:24:15.978624] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T17:24:16.734856] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-11. [2025-11-03T17:24:16.866871] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T17:24:17.534863] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-11-03T17:24:17.733787] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-11 (1.00 seconds). [2025-11-03T17:24:17.735124] [INFO ] [REMOTE ] AVB: Full fetch complete (59913 records). [2025-11-03T17:24:17.735216] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-11-03T17:24:18.119930] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-11-03T17:24:18.120010] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-11-03T17:24:18.120625] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-11-03T17:24:18.120703] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-11-03T17:24:18.121941] [DEBUG] [LOCAL ] AVB: Trimmed 59913 records to 41960 (keeping 200 days of data) [2025-11-03T17:24:18.334853] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-11-03T17:24:18.362344] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T17:24:18.400473] [DEBUG] [LOCAL ] AVB: Primary data saved (41960 records). [2025-11-03T17:24:18.400591] [INFO ] [MAIN ] AVB: Full history saved. [2025-11-03T17:24:18.401476] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVB took 38.7s. Estimated remaining: 4h 49m 12s. Rate: 7.5 symbols/min [2025-11-03T17:24:18.566620] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:18.602427] [DEBUG] [LOCAL ] AVNT: Loaded 38514 existing records from primary storage. [2025-11-03T17:24:18.602717] [INFO ] [MAIN ] AVNT: Loaded 38514 existing records. [2025-11-03T17:24:18.787089] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:18.787330] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-11-03T17:24:18.787381] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-11-03T17:24:18.788078] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-11-03T17:24:18.788140] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-11-03T17:24:19.100170] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T17:24:19.168037] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-11-03T17:24:19.174751] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:19.913918] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-11-03T17:24:19.934807] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-11-03T17:24:20.734848] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-11-03T17:24:20.896041] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-11-03T17:24:21.472392] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T17:24:21.534824] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-11-03T17:24:22.334823] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-11-03T17:24:22.369638] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T17:24:23.134849] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-11-03T17:24:23.224479] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T17:24:23.843422] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T17:24:23.934863] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-11-03T17:24:24.734801] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-11-03T17:24:25.015879] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T17:24:25.406522] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-11-03T17:24:25.534911] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-11-03T17:24:26.334880] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-11-03T17:24:26.596100] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:24:27.134847] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-11-03T17:24:27.204594] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T17:24:27.934857] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-11. [2025-11-03T17:24:28.156676] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T17:24:28.584788] [DEBUG] [REMOTE ] AVD: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:24:28.585134] [WARN ] [REMOTE ] AVD: No data returned for month 2025-11 [2025-11-03T17:24:28.585231] [FATAL] [REMOTE ] AVD: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:24:28.585331] [FATAL] [MAIN ] AVD: Failed to fetch primary data. [2025-11-03T17:24:28.585407] [WARN ] [MAIN ] AVD: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:24:28.585488] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-11-03T17:24:28.585563] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-11-03T17:24:28.585605] [INFO ] [LOCAL ] AVD: Starting deletion of derivative data. [2025-11-03T17:24:28.585683] [DEBUG] [LOCAL ] AVD: No derivative data file found to delete. [2025-11-03T17:24:28.585755] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVD took 37.9s. Estimated remaining: 4h 49m 31s. Rate: 7.5 symbols/min [2025-11-03T17:24:28.736142] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-11. [2025-11-03T17:24:28.760717] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:28.812196] [DEBUG] [LOCAL ] AVTR: Loaded 54350 existing records from primary storage. [2025-11-03T17:24:28.812509] [INFO ] [MAIN ] AVTR: Loaded 54350 existing records. [2025-11-03T17:24:28.988864] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:28.989093] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-11-03T17:24:28.989142] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-11-03T17:24:28.990025] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-11-03T17:24:28.990084] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-11-03T17:24:29.364661] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:29.534907] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-11-03T17:24:29.903296] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T17:24:29.904499] [INFO ] [REMOTE ] AVK: Full fetch complete (26738 records). [2025-11-03T17:24:29.904588] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-11-03T17:24:30.337166] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-11-03T17:24:30.336890] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-11-03T17:24:30.337374] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-11-03T17:24:30.338955] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-11-03T17:24:30.339024] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-11-03T17:24:30.340037] [DEBUG] [LOCAL ] AVK: Trimmed 26738 records to 18425 (keeping 200 days of data) [2025-11-03T17:24:30.452663] [DEBUG] [LOCAL ] AVK: Primary data saved (18425 records). [2025-11-03T17:24:30.452835] [INFO ] [MAIN ] AVK: Full history saved. [2025-11-03T17:24:30.452929] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVK took 30.0s. Estimated remaining: 4h 48m 11s. Rate: 7.6 symbols/min [2025-11-03T17:24:30.636426] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:30.672989] [DEBUG] [LOCAL ] AVY: Loaded 38317 existing records from primary storage. [2025-11-03T17:24:30.673261] [INFO ] [MAIN ] AVY: Loaded 38317 existing records. [2025-11-03T17:24:30.855976] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:30.856357] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-11-03T17:24:30.856409] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-11-03T17:24:30.866452] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-11-03T17:24:30.871743] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-11-03T17:24:30.959485] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T17:24:31.145314] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-11-03T17:24:31.273502] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:31.437933] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T17:24:31.934899] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-11-03T17:24:32.510695] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T17:24:32.734879] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-11-03T17:24:33.120242] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T17:24:33.534892] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-11-03T17:24:33.889892] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T17:24:34.334898] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-11-03T17:24:34.644130] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T17:24:35.134877] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-11-03T17:24:35.361700] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T17:24:35.934819] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-11-03T17:24:36.072054] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T17:24:36.734844] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-11-03T17:24:37.075860] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T17:24:37.534823] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-11-03T17:24:37.789143] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T17:24:38.334885] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-11-03T17:24:38.959725] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T17:24:39.134894] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-11-03T17:24:39.518122] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T17:24:39.934874] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-11-03T17:24:40.563487] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T17:24:40.734821] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-11-03T17:24:40.946324] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T17:24:41.534965] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-11-03T17:24:42.231591] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T17:24:42.334853] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-11-03T17:24:42.721159] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T17:24:43.134947] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-11-03T17:24:43.567390] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:24:43.934931] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-11-03T17:24:44.133191] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T17:24:44.734943] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-11-03T17:24:45.413348] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T17:24:45.534896] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-11-03T17:24:45.655052] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T17:24:46.334915] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-11-03T17:24:46.928520] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T17:24:47.134935] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-11-03T17:24:47.490601] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T17:24:47.934921] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-11-03T17:24:48.523573] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:24:48.734920] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-11-03T17:24:48.942866] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-11-03T17:24:49.534931] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-11-03T17:24:49.931796] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T17:24:50.334893] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-11-03T17:24:50.501422] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T17:24:51.134944] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-11-03T17:24:51.825259] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T17:24:51.934829] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-11-03T17:24:52.071974] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T17:24:52.734906] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-11-03T17:24:53.521907] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T17:24:53.534804] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-11. [2025-11-03T17:24:53.807557] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T17:24:54.334944] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-11. [2025-11-03T17:24:55.134850] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-11. [2025-11-03T17:24:55.759842] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-11 (2.23 seconds). [2025-11-03T17:24:55.761356] [INFO ] [REMOTE ] AVTR: Full fetch complete (77678 records). [2025-11-03T17:24:55.761452] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-11-03T17:24:55.935712] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-11 (1.60 seconds). [2025-11-03T17:24:55.935519] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-11-03T17:24:55.940174] [INFO ] [REMOTE ] AVNT: Full fetch complete (55896 records). [2025-11-03T17:24:55.975712] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-11-03T17:24:56.399791] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-11-03T17:24:56.444758] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-11-03T17:24:56.472710] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-11-03T17:24:56.484447] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-11-03T17:24:56.512692] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-11 (1.38 seconds). [2025-11-03T17:24:56.555925] [INFO ] [REMOTE ] AVNS: Full fetch complete (47934 records). [2025-11-03T17:24:56.612533] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-11-03T17:24:56.612183] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-11-03T17:24:56.612771] [DEBUG] [LOCAL ] AVTR: Trimmed 77678 records to 53570 (keeping 200 days of data) [2025-11-03T17:24:56.612877] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-11-03T17:24:56.626784] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-11-03T17:24:56.642630] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-11-03T17:24:56.647080] [DEBUG] [LOCAL ] AVNT: Trimmed 55896 records to 37880 (keeping 200 days of data) [2025-11-03T17:24:57.374621] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-11-03T17:24:57.440112] [DEBUG] [LOCAL ] AVNT: Primary data saved (37880 records). [2025-11-03T17:24:57.467053] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-11-03T17:24:57.467511] [INFO ] [MAIN ] AVNT: Full history saved. [2025-11-03T17:24:57.469327] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-11-03T17:24:57.470239] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVNT took 39.1s. Estimated remaining: 4h 51m 47s. Rate: 7.5 symbols/min [2025-11-03T17:24:57.471914] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-11-03T17:24:57.563089] [DEBUG] [LOCAL ] AVNS: Trimmed 47934 records to 33140 (keeping 200 days of data) [2025-11-03T17:24:57.718399] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:57.786140] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-11-03T17:24:57.797807] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-11-03T17:24:57.966233] [DEBUG] [LOCAL ] AWF: Loaded 24099 existing records from primary storage. [2025-11-03T17:24:57.976734] [INFO ] [MAIN ] AWF: Loaded 24099 existing records. [2025-11-03T17:24:57.996772] [DEBUG] [LOCAL ] AVTR: Primary data saved (53570 records). [2025-11-03T17:24:58.025385] [INFO ] [MAIN ] AVTR: Full history saved. [2025-11-03T17:24:58.054463] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVTR took 29.5s. Estimated remaining: 4h 50m 12s. Rate: 7.5 symbols/min [2025-11-03T17:24:58.135125] [DEBUG] [LOCAL ] AVNS: Primary data saved (33140 records). [2025-11-03T17:24:58.168204] [INFO ] [MAIN ] AVNS: Full history saved. [2025-11-03T17:24:58.206070] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AVNS took 52.6s. Estimated remaining: 4h 48m 33s. Rate: 7.5 symbols/min [2025-11-03T17:24:58.318135] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:58.357058] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-11-03T17:24:58.403539] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-11-03T17:24:58.434204] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:58.456961] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-11-03T17:24:58.457181] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-11-03T17:24:58.615318] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:24:58.706858] [DEBUG] [LOCAL ] AWI: Loaded 25363 existing records from primary storage. [2025-11-03T17:24:58.776585] [INFO ] [MAIN ] AWI: Loaded 25363 existing records. [2025-11-03T17:24:58.989103] [DEBUG] [LOCAL ] AWK: Loaded 48987 existing records from primary storage. [2025-11-03T17:24:59.045909] [INFO ] [MAIN ] AWK: Loaded 48987 existing records. [2025-11-03T17:24:59.079263] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:59.171412] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:59.190624] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-11-03T17:24:59.196039] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-11-03T17:24:59.211637] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-11-03T17:24:59.226850] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-11-03T17:24:59.247585] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-11-03T17:24:59.299087] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:24:59.361505] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-11-03T17:24:59.375018] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:24:59.361810] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-11-03T17:24:59.419018] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-11-03T17:24:59.430167] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-11-03T17:24:59.472264] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-11-03T17:24:59.984072] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:24:59.995056] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-11-03T17:25:00.056223] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:00.056976] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-11-03T17:25:00.170548] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T17:25:00.734851] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-11-03T17:25:00.799247] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T17:25:00.880750] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T17:25:01.315139] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T17:25:01.456419] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T17:25:01.534875] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-11-03T17:25:02.334947] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-11-03T17:25:02.999900] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-11-03T17:25:03.134855] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-11-03T17:25:03.252229] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T17:25:03.934868] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-11-03T17:25:04.155178] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T17:25:04.734824] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-11-03T17:25:05.436721] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T17:25:05.534844] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-11-03T17:25:05.624797] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:25:06.334858] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-11-03T17:25:06.778902] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T17:25:07.117894] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-11-03T17:25:07.134816] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-11-03T17:25:07.831070] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T17:25:07.934895] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-11-03T17:25:08.734833] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-11-03T17:25:09.138436] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T17:25:09.534870] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-11. [2025-11-03T17:25:10.203919] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T17:25:10.334885] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-11-03T17:25:11.134855] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-11-03T17:25:11.273985] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-11 (1.74 seconds). [2025-11-03T17:25:11.275290] [INFO ] [REMOTE ] AVY: Full fetch complete (56597 records). [2025-11-03T17:25:11.275386] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-11-03T17:25:11.682621] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-11-03T17:25:11.682770] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-11-03T17:25:11.683520] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-11-03T17:25:11.683664] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-11-03T17:25:11.702146] [DEBUG] [LOCAL ] AVY: Trimmed 56597 records to 37660 (keeping 200 days of data) [2025-11-03T17:25:11.702018] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T17:25:11.936373] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-11-03T17:25:11.950764] [DEBUG] [LOCAL ] AVY: Primary data saved (37660 records). [2025-11-03T17:25:11.950979] [INFO ] [MAIN ] AVY: Full history saved. [2025-11-03T17:25:11.951065] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVY took 41.5s. Estimated remaining: 4h 49m 32s. Rate: 7.5 symbols/min [2025-11-03T17:25:12.138719] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:25:12.157230] [DEBUG] [LOCAL ] AWP: Loaded 21663 existing records from primary storage. [2025-11-03T17:25:12.157472] [INFO ] [MAIN ] AWP: Loaded 21663 existing records. [2025-11-03T17:25:12.332043] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:25:12.332273] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-11-03T17:25:12.332349] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-11-03T17:25:12.332840] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-11-03T17:25:12.332900] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-11-03T17:25:12.699586] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:12.738721] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-11-03T17:25:12.740051] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T17:25:12.748625] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T17:25:13.534916] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-11-03T17:25:13.855948] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:25:14.334922] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-11-03T17:25:14.440933] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T17:25:15.134875] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-11-03T17:25:15.934889] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-11-03T17:25:16.018785] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T17:25:16.045299] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T17:25:16.734899] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-11-03T17:25:16.860960] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T17:25:17.534858] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-11-03T17:25:17.606301] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T17:25:18.218131] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T17:25:18.334864] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-11-03T17:25:19.080062] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T17:25:19.134847] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-11-03T17:25:19.895946] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T17:25:19.934816] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-11-03T17:25:20.734817] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-11. [2025-11-03T17:25:20.793078] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T17:25:21.534844] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-11-03T17:25:22.098727] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-11 (1.36 seconds). [2025-11-03T17:25:22.099732] [INFO ] [REMOTE ] AWF: Full fetch complete (35646 records). [2025-11-03T17:25:22.099807] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-11-03T17:25:22.340043] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-11-03T17:25:22.425150] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T17:25:22.515495] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-11-03T17:25:22.515587] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-11-03T17:25:22.516063] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-11-03T17:25:22.516127] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-11-03T17:25:22.517116] [DEBUG] [LOCAL ] AWF: Trimmed 35646 records to 23582 (keeping 200 days of data) [2025-11-03T17:25:22.655025] [DEBUG] [LOCAL ] AWF: Primary data saved (23582 records). [2025-11-03T17:25:22.655146] [INFO ] [MAIN ] AWF: Full history saved. [2025-11-03T17:25:22.655223] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AWF took 25.2s. Estimated remaining: 4h 49m 55s. Rate: 7.5 symbols/min [2025-11-03T17:25:22.821092] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:25:22.821229] [DEBUG] [LOCAL ] AWR: No existing data file found in primary storage. [2025-11-03T17:25:22.821267] [WARN ] [MAIN ] AWR: No existing data found, performing full refresh instead. [2025-11-03T17:25:22.821376] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-11-03T17:25:22.821419] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-11-03T17:25:22.821460] [DEBUG] [LOCAL ] AWR: No primary data file found to delete. [2025-11-03T17:25:22.821493] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-11-03T17:25:23.140013] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-11-03T17:25:23.180726] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:23.611507] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:25:23.934834] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-11-03T17:25:24.037622] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T17:25:24.734854] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-11-03T17:25:25.000496] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T17:25:25.543489] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-11-03T17:25:25.545415] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T17:25:26.334904] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-11-03T17:25:26.688162] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T17:25:27.092220] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T17:25:27.134862] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-11-03T17:25:27.934847] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-11-03T17:25:28.024408] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T17:25:28.727748] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T17:25:28.734813] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-11-03T17:25:29.534848] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-11-03T17:25:29.699912] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T17:25:30.334835] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-11-03T17:25:30.413441] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-11-03T17:25:31.134834] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-11-03T17:25:31.148801] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T17:25:31.934821] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-11. [2025-11-03T17:25:32.432380] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T17:25:32.734882] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-11-03T17:25:33.516690] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-11 (1.58 seconds). [2025-11-03T17:25:33.517804] [INFO ] [REMOTE ] AWI: Full fetch complete (36635 records). [2025-11-03T17:25:33.517876] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-11-03T17:25:33.539969] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-11-03T17:25:33.915945] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-11-03T17:25:33.916546] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-11-03T17:25:33.917121] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-11-03T17:25:33.917777] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T17:25:33.917904] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-11-03T17:25:33.926296] [DEBUG] [LOCAL ] AWI: Trimmed 36635 records to 25025 (keeping 200 days of data) [2025-11-03T17:25:34.074169] [DEBUG] [LOCAL ] AWI: Primary data saved (25025 records). [2025-11-03T17:25:34.074286] [INFO ] [MAIN ] AWI: Full history saved. [2025-11-03T17:25:34.074363] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWI took 36.0s. Estimated remaining: 4h 50m 26s. Rate: 7.5 symbols/min [2025-11-03T17:25:34.245196] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:25:34.270097] [DEBUG] [LOCAL ] AX: Loaded 27618 existing records from primary storage. [2025-11-03T17:25:34.270441] [INFO ] [MAIN ] AX: Loaded 27618 existing records. [2025-11-03T17:25:34.340531] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-11-03T17:25:34.464621] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:25:34.466056] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T17:25:34.466252] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-11-03T17:25:34.470704] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-11-03T17:25:34.471695] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-11-03T17:25:34.471755] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-11-03T17:25:34.826136] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:35.134820] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-11-03T17:25:35.252408] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T17:25:35.934844] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-11. [2025-11-03T17:25:35.974499] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T17:25:36.086905] [DEBUG] [REMOTE ] AWK: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:25:36.087425] [WARN ] [REMOTE ] AWK: No data returned for month 2025-11 [2025-11-03T17:25:36.087529] [FATAL] [REMOTE ] AWK: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:25:36.087633] [FATAL] [MAIN ] AWK: Failed to fetch primary data. [2025-11-03T17:25:36.087717] [WARN ] [MAIN ] AWK: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:25:36.087773] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-11-03T17:25:36.087841] [DEBUG] [LOCAL ] AWK: No primary data file found to delete. [2025-11-03T17:25:36.087881] [INFO ] [LOCAL ] AWK: Starting deletion of derivative data. [2025-11-03T17:25:36.088137] [DEBUG] [LOCAL ] AWK: Deleted derivative data file. [2025-11-03T17:25:36.088274] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWK took 37.8s. Estimated remaining: 4h 49m 10s. Rate: 7.5 symbols/min [2025-11-03T17:25:36.263131] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:25:36.310317] [DEBUG] [LOCAL ] AXL: Loaded 51226 existing records from primary storage. [2025-11-03T17:25:36.310690] [INFO ] [MAIN ] AXL: Loaded 51226 existing records. [2025-11-03T17:25:36.488989] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:25:36.489258] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-11-03T17:25:36.489338] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-11-03T17:25:36.490150] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-11-03T17:25:36.490210] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-11-03T17:25:36.739928] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-11-03T17:25:36.854102] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:37.534906] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-11-03T17:25:37.936170] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:25:38.334860] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-11-03T17:25:38.374256] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-11-03T17:25:39.134858] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-11-03T17:25:39.577203] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T17:25:39.943379] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-11-03T17:25:39.947679] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T17:25:40.734898] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-11-03T17:25:41.367638] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T17:25:41.534888] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-11-03T17:25:41.552986] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-11-03T17:25:42.334907] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-11-03T17:25:42.747421] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:25:43.124169] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:25:43.134808] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-11. [2025-11-03T17:25:43.934853] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-11-03T17:25:44.111396] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T17:25:44.112307] [INFO ] [REMOTE ] AWP: Full fetch complete (31142 records). [2025-11-03T17:25:44.112376] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-11-03T17:25:44.479848] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-11-03T17:25:44.480014] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-11-03T17:25:44.480448] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-11-03T17:25:44.480509] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-11-03T17:25:44.481261] [DEBUG] [LOCAL ] AWP: Trimmed 31142 records to 21342 (keeping 200 days of data) [2025-11-03T17:25:44.603964] [DEBUG] [LOCAL ] AWP: Primary data saved (21342 records). [2025-11-03T17:25:44.604085] [INFO ] [MAIN ] AWP: Full history saved. [2025-11-03T17:25:44.604160] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWP took 32.7s. Estimated remaining: 4h 49m 8s. Rate: 7.5 symbols/min [2025-11-03T17:25:44.746888] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-11-03T17:25:44.778871] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:25:44.825830] [DEBUG] [LOCAL ] AXP: Loaded 53860 existing records from primary storage. [2025-11-03T17:25:44.826131] [INFO ] [MAIN ] AXP: Loaded 53860 existing records. [2025-11-03T17:25:45.009690] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:25:45.016091] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-11-03T17:25:45.026664] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-11-03T17:25:45.027822] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T17:25:45.034267] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-11-03T17:25:45.034784] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-11-03T17:25:45.384973] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:45.534835] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-11-03T17:25:45.621906] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T17:25:46.334910] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-11-03T17:25:47.134869] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-11-03T17:25:47.173625] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T17:25:47.325862] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T17:25:47.934903] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-11-03T17:25:48.518315] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T17:25:48.734846] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-11-03T17:25:48.810279] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T17:25:49.534906] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-11-03T17:25:50.192524] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T17:25:50.334833] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-11-03T17:25:51.015307] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-11-03T17:25:51.134855] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-11. [2025-11-03T17:25:51.715950] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T17:25:51.934850] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-11-03T17:25:52.487566] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T17:25:52.488600] [INFO ] [REMOTE ] AWR: Full fetch complete (32680 records). [2025-11-03T17:25:52.488712] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-11-03T17:25:52.743209] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-11-03T17:25:52.853446] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-11-03T17:25:52.853525] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-11-03T17:25:52.853959] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-11-03T17:25:52.854021] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-11-03T17:25:52.854932] [DEBUG] [LOCAL ] AWR: Trimmed 32680 records to 22506 (keeping 200 days of data) [2025-11-03T17:25:52.985289] [DEBUG] [LOCAL ] AWR: Primary data saved (22506 records). [2025-11-03T17:25:52.985409] [INFO ] [MAIN ] AWR: Full history saved. [2025-11-03T17:25:52.985477] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AWR took 30.3s. Estimated remaining: 4h 49m 5s. Rate: 7.5 symbols/min [2025-11-03T17:25:53.160436] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:25:53.164486] [DEBUG] [LOCAL ] AXR: Loaded 2769 existing records from primary storage. [2025-11-03T17:25:53.164636] [INFO ] [MAIN ] AXR: Loaded 2769 existing records. [2025-11-03T17:25:53.349466] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:25:53.349875] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-11-03T17:25:53.350050] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-11-03T17:25:53.350390] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-11-03T17:25:53.350474] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-11-03T17:25:53.474606] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-11-03T17:25:53.536327] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-11-03T17:25:53.742161] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:25:54.334826] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-11-03T17:25:54.423340] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-11-03T17:25:54.736237] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T17:25:55.134824] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-11-03T17:25:55.329492] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T17:25:55.934866] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-11-03T17:25:56.417550] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T17:25:56.734833] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-11-03T17:25:56.811807] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-11-03T17:25:57.109147] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T17:25:57.534850] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-11-03T17:25:58.334855] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-11-03T17:25:58.726595] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-11-03T17:25:58.817325] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T17:25:59.134839] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-11-03T17:25:59.939107] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-11-03T17:25:59.941596] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T17:26:00.374188] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T17:26:00.734874] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-11-03T17:26:01.534924] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-11-03T17:26:01.599677] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T17:26:01.885692] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-11-03T17:26:02.334892] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-11-03T17:26:02.721892] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T17:26:03.134865] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-11-03T17:26:03.934858] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-11-03T17:26:04.519369] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T17:26:04.734910] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-11-03T17:26:04.828246] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T17:26:05.114700] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-11-03T17:26:05.534905] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-11-03T17:26:05.916279] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-11-03T17:26:06.334921] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-11-03T17:26:07.134845] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-11-03T17:26:07.813535] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T17:26:07.934824] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-11-03T17:26:08.056374] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T17:26:08.422716] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T17:26:08.734844] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-11-03T17:26:09.534857] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-11. [2025-11-03T17:26:10.323091] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T17:26:10.334803] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-11-03T17:26:10.624779] [DEBUG] [REMOTE ] AXL: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:26:10.625108] [WARN ] [REMOTE ] AXL: No data returned for month 2025-11 [2025-11-03T17:26:10.625197] [FATAL] [REMOTE ] AXL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:26:10.625279] [FATAL] [MAIN ] AXL: Failed to fetch primary data. [2025-11-03T17:26:10.625342] [WARN ] [MAIN ] AXL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:26:10.625415] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-11-03T17:26:10.625480] [DEBUG] [LOCAL ] AXL: No primary data file found to delete. [2025-11-03T17:26:10.625535] [INFO ] [LOCAL ] AXL: Starting deletion of derivative data. [2025-11-03T17:26:10.625735] [DEBUG] [LOCAL ] AXL: Deleted derivative data file. [2025-11-03T17:26:10.625820] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AXL took 34.5s. Estimated remaining: 4h 50m 44s. Rate: 7.5 symbols/min [2025-11-03T17:26:10.804892] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:10.840934] [DEBUG] [LOCAL ] AXS: Loaded 39401 existing records from primary storage. [2025-11-03T17:26:10.841219] [INFO ] [MAIN ] AXS: Loaded 39401 existing records. [2025-11-03T17:26:11.026695] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:26:11.026957] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-11-03T17:26:11.027023] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-11-03T17:26:11.027753] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-11-03T17:26:11.027812] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-11-03T17:26:11.140080] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-11-03T17:26:11.380623] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:11.596115] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-11-03T17:26:11.934837] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-11-03T17:26:12.049934] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-11-03T17:26:12.734905] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-11. [2025-11-03T17:26:13.156237] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T17:26:13.330848] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-11 (0.60 seconds). [2025-11-03T17:26:13.331477] [INFO ] [REMOTE ] AXR: Full fetch complete (4159 records). [2025-11-03T17:26:13.331545] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-11-03T17:26:13.540056] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-11-03T17:26:13.715233] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-11-03T17:26:13.715312] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-11-03T17:26:13.715435] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-11-03T17:26:13.715473] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-11-03T17:26:13.715833] [DEBUG] [LOCAL ] AXR: Trimmed 4159 records to 2720 (keeping 200 days of data) [2025-11-03T17:26:13.731181] [DEBUG] [LOCAL ] AXR: Primary data saved (2720 records). [2025-11-03T17:26:13.731246] [INFO ] [MAIN ] AXR: Full history saved. [2025-11-03T17:26:13.731313] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AXR took 20.7s. Estimated remaining: 4h 49m 42s. Rate: 7.5 symbols/min [2025-11-03T17:26:13.906723] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:13.906907] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-11-03T17:26:13.906982] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-11-03T17:26:13.907100] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-11-03T17:26:13.907145] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-11-03T17:26:13.907185] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-11-03T17:26:13.907216] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-11-03T17:26:14.274952] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:14.334819] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-11-03T17:26:14.595447] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-11-03T17:26:15.134848] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-11-03T17:26:15.319520] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T17:26:15.934960] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-11-03T17:26:16.508200] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:26:16.734849] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-11-03T17:26:17.049128] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T17:26:17.534865] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-11-03T17:26:17.934451] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-11-03T17:26:18.334917] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-11. [2025-11-03T17:26:19.068518] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-11-03T17:26:19.134833] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-11-03T17:26:19.716794] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-11 (1.38 seconds). [2025-11-03T17:26:19.717920] [INFO ] [REMOTE ] AX: Full fetch complete (41692 records). [2025-11-03T17:26:19.717990] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-11-03T17:26:19.944837] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-11-03T17:26:20.101674] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-11-03T17:26:20.101764] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-11-03T17:26:20.102282] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-11-03T17:26:20.102322] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-11-03T17:26:20.103231] [DEBUG] [LOCAL ] AX: Trimmed 41692 records to 27158 (keeping 200 days of data) [2025-11-03T17:26:20.265371] [DEBUG] [LOCAL ] AX: Primary data saved (27158 records). [2025-11-03T17:26:20.265470] [INFO ] [MAIN ] AX: Full history saved. [2025-11-03T17:26:20.265558] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AX took 46.2s. Estimated remaining: 4h 49m 17s. Rate: 7.5 symbols/min [2025-11-03T17:26:20.734884] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-11-03T17:26:21.054504] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-11-03T17:26:21.151797] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T17:26:21.534875] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-11-03T17:26:22.061375] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T17:26:22.334871] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-11-03T17:26:22.597343] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T17:26:23.134923] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-11-03T17:26:23.891436] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T17:26:23.934866] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-11-03T17:26:24.355528] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T17:26:24.734862] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-11-03T17:26:25.534985] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-11-03T17:26:25.873949] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-11-03T17:26:25.999082] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T17:26:26.334885] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-11. [2025-11-03T17:26:26.763455] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:26:27.134864] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-11-03T17:26:27.635732] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T17:26:27.637297] [INFO ] [REMOTE ] AXP: Full fetch complete (77059 records). [2025-11-03T17:26:27.637394] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-11-03T17:26:27.938356] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-11-03T17:26:28.035518] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-11-03T17:26:28.035592] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-11-03T17:26:28.036349] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-11-03T17:26:28.036418] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-11-03T17:26:28.037832] [DEBUG] [LOCAL ] AXP: Trimmed 77059 records to 53081 (keeping 200 days of data) [2025-11-03T17:26:28.384983] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T17:26:28.400379] [DEBUG] [LOCAL ] AXP: Primary data saved (53081 records). [2025-11-03T17:26:28.400487] [INFO ] [MAIN ] AXP: Full history saved. [2025-11-03T17:26:28.401310] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXP took 43.8s. Estimated remaining: 4h 49m 11s. Rate: 7.5 symbols/min [2025-11-03T17:26:28.734839] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-11-03T17:26:29.468509] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-11-03T17:26:29.534819] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-11-03T17:26:29.857005] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T17:26:30.334838] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-11-03T17:26:30.714326] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T17:26:31.134867] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-11-03T17:26:31.394031] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T17:26:31.934908] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-11-03T17:26:32.527351] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:26:32.734849] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-11-03T17:26:33.277305] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-11-03T17:26:33.534855] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-11. [2025-11-03T17:26:33.983823] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:26:34.334935] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-11-03T17:26:35.236820] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-11 (1.70 seconds). [2025-11-03T17:26:35.238134] [INFO ] [REMOTE ] AXS: Full fetch complete (56562 records). [2025-11-03T17:26:35.238212] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-11-03T17:26:35.644183] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-11-03T17:26:35.644273] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-11-03T17:26:35.644895] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-11-03T17:26:35.644956] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-11-03T17:26:35.646073] [DEBUG] [LOCAL ] AXS: Trimmed 56562 records to 38961 (keeping 200 days of data) [2025-11-03T17:26:35.907757] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T17:26:35.923216] [DEBUG] [LOCAL ] AXS: Primary data saved (38961 records). [2025-11-03T17:26:35.923439] [INFO ] [MAIN ] AXS: Full history saved. [2025-11-03T17:26:35.923525] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 25.3s. Estimated remaining: 4h 48m 58s. Rate: 7.5 symbols/min [2025-11-03T17:26:35.924098] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-11. [2025-11-03T17:26:37.696596] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-11 (1.77 seconds). [2025-11-03T17:26:37.698394] [INFO ] [REMOTE ] AXTA: Full fetch complete (75661 records). [2025-11-03T17:26:37.698493] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-11-03T17:26:38.118253] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-11-03T17:26:38.118334] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-11-03T17:26:38.119107] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-11-03T17:26:38.119169] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-11-03T17:26:38.120503] [DEBUG] [LOCAL ] AXTA: Trimmed 75661 records to 52358 (keeping 200 days of data) [2025-11-03T17:26:38.410696] [DEBUG] [LOCAL ] AXTA: Primary data saved (52358 records). [2025-11-03T17:26:38.410792] [INFO ] [MAIN ] AXTA: Full history saved. [2025-11-03T17:26:38.410858] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 24.7s. Estimated remaining: 4h 47m 50s. Rate: 7.5 symbols/min [2025-11-03T17:26:38.953049] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:39.054430] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:39.005725] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-11-03T17:26:39.091245] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:39.074355] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-11-03T17:26:39.116780] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-11-03T17:26:39.120243] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:39.120496] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-11-03T17:26:39.120712] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-11-03T17:26:39.120909] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-11-03T17:26:39.244076] [DEBUG] [LOCAL ] AZO: Loaded 10763 existing records from primary storage. [2025-11-03T17:26:39.252912] [INFO ] [MAIN ] AZO: Loaded 10763 existing records. [2025-11-03T17:26:39.370274] [DEBUG] [LOCAL ] AYI: Loaded 23591 existing records from primary storage. [2025-11-03T17:26:39.400446] [DEBUG] [LOCAL ] AZZ: Loaded 23251 existing records from primary storage. [2025-11-03T17:26:39.416503] [INFO ] [MAIN ] AYI: Loaded 23591 existing records. [2025-11-03T17:26:39.427497] [INFO ] [MAIN ] AZZ: Loaded 23251 existing records. [2025-11-03T17:26:39.892170] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:39.962329] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-11-03T17:26:40.052465] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:26:40.105073] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:26:40.101256] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-11-03T17:26:40.108353] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-11-03T17:26:40.108024] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:26:40.108510] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-11-03T17:26:40.108735] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-11-03T17:26:40.108908] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-11-03T17:26:40.109011] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-11-03T17:26:40.109091] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-11-03T17:26:40.108830] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-11-03T17:26:40.158067] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-11-03T17:26:40.169854] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-11-03T17:26:40.158019] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-11-03T17:26:40.197569] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-11-03T17:26:41.096616] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:41.149299] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-11-03T17:26:41.171599] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:41.199119] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-11-03T17:26:41.269350] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:41.270848] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T17:26:41.271130] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-11-03T17:26:41.277985] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-11-03T17:26:41.431112] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:26:41.431358] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-11-03T17:26:41.431447] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:26:41.431563] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-11-03T17:26:41.431634] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:26:41.431728] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-11-03T17:26:41.431789] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-11-03T17:26:41.431824] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-11-03T17:26:41.431863] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-11-03T17:26:41.431910] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.0s. Estimated remaining: 4h 46m 49s. Rate: 7.5 symbols/min [2025-11-03T17:26:41.599814] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:26:41.653426] [DEBUG] [LOCAL ] BA: Loaded 54570 existing records from primary storage. [2025-11-03T17:26:41.653803] [INFO ] [MAIN ] BA: Loaded 54570 existing records. [2025-11-03T17:26:41.849816] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T17:26:41.853710] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:26:41.856900] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-11-03T17:26:41.857284] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-11-03T17:26:41.857986] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-11-03T17:26:41.858897] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-11-03T17:26:41.858956] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-11-03T17:26:42.228510] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:26:42.239434] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-11-03T17:26:42.241356] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T17:26:42.245918] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-11-03T17:26:42.442398] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T17:26:42.449157] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-11-03T17:26:42.573957] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T17:26:43.022914] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T17:26:43.134862] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-11-03T17:26:43.193216] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T17:26:43.875803] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T17:26:43.934849] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-11-03T17:26:44.331160] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-11-03T17:26:44.734919] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-11-03T17:26:44.810916] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-11-03T17:26:45.534899] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-11-03T17:26:46.334917] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-11-03T17:26:46.619005] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T17:26:46.662471] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-11-03T17:26:47.058091] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T17:26:47.134940] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-11-03T17:26:47.847341] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-11-03T17:26:47.934941] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-11-03T17:26:48.727157] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-11-03T17:26:48.734815] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-11-03T17:26:49.534845] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-11-03T17:26:49.557370] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T17:26:50.182199] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T17:26:50.334887] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-11-03T17:26:50.954179] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T17:26:51.134887] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-11-03T17:26:51.934928] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-11-03T17:26:52.734838] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-11-03T17:26:52.783611] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-11-03T17:26:52.828140] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-11-03T17:26:53.534866] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-11-03T17:26:53.658423] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T17:26:54.334979] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-11-03T17:26:54.889836] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-11-03T17:26:55.134877] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-11-03T17:26:55.667071] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-11-03T17:26:55.775239] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T17:26:55.934903] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-11-03T17:26:56.657474] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T17:26:56.734871] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-11-03T17:26:57.534870] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-11-03T17:26:57.776262] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:26:58.334944] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-11-03T17:26:59.129357] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T17:26:59.134983] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-11-03T17:26:59.502462] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-11-03T17:26:59.934851] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-11-03T17:27:00.051487] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T17:27:00.734832] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-11-03T17:27:00.752339] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-11-03T17:27:01.534914] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-11-03T17:27:01.591124] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T17:27:02.334847] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-11. [2025-11-03T17:27:02.450583] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T17:27:03.134877] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-11-03T17:27:03.455210] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T17:27:03.456826] [INFO ] [REMOTE ] AZO: Full fetch complete (16389 records). [2025-11-03T17:27:03.456961] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-11-03T17:27:03.903006] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-11-03T17:27:03.903107] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-11-03T17:27:03.903535] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-11-03T17:27:03.903597] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-11-03T17:27:03.904276] [DEBUG] [LOCAL ] AZO: Trimmed 16389 records to 10956 (keeping 200 days of data) [2025-11-03T17:27:03.940028] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-11-03T17:27:03.976998] [DEBUG] [LOCAL ] AZO: Primary data saved (10956 records). [2025-11-03T17:27:03.977165] [INFO ] [MAIN ] AZO: Full history saved. [2025-11-03T17:27:03.977251] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AZO took 25.6s. Estimated remaining: 4h 49m 17s. Rate: 7.5 symbols/min [2025-11-03T17:27:04.154742] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:04.206333] [DEBUG] [LOCAL ] BABA: Loaded 54600 existing records from primary storage. [2025-11-03T17:27:04.206638] [INFO ] [MAIN ] BABA: Loaded 54600 existing records. [2025-11-03T17:27:04.382975] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:27:04.383175] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-11-03T17:27:04.383220] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-11-03T17:27:04.384097] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-11-03T17:27:04.384156] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-11-03T17:27:04.740765] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-11-03T17:27:04.746403] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:05.034094] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T17:27:05.128301] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-11-03T17:27:05.534882] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-11-03T17:27:05.914528] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-11-03T17:27:06.334829] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-11-03T17:27:06.400452] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T17:27:07.134867] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-11. [2025-11-03T17:27:07.934959] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-11-03T17:27:08.638568] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-11-03T17:27:08.734481] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-11 (1.60 seconds). [2025-11-03T17:27:08.735522] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-11-03T17:27:08.736495] [INFO ] [REMOTE ] AZZ: Full fetch complete (32203 records). [2025-11-03T17:27:08.736579] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-11-03T17:27:09.124113] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-11-03T17:27:09.124229] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-11-03T17:27:09.124685] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-11-03T17:27:09.124749] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-11-03T17:27:09.125632] [DEBUG] [LOCAL ] AZZ: Trimmed 32203 records to 22960 (keeping 200 days of data) [2025-11-03T17:27:09.266340] [DEBUG] [LOCAL ] AZZ: Primary data saved (22960 records). [2025-11-03T17:27:09.266464] [INFO ] [MAIN ] AZZ: Full history saved. [2025-11-03T17:27:09.266543] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AZZ took 30.8s. Estimated remaining: 4h 48m 40s. Rate: 7.5 symbols/min [2025-11-03T17:27:09.435911] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:09.482431] [DEBUG] [LOCAL ] BAC: Loaded 54588 existing records from primary storage. [2025-11-03T17:27:09.482813] [INFO ] [MAIN ] BAC: Loaded 54588 existing records. [2025-11-03T17:27:09.547000] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-11-03T17:27:09.669396] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:27:09.669687] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-11-03T17:27:09.669745] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-11-03T17:27:09.670613] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-11-03T17:27:09.670708] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-11-03T17:27:10.053351] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:10.086441] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-11-03T17:27:10.334853] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-11-03T17:27:10.473363] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T17:27:10.914357] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-11-03T17:27:11.134854] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-11-03T17:27:11.934900] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-11. [2025-11-03T17:27:12.410359] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-11-03T17:27:12.734909] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-11-03T17:27:13.205104] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-11 (1.27 seconds). [2025-11-03T17:27:13.206286] [INFO ] [REMOTE ] AYI: Full fetch complete (35854 records). [2025-11-03T17:27:13.206369] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-11-03T17:27:13.539972] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-11-03T17:27:13.612672] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-11-03T17:27:13.612897] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-11-03T17:27:13.613436] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-11-03T17:27:13.613673] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-11-03T17:27:13.614936] [DEBUG] [LOCAL ] AYI: Trimmed 35854 records to 23197 (keeping 200 days of data) [2025-11-03T17:27:13.762557] [DEBUG] [LOCAL ] AYI: Primary data saved (23197 records). [2025-11-03T17:27:13.762806] [INFO ] [MAIN ] AYI: Full history saved. [2025-11-03T17:27:13.762923] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. AYI took 35.4s. Estimated remaining: 4h 47m 55s. Rate: 7.5 symbols/min [2025-11-03T17:27:13.946535] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-11-03T17:27:13.974364] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:14.024088] [DEBUG] [LOCAL ] BAH: Loaded 52419 existing records from primary storage. [2025-11-03T17:27:14.024466] [INFO ] [MAIN ] BAH: Loaded 52419 existing records. [2025-11-03T17:27:14.198621] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:27:14.198860] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-11-03T17:27:14.198906] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-11-03T17:27:14.199821] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-11-03T17:27:14.199879] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-11-03T17:27:14.341846] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-11-03T17:27:14.584087] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:14.622538] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-11-03T17:27:15.134871] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-11-03T17:27:15.894128] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-11-03T17:27:15.934870] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-11-03T17:27:16.731679] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-11-03T17:27:16.742251] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-11-03T17:27:17.081043] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-11-03T17:27:17.534843] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-11-03T17:27:18.263823] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T17:27:18.345350] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-11-03T17:27:18.351448] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (2.42 seconds). [2025-11-03T17:27:19.134962] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-11-03T17:27:19.624556] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-11-03T17:27:19.934905] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-11-03T17:27:20.306061] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:27:20.734847] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-11-03T17:27:20.836761] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-11-03T17:27:21.534876] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-11-03T17:27:21.837017] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-11-03T17:27:22.122266] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T17:27:22.334888] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-11-03T17:27:23.134877] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-11. [2025-11-03T17:27:23.591525] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T17:27:23.820942] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-11-03T17:27:23.934879] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-11-03T17:27:24.734866] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-11-03T17:27:24.892943] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-11 (1.76 seconds). [2025-11-03T17:27:24.894908] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-11-03T17:27:24.895035] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-11-03T17:27:25.309822] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-11-03T17:27:25.309957] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-11-03T17:27:25.311289] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-11-03T17:27:25.311367] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-11-03T17:27:25.313632] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-11-03T17:27:25.535501] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-11-03T17:27:25.670576] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-11-03T17:27:25.670797] [INFO ] [MAIN ] BA: Full history saved. [2025-11-03T17:27:25.672003] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 44.2s. Estimated remaining: 4h 48m 28s. Rate: 7.5 symbols/min [2025-11-03T17:27:25.850100] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:25.850381] [DEBUG] [LOCAL ] BAK: No existing data file found in primary storage. [2025-11-03T17:27:25.850434] [WARN ] [MAIN ] BAK: No existing data found, performing full refresh instead. [2025-11-03T17:27:25.850554] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-11-03T17:27:25.850596] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-11-03T17:27:25.850639] [DEBUG] [LOCAL ] BAK: No primary data file found to delete. [2025-11-03T17:27:25.850718] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-11-03T17:27:26.260405] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:26.299397] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-11-03T17:27:26.341326] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-11-03T17:27:26.357675] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-11-03T17:27:27.134865] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-11-03T17:27:27.486859] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-11-03T17:27:27.934869] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-11-03T17:27:28.320036] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-11-03T17:27:28.425402] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T17:27:28.734859] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-11-03T17:27:29.060496] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T17:27:29.534859] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-11-03T17:27:30.334920] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-11-03T17:27:30.932078] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-11-03T17:27:31.134830] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-11-03T17:27:31.233663] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-11-03T17:27:31.282763] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T17:27:31.934871] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-11-03T17:27:32.432608] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T17:27:32.734841] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-11-03T17:27:33.534862] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-11-03T17:27:33.986556] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T17:27:34.181069] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-11-03T17:27:34.334828] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-11-03T17:27:34.511007] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T17:27:35.134866] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-11-03T17:27:35.934863] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-11-03T17:27:36.251114] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-11-03T17:27:36.317389] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T17:27:36.734874] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-11-03T17:27:36.824095] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:27:37.534888] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-11-03T17:27:38.208344] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-11-03T17:27:38.334881] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-11. [2025-11-03T17:27:39.134827] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-11. [2025-11-03T17:27:39.365005] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-11-03T17:27:39.934888] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-11-03T17:27:40.549561] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-11 (2.21 seconds). [2025-11-03T17:27:40.551066] [INFO ] [REMOTE ] BAH: Full fetch complete (75353 records). [2025-11-03T17:27:40.551167] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-11-03T17:27:40.744283] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-11-03T17:27:40.968027] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-11-03T17:27:40.968153] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-11-03T17:27:40.969224] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-11-03T17:27:40.969316] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-11-03T17:27:40.971301] [DEBUG] [LOCAL ] BAH: Trimmed 75353 records to 51681 (keeping 200 days of data) [2025-11-03T17:27:41.051950] [DEBUG] [REMOTE ] BABA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:27:41.087812] [WARN ] [REMOTE ] BABA: No data returned for month 2025-11 [2025-11-03T17:27:41.092488] [FATAL] [REMOTE ] BABA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:27:41.104254] [FATAL] [MAIN ] BABA: Failed to fetch primary data. [2025-11-03T17:27:41.106461] [WARN ] [MAIN ] BABA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:27:41.116350] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-11-03T17:27:41.135789] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-11-03T17:27:41.135906] [INFO ] [LOCAL ] BABA: Starting deletion of derivative data. [2025-11-03T17:27:41.136172] [DEBUG] [LOCAL ] BABA: Deleted derivative data file. [2025-11-03T17:27:41.137267] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. BABA took 37.2s. Estimated remaining: 4h 49m 38s. Rate: 7.5 symbols/min [2025-11-03T17:27:41.555888] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:41.684836] [DEBUG] [LOCAL ] BAH: Primary data saved (51681 records). [2025-11-03T17:27:41.685366] [INFO ] [MAIN ] BAH: Full history saved. [2025-11-03T17:27:41.686415] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAH took 27.9s. Estimated remaining: 4h 48m 12s. Rate: 7.5 symbols/min [2025-11-03T17:27:41.913606] [DEBUG] [LOCAL ] BALL: Loaded 52668 existing records from primary storage. [2025-11-03T17:27:41.941101] [INFO ] [MAIN ] BALL: Loaded 52668 existing records. [2025-11-03T17:27:42.115550] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:42.117982] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-11-03T17:27:42.126590] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-11-03T17:27:42.158594] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-11-03T17:27:42.159047] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-11-03T17:27:42.164303] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-11-03T17:27:42.167362] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-11-03T17:27:42.167760] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-11-03T17:27:42.195058] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-11-03T17:27:42.268691] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:27:42.284666] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-11-03T17:27:42.303587] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-11-03T17:27:42.350435] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-11-03T17:27:42.350592] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-11-03T17:27:42.558484] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-11-03T17:27:42.788175] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-11-03T17:27:43.001089] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:43.024698] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:43.134874] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-11-03T17:27:43.935697] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-11-03T17:27:43.941389] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T17:27:44.189761] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T17:27:44.246551] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-11-03T17:27:44.734864] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-11-03T17:27:45.195016] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T17:27:45.298356] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T17:27:45.534853] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-11-03T17:27:46.045684] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T17:27:46.334876] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-11. [2025-11-03T17:27:47.134850] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-11-03T17:27:47.698876] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-11-03T17:27:47.934880] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-11-03T17:27:48.010332] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-11 (1.68 seconds). [2025-11-03T17:27:48.012122] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-11-03T17:27:48.012241] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-11-03T17:27:48.405499] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-11-03T17:27:48.405633] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-11-03T17:27:48.406469] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-11-03T17:27:48.406518] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-11-03T17:27:48.408000] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-11-03T17:27:48.724976] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-11-03T17:27:48.725107] [INFO ] [MAIN ] BAC: Full history saved. [2025-11-03T17:27:48.725182] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAC took 39.5s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-11-03T17:27:48.740112] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-11-03T17:27:48.894792] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:27:48.941139] [DEBUG] [LOCAL ] BAM: Loaded 52839 existing records from primary storage. [2025-11-03T17:27:48.941452] [INFO ] [MAIN ] BAM: Loaded 52839 existing records. [2025-11-03T17:27:49.119951] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:27:49.120331] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-11-03T17:27:49.120438] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-11-03T17:27:49.121392] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-11-03T17:27:49.121453] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-11-03T17:27:49.428483] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T17:27:49.559960] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-11-03T17:27:49.566465] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:27:50.016614] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T17:27:50.334850] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-11-03T17:27:50.830377] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:27:50.907820] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T17:27:51.134853] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-11-03T17:27:51.661032] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T17:27:51.934878] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-11-03T17:27:52.734893] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-11-03T17:27:53.293624] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T17:27:53.534861] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-11-03T17:27:53.872143] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T17:27:54.184224] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T17:27:54.334918] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-11-03T17:27:55.134871] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-11-03T17:27:55.530080] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T17:27:55.721714] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T17:27:55.934919] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-11-03T17:27:56.734871] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-11-03T17:27:57.047961] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T17:27:57.235058] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-11-03T17:27:57.534875] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-11-03T17:27:58.334896] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-11-03T17:27:58.849083] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T17:27:59.134885] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-11-03T17:27:59.407573] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T17:27:59.934896] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-11-03T17:28:00.362778] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T17:28:00.734865] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-11-03T17:28:01.166799] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T17:28:01.427522] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T17:28:01.534884] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-11. [2025-11-03T17:28:02.334983] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-11-03T17:28:02.549756] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T17:28:02.550726] [INFO ] [REMOTE ] BALY: Full fetch complete (15605 records). [2025-11-03T17:28:02.550796] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-11-03T17:28:02.738941] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-11-03T17:28:02.739269] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-11-03T17:28:02.739341] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-11-03T17:28:02.739391] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-11-03T17:28:02.739448] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-11-03T17:28:02.739484] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-11-03T17:28:02.739523] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-11-03T17:28:02.739582] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BALY took 21.1s. Estimated remaining: 4h 48m 48s. Rate: 7.5 symbols/min [2025-11-03T17:28:02.912619] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:02.962507] [DEBUG] [LOCAL ] BANC: Loaded 52147 existing records from primary storage. [2025-11-03T17:28:02.962839] [INFO ] [MAIN ] BANC: Loaded 52147 existing records. [2025-11-03T17:28:03.142860] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-11-03T17:28:03.148773] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:03.149026] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-11-03T17:28:03.149219] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-11-03T17:28:03.150704] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-11-03T17:28:03.150764] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-11-03T17:28:03.533814] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:03.573892] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:28:03.934892] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-11. [2025-11-03T17:28:04.639721] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T17:28:04.734862] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-11-03T17:28:05.534858] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-11-03T17:28:05.602708] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T17:28:05.604104] [INFO ] [REMOTE ] BAK: Full fetch complete (56710 records). [2025-11-03T17:28:05.604209] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-11-03T17:28:06.011065] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-11-03T17:28:06.011180] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-11-03T17:28:06.012000] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-11-03T17:28:06.012080] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-11-03T17:28:06.013586] [DEBUG] [LOCAL ] BAK: Trimmed 56710 records to 39069 (keeping 200 days of data) [2025-11-03T17:28:06.144805] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:28:06.283261] [DEBUG] [LOCAL ] BAK: Primary data saved (39069 records). [2025-11-03T17:28:06.283395] [INFO ] [MAIN ] BAK: Full history saved. [2025-11-03T17:28:06.283465] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BAK took 40.6s. Estimated remaining: 4h 47m 54s. Rate: 7.5 symbols/min [2025-11-03T17:28:06.346719] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-11-03T17:28:06.454011] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:06.476687] [DEBUG] [LOCAL ] BAP: Loaded 25327 existing records from primary storage. [2025-11-03T17:28:06.476938] [INFO ] [MAIN ] BAP: Loaded 25327 existing records. [2025-11-03T17:28:06.654274] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:06.654524] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-11-03T17:28:06.654583] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-11-03T17:28:06.655206] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-11-03T17:28:06.655266] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-11-03T17:28:07.018760] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:07.049006] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T17:28:07.134818] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-11-03T17:28:07.704311] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T17:28:07.934848] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-11-03T17:28:08.292115] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T17:28:08.734849] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-11-03T17:28:09.341553] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T17:28:09.534845] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-11. [2025-11-03T17:28:09.759106] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:28:10.334858] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-11-03T17:28:10.852239] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T17:28:10.853748] [INFO ] [REMOTE ] BALL: Full fetch complete (75628 records). [2025-11-03T17:28:10.853837] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-11-03T17:28:11.145082] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-11-03T17:28:11.247360] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-11-03T17:28:11.247442] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-11-03T17:28:11.248250] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-11-03T17:28:11.248314] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-11-03T17:28:11.249746] [DEBUG] [LOCAL ] BALL: Trimmed 75628 records to 51934 (keeping 200 days of data) [2025-11-03T17:28:11.553070] [DEBUG] [LOCAL ] BALL: Primary data saved (51934 records). [2025-11-03T17:28:11.553186] [INFO ] [MAIN ] BALL: Full history saved. [2025-11-03T17:28:11.553914] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALL took 30.4s. Estimated remaining: 4h 47m 18s. Rate: 7.5 symbols/min [2025-11-03T17:28:11.734813] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:11.775300] [DEBUG] [LOCAL ] BARK: Loaded 38709 existing records from primary storage. [2025-11-03T17:28:11.775685] [INFO ] [MAIN ] BARK: Loaded 38709 existing records. [2025-11-03T17:28:11.937054] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-11-03T17:28:12.033818] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:12.034112] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-11-03T17:28:12.034218] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-11-03T17:28:12.036741] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-11-03T17:28:12.036884] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-11-03T17:28:12.036690] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-11-03T17:28:12.400505] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:12.557067] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:28:12.734840] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-11-03T17:28:12.941968] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T17:28:13.534902] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-11-03T17:28:14.020024] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T17:28:14.334864] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-11-03T17:28:14.947297] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T17:28:15.134828] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-11-03T17:28:15.585398] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T17:28:15.934836] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-11-03T17:28:16.183432] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T17:28:16.734845] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-11-03T17:28:17.055004] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:28:17.534867] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-11-03T17:28:18.245786] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T17:28:18.334887] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-11-03T17:28:18.494702] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T17:28:19.135070] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-11-03T17:28:19.351841] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:28:19.934895] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-11-03T17:28:20.013839] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T17:28:20.734910] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-11-03T17:28:21.065432] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T17:28:21.534896] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-11-03T17:28:22.141883] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T17:28:22.334933] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-11-03T17:28:22.869485] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:28:23.134839] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-11-03T17:28:23.205514] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T17:28:23.934918] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-11-03T17:28:24.111815] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-11-03T17:28:24.734982] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-11-03T17:28:25.032922] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T17:28:25.534911] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-11-03T17:28:25.683892] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T17:28:26.334866] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-11-03T17:28:26.774826] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T17:28:27.134932] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-11-03T17:28:27.693560] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T17:28:27.934875] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-11-03T17:28:28.637871] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T17:28:28.734817] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-11-03T17:28:28.803491] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T17:28:29.534887] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-11-03T17:28:30.339937] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-11-03T17:28:30.365391] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-11-03T17:28:30.851214] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:28:31.134829] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-11-03T17:28:31.173120] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T17:28:31.934878] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-11-03T17:28:32.414098] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:28:32.734830] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-11. [2025-11-03T17:28:32.841951] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T17:28:33.534926] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-11-03T17:28:34.334887] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-11-03T17:28:34.536569] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-11 (1.80 seconds). [2025-11-03T17:28:34.538270] [INFO ] [REMOTE ] BANC: Full fetch complete (74684 records). [2025-11-03T17:28:34.538548] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-11-03T17:28:34.952571] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-11-03T17:28:34.952787] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-11-03T17:28:34.953674] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-11-03T17:28:34.953773] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-11-03T17:28:34.978699] [DEBUG] [LOCAL ] BANC: Trimmed 74684 records to 51372 (keeping 200 days of data) [2025-11-03T17:28:34.980541] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-11-03T17:28:35.182392] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-11-03T17:28:35.197780] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T17:28:35.344990] [DEBUG] [LOCAL ] BANC: Primary data saved (51372 records). [2025-11-03T17:28:35.345157] [INFO ] [MAIN ] BANC: Full history saved. [2025-11-03T17:28:35.346099] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BANC took 32.6s. Estimated remaining: 4h 49m 50s. Rate: 7.4 symbols/min [2025-11-03T17:28:35.519670] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:35.570376] [DEBUG] [LOCAL ] BAX: Loaded 54316 existing records from primary storage. [2025-11-03T17:28:35.570744] [INFO ] [MAIN ] BAX: Loaded 54316 existing records. [2025-11-03T17:28:35.797242] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:35.797478] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-11-03T17:28:35.797542] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-11-03T17:28:35.798611] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-11-03T17:28:35.798702] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-11-03T17:28:35.940217] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-11. [2025-11-03T17:28:36.206742] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:36.734824] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-11-03T17:28:36.835347] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-11-03T17:28:37.478367] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-11 (1.54 seconds). [2025-11-03T17:28:37.479525] [INFO ] [REMOTE ] BAP: Full fetch complete (37153 records). [2025-11-03T17:28:37.479599] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-11-03T17:28:37.545205] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-11-03T17:28:37.879874] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-11-03T17:28:37.879976] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-11-03T17:28:37.880432] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-11-03T17:28:37.880471] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-11-03T17:28:37.881397] [DEBUG] [LOCAL ] BAP: Trimmed 37153 records to 25020 (keeping 200 days of data) [2025-11-03T17:28:38.026634] [DEBUG] [LOCAL ] BAP: Primary data saved (25020 records). [2025-11-03T17:28:38.026785] [INFO ] [MAIN ] BAP: Full history saved. [2025-11-03T17:28:38.026881] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAP took 31.7s. Estimated remaining: 4h 48m 48s. Rate: 7.5 symbols/min [2025-11-03T17:28:38.220384] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:38.252546] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T17:28:38.301909] [DEBUG] [LOCAL ] BB: Loaded 53623 existing records from primary storage. [2025-11-03T17:28:38.302214] [INFO ] [MAIN ] BB: Loaded 53623 existing records. [2025-11-03T17:28:38.344078] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-11-03T17:28:38.480116] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:38.480675] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-11-03T17:28:38.480740] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-11-03T17:28:38.481613] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-11-03T17:28:38.481707] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-11-03T17:28:38.924553] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:38.927364] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T17:28:39.134871] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-11. [2025-11-03T17:28:39.577101] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T17:28:39.934852] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-11-03T17:28:40.734953] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-11-03T17:28:41.132868] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-11 (2.00 seconds). [2025-11-03T17:28:41.134480] [INFO ] [REMOTE ] BAM: Full fetch complete (75452 records). [2025-11-03T17:28:41.134615] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-11-03T17:28:41.543936] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-11-03T17:28:41.547631] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-11-03T17:28:41.548737] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-11-03T17:28:41.549599] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-11-03T17:28:41.549987] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-11-03T17:28:41.586953] [DEBUG] [LOCAL ] BAM: Trimmed 75452 records to 52094 (keeping 200 days of data) [2025-11-03T17:28:41.586797] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-11-03T17:28:41.850352] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T17:28:41.933360] [DEBUG] [LOCAL ] BAM: Primary data saved (52094 records). [2025-11-03T17:28:41.933481] [INFO ] [MAIN ] BAM: Full history saved. [2025-11-03T17:28:41.933555] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BAM took 53.2s. Estimated remaining: 4h 47m 58s. Rate: 7.5 symbols/min [2025-11-03T17:28:42.100768] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:42.147160] [DEBUG] [LOCAL ] BBAI: Loaded 54600 existing records from primary storage. [2025-11-03T17:28:42.147464] [INFO ] [MAIN ] BBAI: Loaded 54600 existing records. [2025-11-03T17:28:42.323913] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:42.324139] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-11-03T17:28:42.324206] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-11-03T17:28:42.325115] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-11-03T17:28:42.325176] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-11-03T17:28:42.339966] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-11-03T17:28:42.682789] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:42.923949] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:28:43.134847] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-11-03T17:28:43.939954] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-11-03T17:28:43.953742] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-11-03T17:28:44.734863] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-11-03T17:28:45.190107] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-11-03T17:28:45.226829] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T17:28:45.534850] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-11. [2025-11-03T17:28:46.177001] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T17:28:46.334837] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-11-03T17:28:46.624702] [DEBUG] [REMOTE ] BARK: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:28:46.625009] [WARN ] [REMOTE ] BARK: No data returned for month 2025-11 [2025-11-03T17:28:46.625097] [FATAL] [REMOTE ] BARK: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:28:46.625174] [FATAL] [MAIN ] BARK: Failed to fetch primary data. [2025-11-03T17:28:46.625234] [WARN ] [MAIN ] BARK: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:28:46.625312] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-11-03T17:28:46.625393] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-11-03T17:28:46.625433] [INFO ] [LOCAL ] BARK: Starting deletion of derivative data. [2025-11-03T17:28:46.625624] [DEBUG] [LOCAL ] BARK: Deleted derivative data file. [2025-11-03T17:28:46.625734] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BARK took 35.1s. Estimated remaining: 4h 47m 17s. Rate: 7.5 symbols/min [2025-11-03T17:28:46.803121] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:28:46.841927] [DEBUG] [LOCAL ] BBAR: Loaded 43472 existing records from primary storage. [2025-11-03T17:28:46.842206] [INFO ] [MAIN ] BBAR: Loaded 43472 existing records. [2025-11-03T17:28:47.039108] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:28:47.039336] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-11-03T17:28:47.039385] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-11-03T17:28:47.040189] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-11-03T17:28:47.040248] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-11-03T17:28:47.140579] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-11-03T17:28:47.395463] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:28:47.934859] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-11-03T17:28:48.327961] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-11-03T17:28:48.668148] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T17:28:48.734876] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-11-03T17:28:49.285557] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:28:49.534917] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-11-03T17:28:50.334867] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-11-03T17:28:50.437633] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-11-03T17:28:50.963723] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T17:28:51.134853] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-11-03T17:28:51.934870] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-11-03T17:28:52.388573] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-11-03T17:28:52.736423] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-11-03T17:28:52.738952] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-11-03T17:28:53.227387] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T17:28:53.534911] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-11-03T17:28:54.134379] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T17:28:54.334850] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-11-03T17:28:55.134853] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-11-03T17:28:55.653480] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-11-03T17:28:55.934875] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-11-03T17:28:55.970855] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T17:28:56.548442] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T17:28:56.734879] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-11-03T17:28:57.534920] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-11-03T17:28:58.003324] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-11-03T17:28:58.057705] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:28:58.334839] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-11-03T17:28:58.987549] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T17:28:59.134839] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-11-03T17:28:59.934875] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-11-03T17:29:00.268659] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-11-03T17:29:00.734940] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-11-03T17:29:01.115624] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-11-03T17:29:01.203205] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T17:29:01.534875] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-11-03T17:29:02.334911] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-11-03T17:29:02.858253] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-11-03T17:29:03.134877] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-11-03T17:29:03.538994] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-11-03T17:29:03.645909] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T17:29:03.934876] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-11-03T17:29:04.734875] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-11. [2025-11-03T17:29:05.128165] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-11-03T17:29:05.534915] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-11-03T17:29:05.609502] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T17:29:06.334863] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-11-03T17:29:07.134927] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-11. [2025-11-03T17:29:07.367309] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-11 (2.63 seconds). [2025-11-03T17:29:07.368805] [INFO ] [REMOTE ] BB: Full fetch complete (76949 records). [2025-11-03T17:29:07.368905] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-11-03T17:29:07.766961] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-11-03T17:29:07.767132] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-11-03T17:29:07.768057] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-11-03T17:29:07.768226] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-11-03T17:29:07.777925] [DEBUG] [LOCAL ] BB: Trimmed 76949 records to 52846 (keeping 200 days of data) [2025-11-03T17:29:07.792400] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T17:29:07.913690] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-11-03T17:29:07.941660] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-11-03T17:29:08.140368] [DEBUG] [LOCAL ] BB: Primary data saved (52846 records). [2025-11-03T17:29:08.140508] [INFO ] [MAIN ] BB: Full history saved. [2025-11-03T17:29:08.141629] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BB took 30.1s. Estimated remaining: 4h 49m 23s. Rate: 7.4 symbols/min [2025-11-03T17:29:08.247638] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T17:29:08.265329] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-11-03T17:29:08.275800] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-11-03T17:29:08.364843] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:08.737635] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-11-03T17:29:08.764020] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-11-03T17:29:08.764168] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-11-03T17:29:08.765086] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-11-03T17:29:08.766372] [DEBUG] [LOCAL ] BBD: Loaded 54062 existing records from primary storage. [2025-11-03T17:29:08.766598] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-11-03T17:29:08.767112] [INFO ] [MAIN ] BBD: Loaded 54062 existing records. [2025-11-03T17:29:08.860620] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 53540 (keeping 200 days of data) [2025-11-03T17:29:09.049111] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:09.053445] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-11-03T17:29:09.060364] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-11-03T17:29:09.062433] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-11-03T17:29:09.062897] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-11-03T17:29:09.579923] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:09.580554] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-11-03T17:29:09.629362] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-11-03T17:29:09.725245] [DEBUG] [LOCAL ] BAX: Primary data saved (53540 records). [2025-11-03T17:29:09.725381] [INFO ] [MAIN ] BAX: Full history saved. [2025-11-03T17:29:09.725865] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BAX took 34.4s. Estimated remaining: 4h 48m 11s. Rate: 7.5 symbols/min [2025-11-03T17:29:09.897415] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:09.928456] [DEBUG] [LOCAL ] BBDC: Loaded 32700 existing records from primary storage. [2025-11-03T17:29:09.928755] [INFO ] [MAIN ] BBDC: Loaded 32700 existing records. [2025-11-03T17:29:10.104491] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:10.104729] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-11-03T17:29:10.104781] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-11-03T17:29:10.105338] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-11-03T17:29:10.105394] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-11-03T17:29:10.345398] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-11-03T17:29:10.464829] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:10.944220] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-11-03T17:29:10.992915] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T17:29:11.134858] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-11. [2025-11-03T17:29:11.569717] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:29:11.934865] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-11-03T17:29:12.734868] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-11-03T17:29:13.209835] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T17:29:13.534856] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-11-03T17:29:13.839431] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T17:29:14.334847] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-11-03T17:29:14.836622] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-11 (3.70 seconds). [2025-11-03T17:29:14.838243] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-11-03T17:29:14.838391] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-11-03T17:29:15.147118] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-11-03T17:29:15.184203] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-11-03T17:29:15.286017] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-11-03T17:29:15.286095] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-11-03T17:29:15.286887] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-11-03T17:29:15.286978] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-11-03T17:29:15.288435] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-11-03T17:29:15.413194] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T17:29:15.626536] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-11-03T17:29:15.626700] [INFO ] [MAIN ] BBAI: Full history saved. [2025-11-03T17:29:15.626789] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAI took 33.7s. Estimated remaining: 4h 47m 41s. Rate: 7.5 symbols/min [2025-11-03T17:29:15.796610] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:15.802802] [DEBUG] [LOCAL ] BBDO: Loaded 4962 existing records from primary storage. [2025-11-03T17:29:15.803039] [INFO ] [MAIN ] BBDO: Loaded 4962 existing records. [2025-11-03T17:29:15.942590] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-11-03T17:29:15.984582] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:15.984976] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-11-03T17:29:15.985042] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-11-03T17:29:15.985272] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-11-03T17:29:15.985331] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-11-03T17:29:16.349877] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:16.369698] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T17:29:16.734914] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-11-03T17:29:17.127886] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T17:29:17.534873] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-11-03T17:29:17.967590] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-11-03T17:29:18.322838] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T17:29:18.334812] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-11-03T17:29:19.134860] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-11-03T17:29:19.704701] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T17:29:19.934853] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-11-03T17:29:20.325827] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:29:20.734905] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-11-03T17:29:20.793813] [DEBUG] [REMOTE ] BBDC: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-11-03T17:29:20.794111] [WARN ] [REMOTE ] BBDC: No data returned for month 2025-04 [2025-11-03T17:29:20.794196] [FATAL] [REMOTE ] BBDC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:29:20.794273] [FATAL] [MAIN ] BBDC: Failed to fetch primary data. [2025-11-03T17:29:20.794333] [WARN ] [MAIN ] BBDC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:29:20.794404] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-11-03T17:29:20.794466] [DEBUG] [LOCAL ] BBDC: No primary data file found to delete. [2025-11-03T17:29:20.794500] [INFO ] [LOCAL ] BBDC: Starting deletion of derivative data. [2025-11-03T17:29:20.794670] [DEBUG] [LOCAL ] BBDC: Deleted derivative data file. [2025-11-03T17:29:20.794752] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBDC took 11.1s. Estimated remaining: 4h 47m 5s. Rate: 7.5 symbols/min [2025-11-03T17:29:20.961171] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:20.978710] [DEBUG] [LOCAL ] BBN: Loaded 17702 existing records from primary storage. [2025-11-03T17:29:20.978939] [INFO ] [MAIN ] BBN: Loaded 17702 existing records. [2025-11-03T17:29:21.156624] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:21.156818] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-11-03T17:29:21.156863] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-11-03T17:29:21.157294] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-11-03T17:29:21.157351] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-11-03T17:29:21.510575] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:21.537677] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-11-03T17:29:21.543892] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-11-03T17:29:21.979086] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T17:29:22.334860] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-11-03T17:29:23.134853] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-11-03T17:29:23.634358] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-11-03T17:29:23.792109] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T17:29:23.934874] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-11-03T17:29:24.435327] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T17:29:24.734852] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-11-03T17:29:25.534853] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-11-03T17:29:26.255538] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T17:29:26.334830] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-11-03T17:29:26.761106] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-11-03T17:29:26.844485] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T17:29:27.134839] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-11-03T17:29:27.934903] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-11-03T17:29:28.569536] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T17:29:28.734850] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-11. [2025-11-03T17:29:29.287391] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T17:29:29.534862] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-11-03T17:29:30.334880] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-11-03T17:29:30.643477] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-11 (1.91 seconds). [2025-11-03T17:29:30.645014] [INFO ] [REMOTE ] BBAR: Full fetch complete (61478 records). [2025-11-03T17:29:30.645117] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-11-03T17:29:30.965532] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T17:29:31.080951] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-11-03T17:29:31.081152] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-11-03T17:29:31.081850] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-11-03T17:29:31.081934] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-11-03T17:29:31.111599] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:29:31.122321] [DEBUG] [LOCAL ] BBAR: Trimmed 61478 records to 42918 (keeping 200 days of data) [2025-11-03T17:29:31.183057] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-11-03T17:29:31.416455] [DEBUG] [LOCAL ] BBAR: Primary data saved (42918 records). [2025-11-03T17:29:31.416583] [INFO ] [MAIN ] BBAR: Full history saved. [2025-11-03T17:29:31.417363] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBAR took 44.8s. Estimated remaining: 4h 47m 23s. Rate: 7.5 symbols/min [2025-11-03T17:29:31.640305] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:31.640491] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-11-03T17:29:31.640535] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-11-03T17:29:31.640807] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-11-03T17:29:31.640885] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-11-03T17:29:31.640959] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-11-03T17:29:31.640996] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-11-03T17:29:31.945407] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-11-03T17:29:32.068015] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:32.697526] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T17:29:32.736055] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-11-03T17:29:32.739294] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T17:29:32.901922] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:29:32.902241] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-11-03T17:29:32.902312] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:29:32.902376] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-11-03T17:29:32.902445] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:29:32.902521] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-11-03T17:29:32.902598] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-11-03T17:29:32.902635] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-11-03T17:29:32.902720] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-11-03T17:29:32.902775] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 1.5s. Estimated remaining: 4h 46m 11s. Rate: 7.5 symbols/min [2025-11-03T17:29:33.067778] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:33.075886] [DEBUG] [LOCAL ] BBU: Loaded 6042 existing records from primary storage. [2025-11-03T17:29:33.076097] [INFO ] [MAIN ] BBU: Loaded 6042 existing records. [2025-11-03T17:29:33.273067] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:33.273292] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-11-03T17:29:33.273338] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-11-03T17:29:33.273526] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-11-03T17:29:33.273566] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-11-03T17:29:33.540051] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-11-03T17:29:33.635804] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:34.219669] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T17:29:34.334841] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-11-03T17:29:34.938837] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-11-03T17:29:35.134873] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-11-03T17:29:35.767791] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-11-03T17:29:35.934866] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-11. [2025-11-03T17:29:36.734903] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-11-03T17:29:37.189597] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-11-03T17:29:37.534930] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-11-03T17:29:37.938897] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T17:29:37.973800] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-11 (2.04 seconds). [2025-11-03T17:29:37.975348] [INFO ] [REMOTE ] BBD: Full fetch complete (77268 records). [2025-11-03T17:29:37.975452] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-11-03T17:29:38.342101] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-11-03T17:29:38.373992] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-11-03T17:29:38.374070] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-11-03T17:29:38.374960] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-11-03T17:29:38.375115] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-11-03T17:29:38.376664] [DEBUG] [LOCAL ] BBD: Trimmed 77268 records to 53296 (keeping 200 days of data) [2025-11-03T17:29:38.693295] [DEBUG] [LOCAL ] BBD: Primary data saved (53296 records). [2025-11-03T17:29:38.693432] [INFO ] [MAIN ] BBD: Full history saved. [2025-11-03T17:29:38.693508] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBD took 30.6s. Estimated remaining: 4h 45m 42s. Rate: 7.5 symbols/min [2025-11-03T17:29:38.860998] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:38.874438] [DEBUG] [LOCAL ] BBUC: Loaded 13999 existing records from primary storage. [2025-11-03T17:29:38.874707] [INFO ] [MAIN ] BBUC: Loaded 13999 existing records. [2025-11-03T17:29:39.066224] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:39.067048] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-11-03T17:29:39.067193] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-11-03T17:29:39.067511] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-11-03T17:29:39.067572] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-11-03T17:29:39.139540] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-11-03T17:29:39.236249] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T17:29:39.443573] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:39.543766] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T17:29:39.934848] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-11-03T17:29:40.382323] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-11-03T17:29:40.734901] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-11-03T17:29:41.400562] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T17:29:41.534864] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-11-03T17:29:42.093467] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-11-03T17:29:42.334862] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-11-03T17:29:42.699674] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-11-03T17:29:43.134851] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-11-03T17:29:43.461636] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-11-03T17:29:43.934870] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-11. [2025-11-03T17:29:44.584584] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T17:29:44.585378] [INFO ] [REMOTE ] BBDO: Full fetch complete (7469 records). [2025-11-03T17:29:44.585447] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-11-03T17:29:44.742613] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-11-03T17:29:44.950767] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-11-03T17:29:44.950846] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-11-03T17:29:44.951068] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-11-03T17:29:44.951107] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-11-03T17:29:44.951496] [DEBUG] [LOCAL ] BBDO: Trimmed 7469 records to 4925 (keeping 200 days of data) [2025-11-03T17:29:44.979737] [DEBUG] [LOCAL ] BBDO: Primary data saved (4925 records). [2025-11-03T17:29:44.979855] [INFO ] [MAIN ] BBDO: Full history saved. [2025-11-03T17:29:44.979932] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBDO took 29.4s. Estimated remaining: 4h 45m 17s. Rate: 7.5 symbols/min [2025-11-03T17:29:45.151612] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:29:45.155846] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-11-03T17:29:45.200602] [DEBUG] [LOCAL ] BBVA: Loaded 49698 existing records from primary storage. [2025-11-03T17:29:45.200954] [INFO ] [MAIN ] BBVA: Loaded 49698 existing records. [2025-11-03T17:29:45.382747] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:29:45.382952] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-11-03T17:29:45.383036] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-11-03T17:29:45.383843] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-11-03T17:29:45.383910] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-11-03T17:29:45.539985] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-11-03T17:29:45.764994] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:29:46.334842] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-11-03T17:29:46.367593] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T17:29:47.134867] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-11-03T17:29:47.661499] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-11-03T17:29:47.774123] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T17:29:47.934899] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-11-03T17:29:48.656810] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T17:29:48.734834] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-11-03T17:29:49.534847] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-11-03T17:29:49.582853] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T17:29:50.334869] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-11-03T17:29:50.748797] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T17:29:51.025515] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T17:29:51.134941] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-11-03T17:29:51.934866] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-11-03T17:29:52.335370] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T17:29:52.682305] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-11-03T17:29:52.734838] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-11-03T17:29:53.136692] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-11-03T17:29:53.534889] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-11-03T17:29:54.334858] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-11-03T17:29:54.915124] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T17:29:54.937003] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T17:29:55.134893] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-11-03T17:29:55.522633] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T17:29:55.934845] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-11-03T17:29:56.406842] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-11-03T17:29:56.734872] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-11-03T17:29:57.485675] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T17:29:57.534876] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-11-03T17:29:58.165312] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T17:29:58.334858] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-11-03T17:29:58.820696] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T17:29:59.134886] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-11-03T17:29:59.844962] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T17:29:59.934837] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-11-03T17:30:00.642194] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T17:30:00.734890] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-11-03T17:30:01.534918] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-11-03T17:30:01.856036] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T17:30:02.334956] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-11-03T17:30:02.556759] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T17:30:03.134881] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-11. [2025-11-03T17:30:03.335932] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-11-03T17:30:03.934913] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-11-03T17:30:04.209605] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-11 (1.07 seconds). [2025-11-03T17:30:04.211081] [INFO ] [REMOTE ] BBN: Full fetch complete (25223 records). [2025-11-03T17:30:04.211206] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-11-03T17:30:04.607533] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-11-03T17:30:04.607677] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-11-03T17:30:04.608110] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-11-03T17:30:04.608153] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-11-03T17:30:04.608940] [DEBUG] [LOCAL ] BBN: Trimmed 25223 records to 17440 (keeping 200 days of data) [2025-11-03T17:30:04.713850] [DEBUG] [LOCAL ] BBN: Primary data saved (17440 records). [2025-11-03T17:30:04.713985] [INFO ] [MAIN ] BBN: Full history saved. [2025-11-03T17:30:04.714062] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBN took 43.9s. Estimated remaining: 4h 47m 2s. Rate: 7.5 symbols/min [2025-11-03T17:30:04.739989] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-11-03T17:30:04.898587] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:04.898814] [DEBUG] [LOCAL ] BBW: No existing data file found in primary storage. [2025-11-03T17:30:04.898857] [WARN ] [MAIN ] BBW: No existing data found, performing full refresh instead. [2025-11-03T17:30:04.898992] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-11-03T17:30:04.899033] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-11-03T17:30:04.899074] [DEBUG] [LOCAL ] BBW: No primary data file found to delete. [2025-11-03T17:30:04.899106] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-11-03T17:30:05.246072] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:05.534832] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-11-03T17:30:05.659870] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-11-03T17:30:05.660361] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T17:30:06.181038] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-11-03T17:30:06.334885] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-11-03T17:30:07.134851] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-11. [2025-11-03T17:30:07.816165] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T17:30:07.934845] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-11. [2025-11-03T17:30:08.164554] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T17:30:08.165258] [INFO ] [REMOTE ] BBU: Full fetch complete (7696 records). [2025-11-03T17:30:08.165324] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-11-03T17:30:08.526274] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-11-03T17:30:08.526348] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-11-03T17:30:08.526563] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-11-03T17:30:08.526601] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-11-03T17:30:08.527038] [DEBUG] [LOCAL ] BBU: Trimmed 7696 records to 6029 (keeping 200 days of data) [2025-11-03T17:30:08.562437] [DEBUG] [LOCAL ] BBU: Primary data saved (6029 records). [2025-11-03T17:30:08.562560] [INFO ] [MAIN ] BBU: Full history saved. [2025-11-03T17:30:08.562637] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBU took 35.7s. Estimated remaining: 4h 46m 14s. Rate: 7.5 symbols/min [2025-11-03T17:30:08.739858] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:08.739923] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-11-03T17:30:08.791267] [DEBUG] [LOCAL ] BBWI: Loaded 54371 existing records from primary storage. [2025-11-03T17:30:08.791594] [INFO ] [MAIN ] BBWI: Loaded 54371 existing records. [2025-11-03T17:30:08.974985] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:30:08.975270] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-11-03T17:30:08.975327] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-11-03T17:30:08.976235] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-11-03T17:30:08.976295] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-11-03T17:30:09.094266] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T17:30:09.145334] [INFO ] [REMOTE ] BBUC: Full fetch complete (19515 records). [2025-11-03T17:30:09.170613] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-11-03T17:30:09.526774] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:09.545200] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-11-03T17:30:09.739086] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-11-03T17:30:09.739162] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-11-03T17:30:09.739503] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-11-03T17:30:09.739541] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-11-03T17:30:09.740080] [DEBUG] [LOCAL ] BBUC: Trimmed 19515 records to 13781 (keeping 200 days of data) [2025-11-03T17:30:09.819331] [DEBUG] [LOCAL ] BBUC: Primary data saved (13781 records). [2025-11-03T17:30:09.819456] [INFO ] [MAIN ] BBUC: Full history saved. [2025-11-03T17:30:09.819531] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 31.1s. Estimated remaining: 4h 45m 2s. Rate: 7.5 symbols/min [2025-11-03T17:30:09.991289] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:09.991604] [DEBUG] [LOCAL ] BBY: No existing data file found in primary storage. [2025-11-03T17:30:09.991687] [WARN ] [MAIN ] BBY: No existing data found, performing full refresh instead. [2025-11-03T17:30:09.991804] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-11-03T17:30:09.991847] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-11-03T17:30:09.991891] [DEBUG] [LOCAL ] BBY: No primary data file found to delete. [2025-11-03T17:30:09.991925] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-11-03T17:30:10.335844] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-11-03T17:30:10.362765] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:10.393557] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-11-03T17:30:10.740897] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:30:11.134853] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-11-03T17:30:11.934863] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-11-03T17:30:12.012674] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T17:30:12.188751] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-11-03T17:30:12.734898] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-11-03T17:30:13.161939] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T17:30:13.534910] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-11-03T17:30:14.069028] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T17:30:14.334885] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-11-03T17:30:14.505477] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T17:30:15.134908] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-11-03T17:30:15.939343] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-11-03T17:30:15.944761] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-11-03T17:30:16.622255] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T17:30:16.734904] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-11-03T17:30:17.496853] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T17:30:17.534865] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-11-03T17:30:18.334877] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-11-03T17:30:18.573270] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-11-03T17:30:18.783273] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:30:19.134861] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-11-03T17:30:19.934890] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-11-03T17:30:20.057342] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-11-03T17:30:20.734834] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-11-03T17:30:20.852917] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-11-03T17:30:21.495177] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T17:30:21.534885] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-11. [2025-11-03T17:30:21.694769] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T17:30:22.334869] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-11-03T17:30:23.134875] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-11-03T17:30:23.338216] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T17:30:23.552792] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-11 (2.02 seconds). [2025-11-03T17:30:23.554721] [INFO ] [REMOTE ] BBVA: Full fetch complete (71921 records). [2025-11-03T17:30:23.554849] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-11-03T17:30:23.945602] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-11-03T17:30:23.969638] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-11-03T17:30:23.969742] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-11-03T17:30:23.970469] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-11-03T17:30:23.970616] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-11-03T17:30:23.972037] [DEBUG] [LOCAL ] BBVA: Trimmed 71921 records to 48940 (keeping 200 days of data) [2025-11-03T17:30:24.251619] [DEBUG] [LOCAL ] BBVA: Primary data saved (48940 records). [2025-11-03T17:30:24.251772] [INFO ] [MAIN ] BBVA: Full history saved. [2025-11-03T17:30:24.251858] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBVA took 39.3s. Estimated remaining: 4h 45m 54s. Rate: 7.5 symbols/min [2025-11-03T17:30:24.441922] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:24.480730] [DEBUG] [LOCAL ] BC: Loaded 44361 existing records from primary storage. [2025-11-03T17:30:24.481031] [INFO ] [MAIN ] BC: Loaded 44361 existing records. [2025-11-03T17:30:24.670438] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:30:24.670936] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-11-03T17:30:24.671112] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-11-03T17:30:24.671952] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-11-03T17:30:24.672014] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-11-03T17:30:24.737679] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-11-03T17:30:25.034212] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-11-03T17:30:25.125716] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:25.481837] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T17:30:25.534856] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-11-03T17:30:25.639893] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T17:30:26.334908] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-11-03T17:30:26.795297] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T17:30:27.134898] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-11-03T17:30:27.222181] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T17:30:27.934866] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-11-03T17:30:28.547348] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T17:30:28.734842] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-11-03T17:30:29.048054] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:30:29.534929] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-11-03T17:30:30.334853] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-11-03T17:30:30.557019] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-11-03T17:30:30.686004] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T17:30:31.134924] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-11-03T17:30:31.719827] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T17:30:31.934847] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-11-03T17:30:32.090146] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T17:30:32.734861] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-11-03T17:30:33.291765] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T17:30:33.534862] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-11-03T17:30:34.019110] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:30:34.334862] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-11-03T17:30:34.974179] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T17:30:35.134890] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-11-03T17:30:35.596872] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T17:30:35.934901] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-11-03T17:30:36.323605] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T17:30:36.734856] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-11. [2025-11-03T17:30:37.335560] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T17:30:37.534890] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-11-03T17:30:38.140923] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T17:30:38.142358] [INFO ] [REMOTE ] BBW: Full fetch complete (39190 records). [2025-11-03T17:30:38.142457] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-11-03T17:30:38.338173] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-11-03T17:30:38.565257] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-11-03T17:30:38.565390] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-11-03T17:30:38.566302] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-11-03T17:30:38.566373] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-11-03T17:30:38.568055] [DEBUG] [LOCAL ] BBW: Trimmed 39190 records to 26747 (keeping 200 days of data) [2025-11-03T17:30:38.752971] [DEBUG] [LOCAL ] BBW: Primary data saved (26747 records). [2025-11-03T17:30:38.753189] [INFO ] [MAIN ] BBW: Full history saved. [2025-11-03T17:30:38.753280] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBW took 34.0s. Estimated remaining: 4h 46m 47s. Rate: 7.5 symbols/min [2025-11-03T17:30:39.011995] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:39.048281] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T17:30:39.089059] [DEBUG] [LOCAL ] BCAT: Loaded 34426 existing records from primary storage. [2025-11-03T17:30:39.089412] [INFO ] [MAIN ] BCAT: Loaded 34426 existing records. [2025-11-03T17:30:39.139944] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-11-03T17:30:39.331021] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:30:39.331379] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-11-03T17:30:39.331440] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-11-03T17:30:39.332289] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-11-03T17:30:39.332357] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-11-03T17:30:39.691355] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:39.871495] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T17:30:39.934909] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-11-03T17:30:40.734887] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-11-03T17:30:40.838165] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T17:30:40.974015] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T17:30:41.534851] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-11-03T17:30:42.341143] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-11. [2025-11-03T17:30:42.350512] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T17:30:42.452846] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T17:30:43.134906] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-11-03T17:30:43.565417] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-11 (1.22 seconds). [2025-11-03T17:30:43.567225] [INFO ] [REMOTE ] BBY: Full fetch complete (77418 records). [2025-11-03T17:30:43.567426] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-11-03T17:30:43.939289] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-11-03T17:30:43.958769] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-11-03T17:30:43.958836] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-11-03T17:30:43.959611] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-11-03T17:30:43.959788] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-11-03T17:30:43.961301] [DEBUG] [LOCAL ] BBY: Trimmed 77418 records to 53417 (keeping 200 days of data) [2025-11-03T17:30:44.292906] [DEBUG] [LOCAL ] BBY: Primary data saved (53417 records). [2025-11-03T17:30:44.293222] [INFO ] [MAIN ] BBY: Full history saved. [2025-11-03T17:30:44.293325] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBY took 34.5s. Estimated remaining: 4h 46m 16s. Rate: 7.5 symbols/min [2025-11-03T17:30:44.419232] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T17:30:44.494921] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:44.520924] [DEBUG] [LOCAL ] BCC: Loaded 28898 existing records from primary storage. [2025-11-03T17:30:44.521212] [INFO ] [MAIN ] BCC: Loaded 28898 existing records. [2025-11-03T17:30:44.698003] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:30:44.698215] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-11-03T17:30:44.698263] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-11-03T17:30:44.698829] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-11-03T17:30:44.698890] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-11-03T17:30:44.741429] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-11-03T17:30:45.061788] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:45.154001] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T17:30:45.534934] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-11-03T17:30:45.764524] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T17:30:46.334938] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-11-03T17:30:46.749925] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T17:30:47.134896] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-11-03T17:30:47.537859] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T17:30:47.934864] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-11-03T17:30:48.189086] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T17:30:48.734992] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-11. [2025-11-03T17:30:49.243370] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T17:30:49.534876] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-11-03T17:30:50.334900] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-11-03T17:30:50.922876] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:30:51.134892] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-11-03T17:30:51.185538] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-11 (2.45 seconds). [2025-11-03T17:30:51.187310] [INFO ] [REMOTE ] BBWI: Full fetch complete (77642 records). [2025-11-03T17:30:51.187454] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-11-03T17:30:51.604546] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T17:30:51.634483] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-11-03T17:30:51.634596] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-11-03T17:30:51.635786] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-11-03T17:30:51.635859] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-11-03T17:30:51.637219] [DEBUG] [LOCAL ] BBWI: Trimmed 77642 records to 53591 (keeping 200 days of data) [2025-11-03T17:30:51.936326] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-11-03T17:30:51.958261] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-11-03T17:30:51.958366] [INFO ] [MAIN ] BBWI: Full history saved. [2025-11-03T17:30:51.959127] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBWI took 43.4s. Estimated remaining: 4h 46m 4s. Rate: 7.5 symbols/min [2025-11-03T17:30:52.134108] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:30:52.185379] [DEBUG] [LOCAL ] BCE: Loaded 52994 existing records from primary storage. [2025-11-03T17:30:52.185877] [INFO ] [MAIN ] BCE: Loaded 52994 existing records. [2025-11-03T17:30:52.379234] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:30:52.379575] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-11-03T17:30:52.379694] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-11-03T17:30:52.388492] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-11-03T17:30:52.402690] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-11-03T17:30:52.473895] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T17:30:52.740108] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-11-03T17:30:52.777072] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:30:52.947907] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T17:30:53.534860] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-11-03T17:30:53.877879] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T17:30:54.334832] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-11-03T17:30:54.368485] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T17:30:55.134856] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-11-03T17:30:55.703223] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:30:55.934821] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-11-03T17:30:55.987191] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T17:30:56.734844] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-11-03T17:30:57.199775] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T17:30:57.534860] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-11-03T17:30:58.138728] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T17:30:58.334871] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-11-03T17:30:58.580857] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T17:30:59.134928] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-11. [2025-11-03T17:30:59.848697] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T17:30:59.934814] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-11-03T17:31:00.734860] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-11-03T17:31:01.024955] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T17:31:01.026268] [INFO ] [REMOTE ] BC: Full fetch complete (63978 records). [2025-11-03T17:31:01.026358] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-11-03T17:31:01.424808] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-11-03T17:31:01.424898] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-11-03T17:31:01.425658] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-11-03T17:31:01.425727] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-11-03T17:31:01.427043] [DEBUG] [LOCAL ] BC: Trimmed 63978 records to 43526 (keeping 200 days of data) [2025-11-03T17:31:01.538823] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-11-03T17:31:01.703314] [DEBUG] [LOCAL ] BC: Primary data saved (43526 records). [2025-11-03T17:31:01.703489] [INFO ] [MAIN ] BC: Full history saved. [2025-11-03T17:31:01.703636] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BC took 37.5s. Estimated remaining: 4h 46m 12s. Rate: 7.5 symbols/min [2025-11-03T17:31:01.902106] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:31:01.937878] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-11-03T17:31:01.967144] [DEBUG] [LOCAL ] BCH: Loaded 29797 existing records from primary storage. [2025-11-03T17:31:01.967416] [INFO ] [MAIN ] BCH: Loaded 29797 existing records. [2025-11-03T17:31:02.169686] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:31:02.169982] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-11-03T17:31:02.170099] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-11-03T17:31:02.170692] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-11-03T17:31:02.170753] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-11-03T17:31:02.354409] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-11-03T17:31:02.519082] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-11-03T17:31:02.585872] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:31:02.602587] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T17:31:03.134913] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-11-03T17:31:03.745479] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T17:31:03.934889] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-11-03T17:31:04.308422] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T17:31:04.734850] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-11-03T17:31:05.269891] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T17:31:05.534862] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-11-03T17:31:05.822179] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T17:31:06.334862] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-11-03T17:31:06.782851] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T17:31:07.134849] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-11-03T17:31:07.303997] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T17:31:07.934847] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-11-03T17:31:08.331292] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T17:31:08.734846] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-11-03T17:31:08.799449] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-11-03T17:31:09.534844] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-11-03T17:31:09.944231] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T17:31:10.334884] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-11-03T17:31:10.668811] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-11-03T17:31:11.138823] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-11. [2025-11-03T17:31:11.141278] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T17:31:11.934896] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-11-03T17:31:12.734853] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-11-03T17:31:12.910157] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-11 (1.77 seconds). [2025-11-03T17:31:12.912042] [INFO ] [REMOTE ] BCAT: Full fetch complete (50053 records). [2025-11-03T17:31:12.912163] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-11-03T17:31:13.302445] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-11-03T17:31:13.302554] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-11-03T17:31:13.303168] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-11-03T17:31:13.303247] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-11-03T17:31:13.304441] [DEBUG] [LOCAL ] BCAT: Trimmed 50053 records to 33977 (keeping 200 days of data) [2025-11-03T17:31:13.443264] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T17:31:13.535220] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-11-03T17:31:13.562840] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T17:31:13.585839] [DEBUG] [LOCAL ] BCAT: Primary data saved (33977 records). [2025-11-03T17:31:13.585976] [INFO ] [MAIN ] BCAT: Full history saved. [2025-11-03T17:31:13.586844] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCAT took 34.8s. Estimated remaining: 4h 46m 39s. Rate: 7.4 symbols/min [2025-11-03T17:31:13.758286] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:31:13.781099] [DEBUG] [LOCAL ] BCO: Loaded 24398 existing records from primary storage. [2025-11-03T17:31:13.781347] [INFO ] [MAIN ] BCO: Loaded 24398 existing records. [2025-11-03T17:31:13.956153] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:31:13.956395] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-11-03T17:31:13.956453] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-11-03T17:31:13.956964] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-11-03T17:31:13.957022] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-11-03T17:31:14.311042] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:31:14.334808] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-11-03T17:31:14.388135] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T17:31:15.134842] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-11. [2025-11-03T17:31:15.200433] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T17:31:15.934873] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-11-03T17:31:16.734896] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-11-03T17:31:17.019603] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T17:31:17.210006] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-11 (2.08 seconds). [2025-11-03T17:31:17.212429] [INFO ] [REMOTE ] BCE: Full fetch complete (76084 records). [2025-11-03T17:31:17.212691] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-11-03T17:31:17.540089] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-11-03T17:31:17.808216] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-11-03T17:31:17.808338] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-11-03T17:31:17.809538] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-11-03T17:31:17.809671] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-11-03T17:31:17.812051] [DEBUG] [LOCAL ] BCE: Trimmed 76084 records to 52218 (keeping 200 days of data) [2025-11-03T17:31:17.955028] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T17:31:18.232467] [DEBUG] [LOCAL ] BCE: Primary data saved (52218 records). [2025-11-03T17:31:18.232753] [INFO ] [MAIN ] BCE: Full history saved. [2025-11-03T17:31:18.233569] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BCE took 26.3s. Estimated remaining: 4h 45m 60s. Rate: 7.5 symbols/min [2025-11-03T17:31:18.339957] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-11. [2025-11-03T17:31:18.406778] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:31:18.424267] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T17:31:18.474589] [DEBUG] [LOCAL ] BCS: Loaded 54214 existing records from primary storage. [2025-11-03T17:31:18.474907] [INFO ] [MAIN ] BCS: Loaded 54214 existing records. [2025-11-03T17:31:18.646154] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:31:18.646347] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-11-03T17:31:18.646393] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-11-03T17:31:18.647286] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-11-03T17:31:18.647344] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-11-03T17:31:18.993662] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:31:19.134863] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-11-03T17:31:19.911151] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-11 (1.57 seconds). [2025-11-03T17:31:19.912391] [INFO ] [REMOTE ] BCC: Full fetch complete (41842 records). [2025-11-03T17:31:19.912464] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-11-03T17:31:19.945566] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-11-03T17:31:20.305346] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-11-03T17:31:20.305423] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-11-03T17:31:20.306140] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-11-03T17:31:20.306212] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-11-03T17:31:20.307556] [DEBUG] [LOCAL ] BCC: Trimmed 41842 records to 28583 (keeping 200 days of data) [2025-11-03T17:31:20.497980] [DEBUG] [LOCAL ] BCC: Primary data saved (28583 records). [2025-11-03T17:31:20.498115] [INFO ] [MAIN ] BCC: Full history saved. [2025-11-03T17:31:20.498195] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCC took 36.2s. Estimated remaining: 4h 44m 59s. Rate: 7.5 symbols/min [2025-11-03T17:31:20.672026] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:31:20.698989] [DEBUG] [LOCAL ] BCSF: Loaded 28155 existing records from primary storage. [2025-11-03T17:31:20.699253] [INFO ] [MAIN ] BCSF: Loaded 28155 existing records. [2025-11-03T17:31:20.741797] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-11-03T17:31:20.889324] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:31:20.889746] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-11-03T17:31:20.890138] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-11-03T17:31:20.890903] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-11-03T17:31:20.890965] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-11-03T17:31:21.185965] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-11-03T17:31:21.183354] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T17:31:21.371838] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:31:21.534830] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-11-03T17:31:21.651352] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T17:31:22.260406] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T17:31:22.334893] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-11-03T17:31:23.134849] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-11-03T17:31:23.725418] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-11-03T17:31:23.934846] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-11-03T17:31:24.084988] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T17:31:24.734853] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-11-03T17:31:25.332782] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T17:31:25.532481] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T17:31:25.537946] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-11-03T17:31:26.334824] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-11-03T17:31:26.524730] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T17:31:26.901059] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-11-03T17:31:27.134865] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-11-03T17:31:27.934832] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-11-03T17:31:28.072924] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T17:31:28.734883] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-11-03T17:31:29.463634] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T17:31:29.534829] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-11-03T17:31:29.730938] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T17:31:30.334855] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-11-03T17:31:30.990321] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T17:31:31.134836] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-11-03T17:31:31.248409] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T17:31:31.934913] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-11-03T17:31:32.241712] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T17:31:32.734991] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-11-03T17:31:33.004462] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T17:31:33.534861] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-11-03T17:31:34.146173] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T17:31:34.293120] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:31:34.334840] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-11-03T17:31:35.134925] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-11-03T17:31:35.213895] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T17:31:35.931326] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T17:31:35.936960] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-11-03T17:31:36.734897] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-11-03T17:31:36.810959] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T17:31:37.541059] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-11-03T17:31:37.555074] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T17:31:38.334886] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-11-03T17:31:39.134829] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-11-03T17:31:39.213024] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-11-03T17:31:39.256428] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T17:31:39.934828] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-11-03T17:31:40.068830] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T17:31:40.584435] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-11-03T17:31:40.734897] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-11-03T17:31:41.534852] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-11-03T17:31:42.334830] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-11-03T17:31:42.460146] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-11-03T17:31:42.520593] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T17:31:43.135057] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-11. [2025-11-03T17:31:43.345146] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T17:31:43.934869] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-11-03T17:31:44.165966] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T17:31:44.167004] [INFO ] [REMOTE ] BCO: Full fetch complete (35847 records). [2025-11-03T17:31:44.167076] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-11-03T17:31:44.564144] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-11-03T17:31:44.564231] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-11-03T17:31:44.564703] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-11-03T17:31:44.564766] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-11-03T17:31:44.565718] [DEBUG] [LOCAL ] BCO: Trimmed 35847 records to 24087 (keeping 200 days of data) [2025-11-03T17:31:44.708483] [DEBUG] [LOCAL ] BCO: Primary data saved (24087 records). [2025-11-03T17:31:44.708624] [INFO ] [MAIN ] BCO: Full history saved. [2025-11-03T17:31:44.708742] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCO took 31.1s. Estimated remaining: 4h 47m 18s. Rate: 7.4 symbols/min [2025-11-03T17:31:44.739985] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-11. [2025-11-03T17:31:44.882053] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:31:44.901022] [DEBUG] [LOCAL ] BCX: Loaded 21751 existing records from primary storage. [2025-11-03T17:31:44.901265] [INFO ] [MAIN ] BCX: Loaded 21751 existing records. [2025-11-03T17:31:45.079346] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:31:45.079603] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-11-03T17:31:45.079680] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-11-03T17:31:45.080123] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-11-03T17:31:45.080181] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-11-03T17:31:45.458233] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:31:45.478449] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T17:31:45.534814] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-11-03T17:31:46.136986] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T17:31:46.138169] [INFO ] [REMOTE ] BCH: Full fetch complete (41840 records). [2025-11-03T17:31:46.138240] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-11-03T17:31:46.348923] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-11-03T17:31:46.546682] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-11-03T17:31:46.546769] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-11-03T17:31:46.547292] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-11-03T17:31:46.547353] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-11-03T17:31:46.548256] [DEBUG] [LOCAL ] BCH: Trimmed 41840 records to 29410 (keeping 200 days of data) [2025-11-03T17:31:46.710763] [DEBUG] [LOCAL ] BCH: Primary data saved (29410 records). [2025-11-03T17:31:46.710912] [INFO ] [MAIN ] BCH: Full history saved. [2025-11-03T17:31:46.710993] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCH took 45.0s. Estimated remaining: 4h 46m 15s. Rate: 7.4 symbols/min [2025-11-03T17:31:46.878561] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:31:46.901279] [DEBUG] [LOCAL ] BDC: Loaded 23868 existing records from primary storage. [2025-11-03T17:31:46.901530] [INFO ] [MAIN ] BDC: Loaded 23868 existing records. [2025-11-03T17:31:47.080176] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:31:47.080431] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-11-03T17:31:47.080485] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-11-03T17:31:47.081072] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-11-03T17:31:47.081129] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-11-03T17:31:47.149864] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-11-03T17:31:47.450456] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:31:47.505543] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T17:31:47.514668] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-11-03T17:31:47.934857] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-11. [2025-11-03T17:31:48.026758] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T17:31:48.734875] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-11-03T17:31:49.224634] [DEBUG] [REMOTE ] BCS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:31:49.224966] [WARN ] [REMOTE ] BCS: No data returned for month 2025-11 [2025-11-03T17:31:49.225053] [FATAL] [REMOTE ] BCS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:31:49.225130] [FATAL] [MAIN ] BCS: Failed to fetch primary data. [2025-11-03T17:31:49.225191] [WARN ] [MAIN ] BCS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:31:49.225276] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-11-03T17:31:49.225338] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-11-03T17:31:49.225373] [INFO ] [LOCAL ] BCS: Starting deletion of derivative data. [2025-11-03T17:31:49.225551] [DEBUG] [LOCAL ] BCS: Deleted derivative data file. [2025-11-03T17:31:49.226050] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCS took 31.0s. Estimated remaining: 4h 45m 17s. Rate: 7.5 symbols/min [2025-11-03T17:31:49.534942] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-11-03T17:31:49.821530] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T17:31:50.334906] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-11-03T17:31:50.472212] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T17:31:51.105054] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T17:31:51.134854] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-11-03T17:31:51.934893] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-11. [2025-11-03T17:31:51.953892] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T17:31:52.734896] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-11-03T17:31:53.422387] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-11 (1.49 seconds). [2025-11-03T17:31:53.423466] [INFO ] [REMOTE ] BCSF: Full fetch complete (40384 records). [2025-11-03T17:31:53.423545] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-11-03T17:31:53.537305] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-11-03T17:31:53.828720] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T17:31:53.864425] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-11-03T17:31:53.864498] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-11-03T17:31:53.865000] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-11-03T17:31:53.865062] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-11-03T17:31:53.865901] [DEBUG] [LOCAL ] BCSF: Trimmed 40384 records to 27789 (keeping 200 days of data) [2025-11-03T17:31:54.027532] [DEBUG] [LOCAL ] BCSF: Primary data saved (27789 records). [2025-11-03T17:31:54.027674] [INFO ] [MAIN ] BCSF: Full history saved. [2025-11-03T17:31:54.028378] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCSF took 33.5s. Estimated remaining: 4h 44m 40s. Rate: 7.5 symbols/min [2025-11-03T17:31:54.334891] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-11-03T17:31:54.355385] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T17:31:55.000504] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-11-03T17:31:55.134872] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-11-03T17:31:55.944151] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-11-03T17:31:55.946156] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T17:31:56.734886] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-11-03T17:31:56.833168] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T17:31:57.531924] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T17:31:57.535029] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-11-03T17:31:58.334852] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-11-03T17:31:58.485572] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T17:31:59.058279] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T17:31:59.134831] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-11-03T17:31:59.827993] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-11-03T17:31:59.934825] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-11-03T17:32:00.734839] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-11-03T17:32:01.027107] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T17:32:01.534851] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-11. [2025-11-03T17:32:02.107314] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T17:32:02.334864] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-11-03T17:32:02.378403] [DEBUG] [REMOTE ] BCX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:32:02.378883] [WARN ] [REMOTE ] BCX: No data returned for month 2025-11 [2025-11-03T17:32:02.378987] [FATAL] [REMOTE ] BCX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:32:02.379090] [FATAL] [MAIN ] BCX: Failed to fetch primary data. [2025-11-03T17:32:02.379161] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:32:02.379239] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-11-03T17:32:02.379321] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-11-03T17:32:02.379361] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-11-03T17:32:02.379623] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-11-03T17:32:02.379760] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCX took 17.7s. Estimated remaining: 4h 44m 35s. Rate: 7.5 symbols/min [2025-11-03T17:32:03.125321] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T17:32:03.134801] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-11-03T17:32:03.977521] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-11-03T17:32:03.983739] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-11-03T17:32:04.832991] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-11-03T17:32:04.838617] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-11-03T17:32:05.725101] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T17:32:05.730670] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-11-03T17:32:06.573105] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-11-03T17:32:06.578954] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-11. [2025-11-03T17:32:07.690798] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T17:32:07.691836] [INFO ] [REMOTE ] BDC: Full fetch complete (35743 records). [2025-11-03T17:32:07.691928] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-11-03T17:32:08.101198] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-11-03T17:32:08.101290] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-11-03T17:32:08.101811] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-11-03T17:32:08.101879] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-11-03T17:32:08.102840] [DEBUG] [LOCAL ] BDC: Trimmed 35743 records to 23484 (keeping 200 days of data) [2025-11-03T17:32:08.248071] [DEBUG] [LOCAL ] BDC: Primary data saved (23484 records). [2025-11-03T17:32:08.248207] [INFO ] [MAIN ] BDC: Full history saved. [2025-11-03T17:32:08.248287] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 21.5s. Estimated remaining: 4h 44m 8s. Rate: 7.5 symbols/min [2025-11-03T17:32:08.857810] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:08.858614] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:08.927557] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:08.988990] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:09.065218] [DEBUG] [LOCAL ] BE: Loaded 54441 existing records from primary storage. [2025-11-03T17:32:09.076414] [DEBUG] [LOCAL ] BDJ: Loaded 29179 existing records from primary storage. [2025-11-03T17:32:09.075353] [INFO ] [MAIN ] BE: Loaded 54441 existing records. [2025-11-03T17:32:09.112144] [INFO ] [MAIN ] BDJ: Loaded 29179 existing records. [2025-11-03T17:32:09.132896] [DEBUG] [LOCAL ] BDX: Loaded 52789 existing records from primary storage. [2025-11-03T17:32:09.232063] [INFO ] [MAIN ] BDX: Loaded 52789 existing records. [2025-11-03T17:32:09.237340] [DEBUG] [LOCAL ] BDN: Loaded 48232 existing records from primary storage. [2025-11-03T17:32:09.338800] [INFO ] [MAIN ] BDN: Loaded 48232 existing records. [2025-11-03T17:32:09.629376] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:32:09.700506] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:32:09.714531] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-11-03T17:32:09.714750] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-11-03T17:32:09.725627] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-11-03T17:32:09.725556] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-11-03T17:32:09.762668] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-11-03T17:32:09.762603] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-11-03T17:32:09.874956] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:32:09.871765] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-11-03T17:32:09.900157] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-11-03T17:32:09.925170] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-11-03T17:32:09.958783] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:32:09.958866] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-11-03T17:32:09.980626] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-11-03T17:32:10.036550] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-11-03T17:32:10.059451] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-11-03T17:32:10.059601] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-11-03T17:32:10.026157] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-11-03T17:32:10.136628] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-11-03T17:32:11.181887] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:11.265206] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:11.286816] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:11.283850] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-11-03T17:32:11.287110] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-11-03T17:32:11.291700] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-11-03T17:32:11.380026] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:11.380354] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-11-03T17:32:12.466525] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:32:12.473613] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-11-03T17:32:12.978681] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T17:32:12.989082] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-11-03T17:32:13.054128] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-11-03T17:32:13.065816] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-11-03T17:32:13.099937] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-11-03T17:32:13.110364] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-11-03T17:32:13.336948] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-11-03T17:32:13.534887] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-11-03T17:32:14.103326] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T17:32:14.334895] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-11-03T17:32:14.368603] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:32:14.415761] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T17:32:14.447216] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T17:32:15.134891] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-11-03T17:32:15.606218] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:32:15.934931] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-11-03T17:32:16.262346] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:32:16.734891] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-11-03T17:32:17.415480] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T17:32:17.534873] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-11-03T17:32:18.334884] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-11-03T17:32:18.503497] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-11-03T17:32:18.764509] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:32:19.096571] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T17:32:19.134821] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-11-03T17:32:19.934857] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-11-03T17:32:20.629045] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-11-03T17:32:20.734879] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-11-03T17:32:21.165852] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:32:21.534881] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-11-03T17:32:22.209873] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T17:32:22.334822] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-11-03T17:32:22.398101] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T17:32:23.134872] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-11-03T17:32:23.934815] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-11-03T17:32:24.112858] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-11-03T17:32:24.608997] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T17:32:24.734826] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-11-03T17:32:24.898751] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-11-03T17:32:25.535130] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-11-03T17:32:26.192506] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T17:32:26.334880] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-11-03T17:32:26.939259] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T17:32:27.134914] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-11-03T17:32:27.815328] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T17:32:27.934844] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-11-03T17:32:28.591444] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T17:32:28.734822] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-11-03T17:32:28.889888] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T17:32:29.534899] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-11-03T17:32:30.334862] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-11-03T17:32:30.501900] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-11-03T17:32:31.000916] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T17:32:31.134841] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-11-03T17:32:31.179365] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T17:32:31.934887] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-11-03T17:32:32.320963] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T17:32:32.734845] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-11-03T17:32:33.361703] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T17:32:33.534849] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-11-03T17:32:34.334867] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-11-03T17:32:34.660463] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-11-03T17:32:35.004727] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T17:32:35.134879] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-11-03T17:32:35.642577] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T17:32:35.934846] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-11-03T17:32:36.734851] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-11-03T17:32:36.927717] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T17:32:37.154673] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-11-03T17:32:37.534872] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-11. [2025-11-03T17:32:37.998994] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T17:32:38.334890] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-11-03T17:32:39.134873] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-11. [2025-11-03T17:32:39.604595] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T17:32:39.934954] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-11. [2025-11-03T17:32:40.088224] [DEBUG] [REMOTE ] BDN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:32:40.088510] [WARN ] [REMOTE ] BDN: No data returned for month 2025-11 [2025-11-03T17:32:40.088601] [FATAL] [REMOTE ] BDN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:32:40.088714] [FATAL] [MAIN ] BDN: Failed to fetch primary data. [2025-11-03T17:32:40.088805] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:32:40.088889] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-11-03T17:32:40.088951] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-11-03T17:32:40.088988] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-11-03T17:32:40.089233] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-11-03T17:32:40.089330] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDN took 31.8s. Estimated remaining: 4h 47m 30s. Rate: 7.4 symbols/min [2025-11-03T17:32:40.268344] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:40.268518] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-11-03T17:32:40.268571] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-11-03T17:32:40.268719] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-11-03T17:32:40.268772] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-11-03T17:32:40.268818] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-11-03T17:32:40.268851] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-11-03T17:32:40.626694] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:40.734816] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-11-03T17:32:41.125489] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-11-03T17:32:41.228683] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-11 (3.69 seconds). [2025-11-03T17:32:41.230219] [INFO ] [REMOTE ] BE: Full fetch complete (77818 records). [2025-11-03T17:32:41.230316] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-11-03T17:32:41.332807] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T17:32:41.360012] [INFO ] [REMOTE ] BDJ: Full fetch complete (42411 records). [2025-11-03T17:32:41.382469] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-11-03T17:32:41.566334] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-11-03T17:32:41.923525] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-11-03T17:32:41.990178] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-11-03T17:32:42.007420] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-11-03T17:32:42.018595] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-11-03T17:32:42.019012] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-11-03T17:32:42.105742] [DEBUG] [LOCAL ] BE: Trimmed 77818 records to 53662 (keeping 200 days of data) [2025-11-03T17:32:42.106059] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-11-03T17:32:42.106448] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-11-03T17:32:42.106876] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-11-03T17:32:42.106974] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-11-03T17:32:42.155423] [DEBUG] [LOCAL ] BDJ: Trimmed 42411 records to 28750 (keeping 200 days of data) [2025-11-03T17:32:42.336230] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-11-03T17:32:42.518681] [DEBUG] [LOCAL ] BDJ: Primary data saved (28750 records). [2025-11-03T17:32:42.518829] [INFO ] [MAIN ] BDJ: Full history saved. [2025-11-03T17:32:42.518922] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDJ took 34.3s. Estimated remaining: 4h 46m 32s. Rate: 7.4 symbols/min [2025-11-03T17:32:42.728030] [DEBUG] [LOCAL ] BE: Primary data saved (53662 records). [2025-11-03T17:32:42.746464] [INFO ] [MAIN ] BE: Full history saved. [2025-11-03T17:32:42.752433] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BE took 34.5s. Estimated remaining: 4h 45m 15s. Rate: 7.4 symbols/min [2025-11-03T17:32:42.788577] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:42.841145] [DEBUG] [LOCAL ] BEKE: No existing data file found in primary storage. [2025-11-03T17:32:42.852286] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-11-03T17:32:42.857546] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-11-03T17:32:42.877004] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-11-03T17:32:42.879344] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-11-03T17:32:42.879630] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-11-03T17:32:43.052731] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:43.137773] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-11-03T17:32:43.336562] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:43.351693] [DEBUG] [LOCAL ] BEN: Loaded 53861 existing records from primary storage. [2025-11-03T17:32:43.351943] [INFO ] [MAIN ] BEN: Loaded 53861 existing records. [2025-11-03T17:32:43.512156] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-11-03T17:32:43.530957] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:32:43.532169] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-11-03T17:32:43.532217] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-11-03T17:32:43.533169] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-11-03T17:32:43.533225] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-11-03T17:32:43.895807] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:43.927094] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T17:32:43.937899] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-11-03T17:32:44.245271] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-11-03T17:32:44.734925] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-11-03T17:32:45.534929] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-11-03T17:32:45.771210] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-11-03T17:32:46.133670] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T17:32:46.334865] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-11-03T17:32:46.573508] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-11-03T17:32:47.134893] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-11-03T17:32:47.934862] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-11-03T17:32:48.497845] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T17:32:48.734875] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-11. [2025-11-03T17:32:49.288823] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T17:32:49.534865] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-11-03T17:32:49.733367] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.20 seconds). [2025-11-03T17:32:50.130800] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T17:32:50.132467] [INFO ] [REMOTE ] BDX: Full fetch complete (75355 records). [2025-11-03T17:32:50.132561] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-11-03T17:32:50.339925] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-11-03T17:32:50.547242] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-11-03T17:32:50.547321] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-11-03T17:32:50.548137] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-11-03T17:32:50.548213] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-11-03T17:32:50.549826] [DEBUG] [LOCAL ] BDX: Trimmed 75355 records to 52021 (keeping 200 days of data) [2025-11-03T17:32:50.885170] [DEBUG] [LOCAL ] BDX: Primary data saved (52021 records). [2025-11-03T17:32:50.885299] [INFO ] [MAIN ] BDX: Full history saved. [2025-11-03T17:32:50.886142] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BDX took 42.6s. Estimated remaining: 4h 45m 7s. Rate: 7.4 symbols/min [2025-11-03T17:32:51.071191] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:51.071337] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-11-03T17:32:51.071375] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-11-03T17:32:51.071486] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-11-03T17:32:51.071527] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-11-03T17:32:51.071568] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-11-03T17:32:51.071602] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-11-03T17:32:51.140884] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-11-03T17:32:51.446559] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:51.500452] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-11-03T17:32:51.695118] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T17:32:51.934899] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-11-03T17:32:52.734855] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-11-03T17:32:53.402164] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T17:32:53.534867] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-11-03T17:32:54.105586] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:32:54.334844] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-11-03T17:32:55.066948] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-11-03T17:32:55.134815] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-11-03T17:32:55.335691] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T17:32:55.934916] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-11-03T17:32:56.171577] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-11-03T17:32:56.563555] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T17:32:56.734885] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-11-03T17:32:57.028682] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T17:32:57.534859] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-11. [2025-11-03T17:32:57.962177] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-11 (0.43 seconds). [2025-11-03T17:32:57.962877] [INFO ] [REMOTE ] BEDU: Full fetch complete (1312 records). [2025-11-03T17:32:57.962961] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-11-03T17:32:58.138988] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-11-03T17:32:58.139191] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-11-03T17:32:58.139267] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-11-03T17:32:58.139316] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-11-03T17:32:58.139373] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-11-03T17:32:58.139409] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-11-03T17:32:58.139450] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-11-03T17:32:58.139506] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 18.1s. Estimated remaining: 4h 44m 52s. Rate: 7.4 symbols/min [2025-11-03T17:32:58.309688] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:32:58.334844] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-11-03T17:32:58.349777] [DEBUG] [LOCAL ] BEPC: Loaded 46945 existing records from primary storage. [2025-11-03T17:32:58.350064] [INFO ] [MAIN ] BEPC: Loaded 46945 existing records. [2025-11-03T17:32:58.566826] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:32:58.567086] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-11-03T17:32:58.567137] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-11-03T17:32:58.568001] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-11-03T17:32:58.568060] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-11-03T17:32:58.958963] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:32:59.134815] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-11-03T17:32:59.943296] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-11-03T17:32:59.966316] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-11-03T17:33:00.734842] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-11-03T17:33:01.246560] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-11-03T17:33:01.509362] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-11-03T17:33:01.534813] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-11-03T17:33:02.334886] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-11-03T17:33:02.918074] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T17:33:03.134844] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-11-03T17:33:03.209984] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-11-03T17:33:03.490069] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T17:33:03.934857] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-11-03T17:33:04.734834] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-11-03T17:33:04.812438] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-11-03T17:33:05.063633] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:33:05.534842] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-11-03T17:33:05.954193] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T17:33:06.334898] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-11-03T17:33:06.837924] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T17:33:07.134851] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-11-03T17:33:07.516403] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:33:07.934866] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-11-03T17:33:08.464996] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:33:08.734850] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-11-03T17:33:09.228633] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:33:09.534939] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-11-03T17:33:10.006336] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T17:33:10.334880] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-11-03T17:33:10.956618] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T17:33:11.134882] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-11-03T17:33:11.575813] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T17:33:11.934871] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-11-03T17:33:12.339871] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T17:33:12.734925] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-11-03T17:33:13.056752] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-11-03T17:33:13.535123] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-11-03T17:33:14.136375] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T17:33:14.334853] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-11-03T17:33:14.554552] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T17:33:15.134872] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-11-03T17:33:15.850750] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-11-03T17:33:15.934869] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-11-03T17:33:16.312493] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T17:33:16.734886] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-11-03T17:33:17.400214] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T17:33:17.534852] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-11-03T17:33:17.925737] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T17:33:18.334856] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-11-03T17:33:19.058793] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T17:33:19.134905] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-11. [2025-11-03T17:33:19.934850] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-11-03T17:33:19.981515] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-11-03T17:33:20.734879] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-11. [2025-11-03T17:33:21.081897] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T17:33:21.390994] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T17:33:21.392489] [INFO ] [REMOTE ] BEKE: Full fetch complete (77285 records). [2025-11-03T17:33:21.392599] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-11-03T17:33:21.535682] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-11-03T17:33:21.780727] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-11-03T17:33:21.780805] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-11-03T17:33:21.781577] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-11-03T17:33:21.781619] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-11-03T17:33:21.783016] [DEBUG] [LOCAL ] BEKE: Trimmed 77285 records to 53130 (keeping 200 days of data) [2025-11-03T17:33:22.083238] [DEBUG] [LOCAL ] BEKE: Primary data saved (53130 records). [2025-11-03T17:33:22.083358] [INFO ] [MAIN ] BEKE: Full history saved. [2025-11-03T17:33:22.083422] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEKE took 39.6s. Estimated remaining: 4h 47m 1s. Rate: 7.4 symbols/min [2025-11-03T17:33:22.249037] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:22.254936] [DEBUG] [LOCAL ] BEPH: Loaded 4825 existing records from primary storage. [2025-11-03T17:33:22.255107] [INFO ] [MAIN ] BEPH: Loaded 4825 existing records. [2025-11-03T17:33:22.346928] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-11-03T17:33:22.432980] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:33:22.433142] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-11-03T17:33:22.433191] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-11-03T17:33:22.433378] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-11-03T17:33:22.433417] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-11-03T17:33:22.683920] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-11 (1.95 seconds). [2025-11-03T17:33:22.711178] [INFO ] [REMOTE ] BEPC: Full fetch complete (68860 records). [2025-11-03T17:33:22.716997] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-11-03T17:33:22.845860] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:23.142775] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-11-03T17:33:23.190758] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-11-03T17:33:23.190872] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-11-03T17:33:23.191594] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-11-03T17:33:23.191724] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-11-03T17:33:23.220146] [DEBUG] [LOCAL ] BEPC: Trimmed 68860 records to 46314 (keeping 200 days of data) [2025-11-03T17:33:23.221672] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T17:33:23.510018] [DEBUG] [LOCAL ] BEPC: Primary data saved (46314 records). [2025-11-03T17:33:23.510150] [INFO ] [MAIN ] BEPC: Full history saved. [2025-11-03T17:33:23.510947] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEPC took 25.4s. Estimated remaining: 4h 45m 56s. Rate: 7.4 symbols/min [2025-11-03T17:33:23.678967] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:23.685073] [DEBUG] [LOCAL ] BEPI: Loaded 3499 existing records from primary storage. [2025-11-03T17:33:23.685271] [INFO ] [MAIN ] BEPI: Loaded 3499 existing records. [2025-11-03T17:33:23.871628] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T17:33:23.871273] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:33:23.873562] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-11-03T17:33:23.873687] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-11-03T17:33:23.873962] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-11-03T17:33:23.874046] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-11-03T17:33:23.944424] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-11. [2025-11-03T17:33:24.095962] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-11-03T17:33:24.282212] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:24.734852] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-11-03T17:33:25.534880] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-11-03T17:33:25.916819] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-11 (1.97 seconds). [2025-11-03T17:33:25.918355] [INFO ] [REMOTE ] BEP: Full fetch complete (59081 records). [2025-11-03T17:33:25.918468] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-11-03T17:33:26.055629] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T17:33:26.339395] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-11-03T17:33:26.411921] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-11-03T17:33:26.412180] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-11-03T17:33:26.412949] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-11-03T17:33:26.413154] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-11-03T17:33:26.415125] [DEBUG] [LOCAL ] BEP: Trimmed 59081 records to 38923 (keeping 200 days of data) [2025-11-03T17:33:26.508305] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-11-03T17:33:26.662355] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T17:33:26.692161] [DEBUG] [LOCAL ] BEP: Primary data saved (38923 records). [2025-11-03T17:33:26.692338] [INFO ] [MAIN ] BEP: Full history saved. [2025-11-03T17:33:26.692444] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEP took 35.8s. Estimated remaining: 4h 45m 6s. Rate: 7.4 symbols/min [2025-11-03T17:33:26.870152] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:26.874950] [DEBUG] [LOCAL ] BEPJ: Loaded 3060 existing records from primary storage. [2025-11-03T17:33:26.875093] [INFO ] [MAIN ] BEPJ: Loaded 3060 existing records. [2025-11-03T17:33:27.049226] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:33:27.049424] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-11-03T17:33:27.049470] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-11-03T17:33:27.049667] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-11-03T17:33:27.049725] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-11-03T17:33:27.140052] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-11-03T17:33:27.402050] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:27.934854] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-11-03T17:33:28.331664] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T17:33:28.734849] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-11-03T17:33:28.990130] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-11-03T17:33:29.214874] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-11-03T17:33:29.534876] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-11-03T17:33:29.826717] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-11-03T17:33:30.334883] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-11-03T17:33:30.713187] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T17:33:31.134885] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-11-03T17:33:31.702282] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T17:33:31.934917] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-11-03T17:33:32.387564] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-11-03T17:33:32.734853] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-11-03T17:33:33.068595] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-11-03T17:33:33.534944] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-11-03T17:33:34.064072] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T17:33:34.334881] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-11-03T17:33:34.633897] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-11-03T17:33:35.134861] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-11-03T17:33:35.566233] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-11-03T17:33:35.934935] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-11. [2025-11-03T17:33:36.734845] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-11-03T17:33:37.085340] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T17:33:37.093287] [DEBUG] [REMOTE ] BEN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:33:37.093511] [WARN ] [REMOTE ] BEN: No data returned for month 2025-11 [2025-11-03T17:33:37.093597] [FATAL] [REMOTE ] BEN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:33:37.093688] [FATAL] [MAIN ] BEN: Failed to fetch primary data. [2025-11-03T17:33:37.093745] [WARN ] [MAIN ] BEN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:33:37.093820] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-11-03T17:33:37.093906] [DEBUG] [LOCAL ] BEN: No primary data file found to delete. [2025-11-03T17:33:37.093967] [INFO ] [LOCAL ] BEN: Starting deletion of derivative data. [2025-11-03T17:33:37.094136] [DEBUG] [LOCAL ] BEN: Deleted derivative data file. [2025-11-03T17:33:37.094219] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEN took 54.3s. Estimated remaining: 4h 45m 17s. Rate: 7.4 symbols/min [2025-11-03T17:33:37.262911] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:37.295420] [DEBUG] [LOCAL ] BFAM: Loaded 34555 existing records from primary storage. [2025-11-03T17:33:37.295725] [INFO ] [MAIN ] BFAM: Loaded 34555 existing records. [2025-11-03T17:33:37.469766] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:33:37.469981] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-11-03T17:33:37.470035] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-11-03T17:33:37.470550] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-11-03T17:33:37.470589] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-11-03T17:33:37.539977] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-11-03T17:33:37.824809] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:37.976272] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T17:33:38.334873] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-11-03T17:33:39.134851] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-11-03T17:33:39.306889] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T17:33:39.440288] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-11-03T17:33:39.934869] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-11-03T17:33:40.435469] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-11-03T17:33:40.734850] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-11-03T17:33:41.073083] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T17:33:41.534924] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-11-03T17:33:42.334832] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-11-03T17:33:42.469542] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-11-03T17:33:42.854283] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-11-03T17:33:43.134964] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-11-03T17:33:43.486564] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-11-03T17:33:43.934908] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-11-03T17:33:44.734869] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-11-03T17:33:45.110347] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T17:33:45.174479] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T17:33:45.534954] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-11-03T17:33:46.334884] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-11-03T17:33:46.523978] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T17:33:46.641208] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-11-03T17:33:47.134922] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-11-03T17:33:47.604497] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-11-03T17:33:47.935004] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-11-03T17:33:48.228287] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-11-03T17:33:48.734897] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-11-03T17:33:49.122149] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-11-03T17:33:49.534870] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-11-03T17:33:49.886536] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-11-03T17:33:50.334890] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-11-03T17:33:50.976389] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-11-03T17:33:51.134894] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-11-03T17:33:51.423358] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T17:33:51.934861] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-11-03T17:33:52.316663] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-11-03T17:33:52.734849] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-11. [2025-11-03T17:33:53.217870] [DEBUG] [REMOTE ] BEPJ: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:33:53.218172] [WARN ] [REMOTE ] BEPJ: No data returned for month 2025-11 [2025-11-03T17:33:53.218261] [FATAL] [REMOTE ] BEPJ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:33:53.218361] [FATAL] [MAIN ] BEPJ: Failed to fetch primary data. [2025-11-03T17:33:53.218439] [WARN ] [MAIN ] BEPJ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:33:53.218545] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-11-03T17:33:53.218673] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-11-03T17:33:53.218748] [INFO ] [LOCAL ] BEPJ: Starting deletion of derivative data. [2025-11-03T17:33:53.218939] [DEBUG] [LOCAL ] BEPJ: Deleted derivative data file. [2025-11-03T17:33:53.219035] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPJ took 26.5s. Estimated remaining: 4h 46m 17s. Rate: 7.4 symbols/min [2025-11-03T17:33:53.389253] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:53.424380] [DEBUG] [LOCAL ] BFH: Loaded 41636 existing records from primary storage. [2025-11-03T17:33:53.424669] [INFO ] [MAIN ] BFH: Loaded 41636 existing records. [2025-11-03T17:33:53.539928] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-11-03T17:33:53.632824] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:33:53.633005] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-11-03T17:33:53.633052] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-11-03T17:33:53.633702] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-11-03T17:33:53.633758] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-11-03T17:33:53.982111] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:54.334859] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-11. [2025-11-03T17:33:54.891014] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-11-03T17:33:55.015810] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T17:33:55.016472] [INFO ] [REMOTE ] BEPI: Full fetch complete (4754 records). [2025-11-03T17:33:55.016538] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-11-03T17:33:55.139917] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-11-03T17:33:55.368707] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-11-03T17:33:55.368817] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-11-03T17:33:55.368985] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-11-03T17:33:55.369025] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-11-03T17:33:55.369366] [DEBUG] [LOCAL ] BEPI: Trimmed 4754 records to 3446 (keeping 200 days of data) [2025-11-03T17:33:55.390770] [DEBUG] [LOCAL ] BEPI: Primary data saved (3446 records). [2025-11-03T17:33:55.390867] [INFO ] [MAIN ] BEPI: Full history saved. [2025-11-03T17:33:55.390940] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPI took 31.9s. Estimated remaining: 4h 45m 19s. Rate: 7.4 symbols/min [2025-11-03T17:33:55.555325] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:55.568008] [DEBUG] [LOCAL ] BFK: Loaded 14059 existing records from primary storage. [2025-11-03T17:33:55.568194] [INFO ] [MAIN ] BFK: Loaded 14059 existing records. [2025-11-03T17:33:55.740169] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:33:55.740410] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-11-03T17:33:55.740460] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-11-03T17:33:55.740809] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-11-03T17:33:55.740867] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-11-03T17:33:55.942212] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-11-03T17:33:56.087048] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:56.435419] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T17:33:56.642408] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-11-03T17:33:56.734829] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-11-03T17:33:57.534893] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-11. [2025-11-03T17:33:57.819680] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T17:33:58.253335] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T17:33:58.254088] [INFO ] [REMOTE ] BEPH: Full fetch complete (7488 records). [2025-11-03T17:33:58.254154] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-11-03T17:33:58.340283] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-11-03T17:33:58.612345] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-11-03T17:33:58.612422] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-11-03T17:33:58.612616] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-11-03T17:33:58.612689] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-11-03T17:33:58.613077] [DEBUG] [LOCAL ] BEPH: Trimmed 7488 records to 4803 (keeping 200 days of data) [2025-11-03T17:33:58.641846] [DEBUG] [LOCAL ] BEPH: Primary data saved (4803 records). [2025-11-03T17:33:58.641949] [INFO ] [MAIN ] BEPH: Full history saved. [2025-11-03T17:33:58.642023] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPH took 36.6s. Estimated remaining: 4h 44m 30s. Rate: 7.4 symbols/min [2025-11-03T17:33:58.809255] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:33:58.809453] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-11-03T17:33:58.809496] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-11-03T17:33:58.809603] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-11-03T17:33:58.809666] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-11-03T17:33:58.809749] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-11-03T17:33:58.809783] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-11-03T17:33:59.138087] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-11-03T17:33:59.168689] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:33:59.325778] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-11-03T17:33:59.934851] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-11-03T17:34:00.134344] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T17:34:00.734868] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-11-03T17:34:01.459056] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T17:34:01.534850] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-11-03T17:34:02.029234] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:34:02.334916] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-11-03T17:34:03.134927] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-11-03T17:34:03.649500] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-11-03T17:34:03.934871] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-11-03T17:34:04.058677] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-11-03T17:34:04.490978] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T17:34:04.731105] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-11-03T17:34:04.739674] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-11-03T17:34:05.534914] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-11-03T17:34:06.106104] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T17:34:06.334854] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-11-03T17:34:06.714228] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T17:34:07.134879] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-11-03T17:34:07.641581] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T17:34:07.770164] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-11-03T17:34:07.934894] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-11-03T17:34:08.734895] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-11-03T17:34:09.155355] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T17:34:09.534884] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-11-03T17:34:10.058237] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-11-03T17:34:10.334857] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-11-03T17:34:10.396120] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-11-03T17:34:11.134894] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-11-03T17:34:11.397507] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T17:34:11.934865] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-11-03T17:34:12.515265] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T17:34:12.562849] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T17:34:12.734850] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-11. [2025-11-03T17:34:13.534924] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-11-03T17:34:14.334904] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-11-03T17:34:14.341978] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-11 (1.61 seconds). [2025-11-03T17:34:14.343662] [INFO ] [REMOTE ] BFAM: Full fetch complete (48222 records). [2025-11-03T17:34:14.343756] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-11-03T17:34:14.742022] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-11-03T17:34:14.742188] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-11-03T17:34:14.742892] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-11-03T17:34:14.742975] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-11-03T17:34:14.768126] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T17:34:14.766902] [DEBUG] [LOCAL ] BFAM: Trimmed 48222 records to 34252 (keeping 200 days of data) [2025-11-03T17:34:14.978675] [DEBUG] [LOCAL ] BFAM: Primary data saved (34252 records). [2025-11-03T17:34:14.978837] [INFO ] [MAIN ] BFAM: Full history saved. [2025-11-03T17:34:14.978929] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 37.9s. Estimated remaining: 4h 45m 31s. Rate: 7.4 symbols/min [2025-11-03T17:34:15.153122] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-11-03T17:34:15.156399] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:15.157273] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-11-03T17:34:15.157319] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-11-03T17:34:15.157428] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-11-03T17:34:15.157472] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-11-03T17:34:15.157536] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-11-03T17:34:15.157572] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-11-03T17:34:15.529260] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:15.701182] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T17:34:15.934877] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-11-03T17:34:16.089368] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T17:34:16.734971] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-11-03T17:34:17.032112] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T17:34:17.372983] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T17:34:17.534852] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-11-03T17:34:18.098265] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T17:34:18.334842] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-11-03T17:34:18.944029] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T17:34:19.134904] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-11-03T17:34:19.934879] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-11-03T17:34:20.377954] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T17:34:20.453041] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T17:34:20.734876] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-11-03T17:34:21.261870] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-11-03T17:34:21.534853] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-11-03T17:34:22.334904] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-11-03T17:34:22.868945] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-11-03T17:34:23.137217] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-11-03T17:34:23.142148] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T17:34:23.879794] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T17:34:23.934885] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-11-03T17:34:24.641557] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T17:34:24.734868] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-11-03T17:34:25.534867] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-11. [2025-11-03T17:34:25.956621] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T17:34:26.334849] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-11. [2025-11-03T17:34:26.565297] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T17:34:26.566284] [INFO ] [REMOTE ] BFK: Full fetch complete (19824 records). [2025-11-03T17:34:26.566352] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-11-03T17:34:26.924350] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-11-03T17:34:26.924428] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-11-03T17:34:26.924793] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-11-03T17:34:26.924853] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-11-03T17:34:26.925407] [DEBUG] [LOCAL ] BFK: Trimmed 19824 records to 13771 (keeping 200 days of data) [2025-11-03T17:34:27.004329] [DEBUG] [LOCAL ] BFK: Primary data saved (13771 records). [2025-11-03T17:34:27.004457] [INFO ] [MAIN ] BFK: Full history saved. [2025-11-03T17:34:27.004540] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFK took 31.6s. Estimated remaining: 4h 45m 56s. Rate: 7.4 symbols/min [2025-11-03T17:34:27.142915] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-11-03T17:34:27.176680] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:27.176849] [DEBUG] [LOCAL ] BFZ: No existing data file found in primary storage. [2025-11-03T17:34:27.176893] [WARN ] [MAIN ] BFZ: No existing data found, performing full refresh instead. [2025-11-03T17:34:27.177022] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-11-03T17:34:27.177063] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-11-03T17:34:27.177104] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-11-03T17:34:27.177135] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-11-03T17:34:27.532111] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:27.934878] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-11-03T17:34:28.160622] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T17:34:28.161922] [INFO ] [REMOTE ] BFH: Full fetch complete (60307 records). [2025-11-03T17:34:28.162003] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-11-03T17:34:28.538196] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-11-03T17:34:28.538283] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-11-03T17:34:28.538994] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-11-03T17:34:28.539060] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-11-03T17:34:28.540389] [DEBUG] [LOCAL ] BFH: Trimmed 60307 records to 40812 (keeping 200 days of data) [2025-11-03T17:34:28.672534] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T17:34:28.757925] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-11-03T17:34:28.797857] [DEBUG] [LOCAL ] BFH: Primary data saved (40812 records). [2025-11-03T17:34:28.798011] [INFO ] [MAIN ] BFH: Full history saved. [2025-11-03T17:34:28.798767] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFH took 35.6s. Estimated remaining: 4h 44m 55s. Rate: 7.4 symbols/min [2025-11-03T17:34:28.954125] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-11-03T17:34:29.013382] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:29.060012] [DEBUG] [LOCAL ] BG: Loaded 51068 existing records from primary storage. [2025-11-03T17:34:29.060333] [INFO ] [MAIN ] BG: Loaded 51068 existing records. [2025-11-03T17:34:29.243006] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:34:29.243223] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-11-03T17:34:29.243271] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-11-03T17:34:29.244170] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-11-03T17:34:29.244229] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-11-03T17:34:29.367753] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T17:34:29.540128] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-11-03T17:34:29.646407] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:30.334892] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-11-03T17:34:30.543792] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T17:34:31.134883] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-11-03T17:34:31.730466] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T17:34:31.934875] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-11-03T17:34:32.734883] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-11-03T17:34:32.807588] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-11-03T17:34:33.188359] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T17:34:33.376935] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T17:34:33.534861] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-11-03T17:34:34.334967] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-11-03T17:34:35.030539] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T17:34:35.134859] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-11-03T17:34:35.673254] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-11-03T17:34:35.730262] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T17:34:35.934842] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-11-03T17:34:36.734861] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-11-03T17:34:37.370050] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T17:34:37.534847] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-11-03T17:34:38.334889] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-11-03T17:34:38.403570] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T17:34:38.814293] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T17:34:38.835207] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T17:34:39.134904] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-11-03T17:34:39.791581] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-11-03T17:34:39.934877] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-11-03T17:34:40.734893] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-11-03T17:34:41.329186] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T17:34:41.345372] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T17:34:41.534855] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-11-03T17:34:42.097065] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T17:34:42.334901] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-11. [2025-11-03T17:34:43.134908] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-11-03T17:34:43.885164] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:34:43.934843] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-11-03T17:34:44.595477] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T17:34:44.734853] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-11-03T17:34:45.364172] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-11 (3.03 seconds). [2025-11-03T17:34:45.365773] [INFO ] [REMOTE ] BFLY: Full fetch complete (75482 records). [2025-11-03T17:34:45.365870] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-11-03T17:34:45.549489] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-11-03T17:34:45.783806] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-11-03T17:34:45.783924] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-11-03T17:34:45.785073] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-11-03T17:34:45.785148] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-11-03T17:34:45.786613] [DEBUG] [LOCAL ] BFLY: Trimmed 75482 records to 51854 (keeping 200 days of data) [2025-11-03T17:34:46.074397] [DEBUG] [LOCAL ] BFLY: Primary data saved (51854 records). [2025-11-03T17:34:46.074678] [INFO ] [MAIN ] BFLY: Full history saved. [2025-11-03T17:34:46.074771] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFLY took 47.4s. Estimated remaining: 4h 46m 3s. Rate: 7.4 symbols/min [2025-11-03T17:34:46.249226] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:46.259753] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T17:34:46.299747] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T17:34:46.318095] [DEBUG] [LOCAL ] BGB: Loaded 17236 existing records from primary storage. [2025-11-03T17:34:46.318401] [INFO ] [MAIN ] BGB: Loaded 17236 existing records. [2025-11-03T17:34:46.343078] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-11-03T17:34:46.504473] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:34:46.504721] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-11-03T17:34:46.504778] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-11-03T17:34:46.505192] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-11-03T17:34:46.505248] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-11-03T17:34:46.860445] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:47.050101] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T17:34:47.134854] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-11-03T17:34:47.934874] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-11-03T17:34:47.961540] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T17:34:48.734832] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-11-03T17:34:49.318062] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T17:34:49.350273] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T17:34:49.534860] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-11-03T17:34:50.334898] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-11-03T17:34:50.792867] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T17:34:51.134837] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-11. [2025-11-03T17:34:51.357638] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T17:34:51.793963] [DEBUG] [REMOTE ] BFZ: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:34:51.794230] [WARN ] [REMOTE ] BFZ: No data returned for month 2025-11 [2025-11-03T17:34:51.794321] [FATAL] [REMOTE ] BFZ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:34:51.794400] [FATAL] [MAIN ] BFZ: Failed to fetch primary data. [2025-11-03T17:34:51.794464] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:34:51.794536] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-11-03T17:34:51.794624] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-11-03T17:34:51.794715] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-11-03T17:34:51.794777] [DEBUG] [LOCAL ] BFZ: No derivative data file found to delete. [2025-11-03T17:34:51.794826] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFZ took 24.8s. Estimated remaining: 4h 45m 35s. Rate: 7.4 symbols/min [2025-11-03T17:34:51.942144] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-11-03T17:34:51.968512] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:51.968717] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-11-03T17:34:51.968767] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-11-03T17:34:51.968877] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-11-03T17:34:51.968921] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-11-03T17:34:51.968961] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-11-03T17:34:51.968992] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-11-03T17:34:52.405001] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:52.734901] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-11-03T17:34:53.388123] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-11-03T17:34:53.496501] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-11-03T17:34:53.534842] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-11-03T17:34:54.301818] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T17:34:54.334857] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-11-03T17:34:55.023283] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T17:34:55.134853] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-11. [2025-11-03T17:34:55.934853] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-11. [2025-11-03T17:34:55.998959] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T17:34:56.000083] [INFO ] [REMOTE ] BFS: Full fetch complete (13226 records). [2025-11-03T17:34:56.000165] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-11-03T17:34:56.389366] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-11-03T17:34:56.389447] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-11-03T17:34:56.389785] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-11-03T17:34:56.389848] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-11-03T17:34:56.390396] [DEBUG] [LOCAL ] BFS: Trimmed 13226 records to 9555 (keeping 200 days of data) [2025-11-03T17:34:56.449169] [DEBUG] [LOCAL ] BFS: Primary data saved (9555 records). [2025-11-03T17:34:56.449502] [INFO ] [MAIN ] BFS: Full history saved. [2025-11-03T17:34:56.449576] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFS took 41.5s. Estimated remaining: 4h 44m 58s. Rate: 7.4 symbols/min [2025-11-03T17:34:56.625781] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:56.639725] [DEBUG] [LOCAL ] BGR: Loaded 13100 existing records from primary storage. [2025-11-03T17:34:56.639991] [INFO ] [MAIN ] BGR: Loaded 13100 existing records. [2025-11-03T17:34:56.740678] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-11-03T17:34:56.832511] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:34:56.832796] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-11-03T17:34:56.832848] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-11-03T17:34:56.833221] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-11-03T17:34:56.833282] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-11-03T17:34:57.120392] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T17:34:57.142882] [INFO ] [REMOTE ] BG: Full fetch complete (72987 records). [2025-11-03T17:34:57.166213] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-11-03T17:34:57.270130] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:57.538828] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-11-03T17:34:57.627283] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-11-03T17:34:57.627388] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-11-03T17:34:57.628245] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-11-03T17:34:57.628325] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-11-03T17:34:57.645633] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T17:34:57.651684] [DEBUG] [LOCAL ] BG: Trimmed 72987 records to 50370 (keeping 200 days of data) [2025-11-03T17:34:57.952120] [DEBUG] [LOCAL ] BG: Primary data saved (50370 records). [2025-11-03T17:34:57.952249] [INFO ] [MAIN ] BG: Full history saved. [2025-11-03T17:34:57.953003] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BG took 29.2s. Estimated remaining: 4h 43m 56s. Rate: 7.4 symbols/min [2025-11-03T17:34:58.123308] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:34:58.169078] [DEBUG] [LOCAL ] BGS: Loaded 51201 existing records from primary storage. [2025-11-03T17:34:58.169397] [INFO ] [MAIN ] BGS: Loaded 51201 existing records. [2025-11-03T17:34:58.335154] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-11-03T17:34:58.360684] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:34:58.361991] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-11-03T17:34:58.362084] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-11-03T17:34:58.363104] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-11-03T17:34:58.363169] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-11-03T17:34:58.552468] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T17:34:58.748150] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:34:59.050350] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-11-03T17:34:59.134883] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-11-03T17:34:59.934897] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-11-03T17:35:00.620802] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T17:35:00.734882] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-11-03T17:35:00.824619] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T17:35:01.534863] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-11-03T17:35:01.771353] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T17:35:02.127517] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-11-03T17:35:02.334880] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-11-03T17:35:03.134843] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-11-03T17:35:03.181476] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T17:35:03.934828] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-11-03T17:35:03.983754] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T17:35:04.734895] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-11-03T17:35:05.252173] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T17:35:05.424189] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-11-03T17:35:05.534911] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-11-03T17:35:06.197004] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T17:35:06.334865] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-11-03T17:35:07.070759] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T17:35:07.134839] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-11-03T17:35:07.740200] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T17:35:07.934864] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-11-03T17:35:08.734860] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-11-03T17:35:09.365374] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T17:35:09.512296] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-11-03T17:35:09.534877] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-11-03T17:35:10.142686] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T17:35:10.334872] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-11-03T17:35:10.920806] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T17:35:11.134878] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-11-03T17:35:11.934850] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-11-03T17:35:12.386613] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T17:35:12.546502] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T17:35:12.734869] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-11-03T17:35:13.534860] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-11-03T17:35:14.036020] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:35:14.169859] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T17:35:14.334872] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-11-03T17:35:15.118485] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T17:35:15.134842] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-11-03T17:35:15.795208] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-11-03T17:35:15.934837] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-11-03T17:35:16.734853] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-11-03T17:35:17.173878] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T17:35:17.525760] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-11-03T17:35:17.534800] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-11-03T17:35:18.242562] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-11-03T17:35:18.334894] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-11-03T17:35:19.036089] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T17:35:19.134839] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-11. [2025-11-03T17:35:19.934857] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-11-03T17:35:20.195548] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T17:35:20.196671] [INFO ] [REMOTE ] BGB: Full fetch complete (26255 records). [2025-11-03T17:35:20.196746] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-11-03T17:35:20.572363] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T17:35:20.615261] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-11-03T17:35:20.615384] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-11-03T17:35:20.616185] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-11-03T17:35:20.616252] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-11-03T17:35:20.617339] [DEBUG] [LOCAL ] BGB: Trimmed 26255 records to 16950 (keeping 200 days of data) [2025-11-03T17:35:20.726595] [DEBUG] [LOCAL ] BGB: Primary data saved (16950 records). [2025-11-03T17:35:20.726947] [INFO ] [MAIN ] BGB: Full history saved. [2025-11-03T17:35:20.727066] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BGB took 34.7s. Estimated remaining: 4h 45m 47s. Rate: 7.4 symbols/min [2025-11-03T17:35:20.739992] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-11. [2025-11-03T17:35:20.917758] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:20.928521] [DEBUG] [LOCAL ] BGSF: Loaded 8442 existing records from primary storage. [2025-11-03T17:35:20.928821] [INFO ] [MAIN ] BGSF: Loaded 8442 existing records. [2025-11-03T17:35:21.113335] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:35:21.113683] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-11-03T17:35:21.113786] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-11-03T17:35:21.114194] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-11-03T17:35:21.114261] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-11-03T17:35:21.485543] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:21.534907] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-11-03T17:35:21.848506] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T17:35:21.849330] [INFO ] [REMOTE ] BGH: Full fetch complete (23070 records). [2025-11-03T17:35:21.849402] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-11-03T17:35:22.136151] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T17:35:22.219189] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-11-03T17:35:22.219269] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-11-03T17:35:22.219667] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-11-03T17:35:22.219728] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-11-03T17:35:22.220344] [DEBUG] [LOCAL ] BGH: Trimmed 23070 records to 16442 (keeping 200 days of data) [2025-11-03T17:35:22.319936] [DEBUG] [LOCAL ] BGH: Primary data saved (16442 records). [2025-11-03T17:35:22.320092] [INFO ] [MAIN ] BGH: Full history saved. [2025-11-03T17:35:22.320166] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGH took 30.5s. Estimated remaining: 4h 44m 46s. Rate: 7.4 symbols/min [2025-11-03T17:35:22.340700] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-11-03T17:35:22.489501] [INFO ] [MAIN ] BGSI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:22.489711] [DEBUG] [LOCAL ] BGSI: No existing data file found in primary storage. [2025-11-03T17:35:22.489768] [WARN ] [MAIN ] BGSI: No existing data found, performing full refresh instead. [2025-11-03T17:35:22.489878] [INFO ] [MAIN ] BGSI: Wiping existing primary data before full refresh. [2025-11-03T17:35:22.489921] [INFO ] [LOCAL ] BGSI: Starting deletion of primary data. [2025-11-03T17:35:22.489961] [DEBUG] [LOCAL ] BGSI: No primary data file found to delete. [2025-11-03T17:35:22.489996] [INFO ] [MAIN ] BGSI: Starting full primary refresh. [2025-11-03T17:35:22.832776] [INFO ] [REMOTE ] BGSI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:23.134920] [INFO ] [REMOTE ] BGSI: Fetching primary data for 2025-01. [2025-11-03T17:35:23.321101] [DEBUG] [REMOTE ] BGSI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:35:23.321416] [WARN ] [REMOTE ] BGSI: No data returned for month 2025-01 [2025-11-03T17:35:23.321503] [FATAL] [REMOTE ] BGSI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:35:23.321555] [FATAL] [MAIN ] BGSI: Failed to fetch primary data. [2025-11-03T17:35:23.321617] [WARN ] [MAIN ] BGSI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:35:23.321706] [INFO ] [LOCAL ] BGSI: Starting deletion of primary data. [2025-11-03T17:35:23.321772] [DEBUG] [LOCAL ] BGSI: No primary data file found to delete. [2025-11-03T17:35:23.321808] [INFO ] [LOCAL ] BGSI: Starting deletion of derivative data. [2025-11-03T17:35:23.321846] [DEBUG] [LOCAL ] BGSI: No derivative data file found to delete. [2025-11-03T17:35:23.321890] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGSI took 1.0s. Estimated remaining: 4h 43m 41s. Rate: 7.4 symbols/min [2025-11-03T17:35:23.487142] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:23.505484] [DEBUG] [LOCAL ] BGT: Loaded 15966 existing records from primary storage. [2025-11-03T17:35:23.505745] [INFO ] [MAIN ] BGT: Loaded 15966 existing records. [2025-11-03T17:35:23.676843] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:35:23.677091] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-11-03T17:35:23.677148] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-11-03T17:35:23.677521] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-11-03T17:35:23.677577] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-11-03T17:35:23.940093] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-11-03T17:35:24.034899] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:24.063095] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-11-03T17:35:24.233768] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T17:35:24.734848] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-11-03T17:35:24.792703] [DEBUG] [REMOTE ] BGS: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-11-03T17:35:24.792922] [WARN ] [REMOTE ] BGS: No data returned for month 2025-08 [2025-11-03T17:35:24.793004] [FATAL] [REMOTE ] BGS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:35:24.793081] [FATAL] [MAIN ] BGS: Failed to fetch primary data. [2025-11-03T17:35:24.793138] [WARN ] [MAIN ] BGS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:35:24.793186] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-11-03T17:35:24.793236] [DEBUG] [LOCAL ] BGS: No primary data file found to delete. [2025-11-03T17:35:24.793278] [INFO ] [LOCAL ] BGS: Starting deletion of derivative data. [2025-11-03T17:35:24.793433] [DEBUG] [LOCAL ] BGS: Deleted derivative data file. [2025-11-03T17:35:24.794023] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BGS took 26.8s. Estimated remaining: 4h 42m 40s. Rate: 7.4 symbols/min [2025-11-03T17:35:24.968200] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:24.980575] [DEBUG] [LOCAL ] BGX: Loaded 11131 existing records from primary storage. [2025-11-03T17:35:24.980831] [INFO ] [MAIN ] BGX: Loaded 11131 existing records. [2025-11-03T17:35:25.159922] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:35:25.160120] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-11-03T17:35:25.160168] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-11-03T17:35:25.160447] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-11-03T17:35:25.160505] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-11-03T17:35:25.528799] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:25.534815] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-11-03T17:35:26.334862] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-11-03T17:35:26.393058] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-11-03T17:35:26.746860] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-11-03T17:35:27.134881] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-11-03T17:35:27.934866] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-11-03T17:35:28.336074] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:35:28.543680] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T17:35:28.734847] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-11-03T17:35:29.328763] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T17:35:29.534878] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-11-03T17:35:30.183361] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T17:35:30.334829] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-11-03T17:35:30.975394] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-11-03T17:35:31.134943] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-11-03T17:35:31.655634] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-11-03T17:35:31.934858] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-11-03T17:35:32.299472] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-11-03T17:35:32.734850] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-11-03T17:35:33.060536] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-11-03T17:35:33.534848] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-11-03T17:35:34.020238] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T17:35:34.334849] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-11-03T17:35:34.998706] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T17:35:35.134864] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-11-03T17:35:35.890808] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T17:35:35.934842] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-11-03T17:35:36.489073] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-11-03T17:35:36.734900] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-11-03T17:35:37.202049] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-11-03T17:35:37.534865] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-11-03T17:35:38.264622] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T17:35:38.334823] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-11-03T17:35:38.849485] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-11-03T17:35:39.134922] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-11-03T17:35:39.626493] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-11-03T17:35:39.934869] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-11-03T17:35:40.660043] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T17:35:40.734854] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-11-03T17:35:41.249886] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-11-03T17:35:41.534860] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-11-03T17:35:42.116467] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T17:35:42.334851] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-11-03T17:35:43.134861] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-11-03T17:35:43.315956] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-11-03T17:35:43.934865] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-11-03T17:35:44.020524] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:35:44.557823] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T17:35:44.734888] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-11. [2025-11-03T17:35:45.534851] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-11-03T17:35:45.708436] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T17:35:45.709493] [INFO ] [REMOTE ] BGX: Full fetch complete (16607 records). [2025-11-03T17:35:45.709565] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-11-03T17:35:46.149418] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-11-03T17:35:46.149673] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-11-03T17:35:46.150313] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-11-03T17:35:46.150441] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-11-03T17:35:46.151187] [DEBUG] [LOCAL ] BGX: Trimmed 16607 records to 11123 (keeping 200 days of data) [2025-11-03T17:35:46.221116] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T17:35:46.230373] [DEBUG] [LOCAL ] BGX: Primary data saved (11123 records). [2025-11-03T17:35:46.230610] [INFO ] [MAIN ] BGX: Full history saved. [2025-11-03T17:35:46.234046] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGX took 21.4s. Estimated remaining: 4h 44m 19s. Rate: 7.4 symbols/min [2025-11-03T17:35:46.339960] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-11. [2025-11-03T17:35:46.435938] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:46.454757] [DEBUG] [LOCAL ] BGY: Loaded 21343 existing records from primary storage. [2025-11-03T17:35:46.455009] [INFO ] [MAIN ] BGY: Loaded 21343 existing records. [2025-11-03T17:35:46.626691] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:35:46.626889] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-11-03T17:35:46.626970] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-11-03T17:35:46.627450] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-11-03T17:35:46.627508] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-11-03T17:35:46.996994] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:47.134840] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-11-03T17:35:47.254144] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T17:35:47.255075] [INFO ] [REMOTE ] BGR: Full fetch complete (19854 records). [2025-11-03T17:35:47.255169] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-11-03T17:35:47.629334] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-11-03T17:35:47.629413] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-11-03T17:35:47.629863] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-11-03T17:35:47.629925] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-11-03T17:35:47.630499] [DEBUG] [LOCAL ] BGR: Trimmed 19854 records to 12841 (keeping 200 days of data) [2025-11-03T17:35:47.707373] [DEBUG] [LOCAL ] BGR: Primary data saved (12841 records). [2025-11-03T17:35:47.707510] [INFO ] [MAIN ] BGR: Full history saved. [2025-11-03T17:35:47.707588] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGR took 51.3s. Estimated remaining: 4h 43m 18s. Rate: 7.4 symbols/min [2025-11-03T17:35:47.879898] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:47.896038] [DEBUG] [LOCAL ] BH: Loaded 16852 existing records from primary storage. [2025-11-03T17:35:47.896306] [INFO ] [MAIN ] BH: Loaded 16852 existing records. [2025-11-03T17:35:47.939942] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-11-03T17:35:48.078940] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:35:48.079181] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-11-03T17:35:48.079235] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-11-03T17:35:48.079625] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-11-03T17:35:48.079716] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-11-03T17:35:48.338755] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:35:48.462155] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:48.577381] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-11-03T17:35:48.734855] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-11-03T17:35:49.430035] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T17:35:49.534855] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-11-03T17:35:50.334857] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-11-03T17:35:50.482170] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T17:35:51.065797] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T17:35:51.134835] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-11-03T17:35:51.796863] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T17:35:51.934864] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-11-03T17:35:52.636742] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T17:35:52.734887] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-11-03T17:35:53.534859] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-10. [2025-11-03T17:35:53.746564] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T17:35:54.274411] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-11-03T17:35:54.334826] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-11. [2025-11-03T17:35:55.134852] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-11-03T17:35:55.286247] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-11 (0.95 seconds). [2025-11-03T17:35:55.287042] [INFO ] [REMOTE ] BGSF: Full fetch complete (9857 records). [2025-11-03T17:35:55.287109] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-11-03T17:35:55.650849] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-11-03T17:35:55.650931] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-11-03T17:35:55.651180] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-11-03T17:35:55.651218] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-11-03T17:35:55.651711] [DEBUG] [LOCAL ] BGSF: Trimmed 9857 records to 8446 (keeping 200 days of data) [2025-11-03T17:35:55.702482] [DEBUG] [LOCAL ] BGSF: Primary data saved (8446 records). [2025-11-03T17:35:55.702675] [INFO ] [MAIN ] BGSF: Full history saved. [2025-11-03T17:35:55.702783] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGSF took 35.0s. Estimated remaining: 4h 43m 9s. Rate: 7.4 symbols/min [2025-11-03T17:35:55.876984] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:35:55.892807] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T17:35:55.935021] [DEBUG] [LOCAL ] BHC: Loaded 47161 existing records from primary storage. [2025-11-03T17:35:55.935111] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-11-03T17:35:55.935586] [INFO ] [MAIN ] BHC: Loaded 47161 existing records. [2025-11-03T17:35:56.127468] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:35:56.127742] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-11-03T17:35:56.127796] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-11-03T17:35:56.128481] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-11-03T17:35:56.128539] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-11-03T17:35:56.447414] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-11-03T17:35:56.530859] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:35:56.734843] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-11-03T17:35:57.401683] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-11-03T17:35:57.534839] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-11-03T17:35:58.319225] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T17:35:58.334807] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-11-03T17:35:59.005013] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T17:35:59.134882] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-11-03T17:35:59.934833] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-11-03T17:36:00.011365] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T17:36:00.734847] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-11-03T17:36:01.030022] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T17:36:01.534901] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-11-03T17:36:01.773804] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:36:02.229494] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T17:36:02.334934] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-11-03T17:36:03.127990] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T17:36:03.134804] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-11-03T17:36:03.875061] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T17:36:03.934859] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-11-03T17:36:04.734853] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-11-03T17:36:05.049696] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T17:36:05.247009] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T17:36:05.534851] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-11-03T17:36:06.334876] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-11-03T17:36:06.747916] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:36:07.133758] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-11-03T17:36:07.138730] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-11-03T17:36:07.934853] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-11. [2025-11-03T17:36:08.348083] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T17:36:08.511207] [DEBUG] [REMOTE ] BGT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:36:08.511492] [WARN ] [REMOTE ] BGT: No data returned for month 2025-11 [2025-11-03T17:36:08.511595] [FATAL] [REMOTE ] BGT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:36:08.511714] [FATAL] [MAIN ] BGT: Failed to fetch primary data. [2025-11-03T17:36:08.511792] [WARN ] [MAIN ] BGT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:36:08.511874] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-11-03T17:36:08.511956] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-11-03T17:36:08.512007] [INFO ] [LOCAL ] BGT: Starting deletion of derivative data. [2025-11-03T17:36:08.512199] [DEBUG] [LOCAL ] BGT: Deleted derivative data file. [2025-11-03T17:36:08.512300] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BGT took 45.2s. Estimated remaining: 4h 43m 38s. Rate: 7.4 symbols/min [2025-11-03T17:36:08.679314] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:08.679484] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-11-03T17:36:08.679520] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-11-03T17:36:08.679626] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-11-03T17:36:08.679708] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-11-03T17:36:08.679793] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-11-03T17:36:08.679855] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-11-03T17:36:08.740729] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-11-03T17:36:09.034596] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:09.534865] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-11. [2025-11-03T17:36:10.036504] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:36:10.334820] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-11-03T17:36:10.789773] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-11 (1.25 seconds). [2025-11-03T17:36:10.790956] [INFO ] [REMOTE ] BGY: Full fetch complete (33068 records). [2025-11-03T17:36:10.791026] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-11-03T17:36:11.146563] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-11-03T17:36:11.161078] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-11-03T17:36:11.161158] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-11-03T17:36:11.161729] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-11-03T17:36:11.161791] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-11-03T17:36:11.162698] [DEBUG] [LOCAL ] BGY: Trimmed 33068 records to 21337 (keeping 200 days of data) [2025-11-03T17:36:11.285226] [DEBUG] [LOCAL ] BGY: Primary data saved (21337 records). [2025-11-03T17:36:11.285343] [INFO ] [MAIN ] BGY: Full history saved. [2025-11-03T17:36:11.285416] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BGY took 25.1s. Estimated remaining: 4h 42m 48s. Rate: 7.4 symbols/min [2025-11-03T17:36:11.456758] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:11.456937] [DEBUG] [LOCAL ] BHK: No existing data file found in primary storage. [2025-11-03T17:36:11.456996] [WARN ] [MAIN ] BHK: No existing data found, performing full refresh instead. [2025-11-03T17:36:11.457104] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-11-03T17:36:11.457145] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-11-03T17:36:11.457186] [DEBUG] [LOCAL ] BHK: No primary data file found to delete. [2025-11-03T17:36:11.457217] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-11-03T17:36:11.822599] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:11.873092] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T17:36:11.871879] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T17:36:11.934819] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-11-03T17:36:12.733602] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T17:36:12.738963] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-11-03T17:36:13.534872] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-11-03T17:36:13.978236] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T17:36:14.334857] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-11-03T17:36:14.596805] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T17:36:15.134864] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-11-03T17:36:15.608887] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:36:15.665972] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T17:36:15.934903] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-11-03T17:36:16.734905] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-11-03T17:36:17.264699] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T17:36:17.534906] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-11-03T17:36:17.711461] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T17:36:18.334837] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-11-03T17:36:18.380093] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T17:36:18.963211] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T17:36:19.134868] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-11-03T17:36:19.765728] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-11-03T17:36:19.934870] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-11-03T17:36:20.728607] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T17:36:20.734808] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-11-03T17:36:21.519195] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T17:36:21.534803] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-11-03T17:36:22.132673] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-11-03T17:36:22.334867] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-11. [2025-11-03T17:36:23.134848] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-10. [2025-11-03T17:36:23.300026] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T17:36:23.300755] [INFO ] [REMOTE ] BH: Full fetch complete (19656 records). [2025-11-03T17:36:23.300822] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-11-03T17:36:23.650830] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-11-03T17:36:23.650903] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-11-03T17:36:23.651242] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-11-03T17:36:23.651281] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-11-03T17:36:23.651850] [DEBUG] [LOCAL ] BH: Trimmed 19656 records to 16756 (keeping 200 days of data) [2025-11-03T17:36:23.745596] [DEBUG] [LOCAL ] BH: Primary data saved (16756 records). [2025-11-03T17:36:23.745750] [INFO ] [MAIN ] BH: Full history saved. [2025-11-03T17:36:23.745832] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BH took 36.0s. Estimated remaining: 4h 43m 14s. Rate: 7.4 symbols/min [2025-11-03T17:36:23.910506] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:23.910685] [DEBUG] [LOCAL ] BHP: No existing data file found in primary storage. [2025-11-03T17:36:23.910739] [WARN ] [MAIN ] BHP: No existing data found, performing full refresh instead. [2025-11-03T17:36:23.910851] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-11-03T17:36:23.910893] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-11-03T17:36:23.910937] [DEBUG] [LOCAL ] BHP: No primary data file found to delete. [2025-11-03T17:36:23.910971] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-11-03T17:36:23.940742] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-11-03T17:36:24.259976] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:24.552050] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:36:24.734836] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-11. [2025-11-03T17:36:24.864944] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T17:36:25.534835] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-11-03T17:36:26.334934] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-11-03T17:36:26.462696] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-11 (1.73 seconds). [2025-11-03T17:36:26.464095] [INFO ] [REMOTE ] BHC: Full fetch complete (67803 records). [2025-11-03T17:36:26.464192] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-11-03T17:36:26.857075] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-11-03T17:36:26.857168] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-11-03T17:36:26.857930] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-11-03T17:36:26.857996] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-11-03T17:36:26.859332] [DEBUG] [LOCAL ] BHC: Trimmed 67803 records to 46417 (keeping 200 days of data) [2025-11-03T17:36:27.108098] [DEBUG] [LOCAL ] BHC: Primary data saved (46417 records). [2025-11-03T17:36:27.108222] [INFO ] [MAIN ] BHC: Full history saved. [2025-11-03T17:36:27.108813] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHC took 31.4s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-11-03T17:36:27.140448] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-11-03T17:36:27.290238] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:27.308036] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T17:36:27.330826] [DEBUG] [LOCAL ] BHR: Loaded 22020 existing records from primary storage. [2025-11-03T17:36:27.331061] [INFO ] [MAIN ] BHR: Loaded 22020 existing records. [2025-11-03T17:36:27.519116] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:36:27.519467] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-11-03T17:36:27.519556] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-11-03T17:36:27.520180] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-11-03T17:36:27.520283] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-11-03T17:36:27.652080] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-11-03T17:36:27.927309] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:27.934806] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-11-03T17:36:28.007240] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-11-03T17:36:28.734918] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-11-03T17:36:29.311357] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T17:36:29.534885] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-11-03T17:36:29.758387] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T17:36:30.334882] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-11-03T17:36:31.134828] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-11-03T17:36:31.173634] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-11-03T17:36:31.275908] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-11-03T17:36:31.606925] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-11-03T17:36:31.934853] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-11-03T17:36:32.699853] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T17:36:32.734815] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-11-03T17:36:33.534836] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-11-03T17:36:33.602087] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-11-03T17:36:34.334867] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-11-03T17:36:34.999354] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T17:36:35.134817] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-11-03T17:36:35.167859] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-11-03T17:36:35.934881] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-11-03T17:36:36.622065] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T17:36:36.740452] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-11-03T17:36:36.753639] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-11-03T17:36:37.534830] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-11-03T17:36:37.656344] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T17:36:38.333997] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T17:36:38.338811] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-11-03T17:36:39.110118] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T17:36:39.134822] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-11-03T17:36:39.934830] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-11-03T17:36:39.993238] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T17:36:40.734845] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-11-03T17:36:40.925522] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T17:36:41.421818] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T17:36:41.534862] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-11-03T17:36:42.334835] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-11-03T17:36:42.386100] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T17:36:43.134892] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-11-03T17:36:43.831170] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-11-03T17:36:43.926471] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:36:43.934803] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-11. [2025-11-03T17:36:44.734846] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-11-03T17:36:45.193263] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-11 (1.26 seconds). [2025-11-03T17:36:45.194240] [INFO ] [REMOTE ] BHR: Full fetch complete (30937 records). [2025-11-03T17:36:45.194313] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-11-03T17:36:45.540095] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-11-03T17:36:45.580706] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-11-03T17:36:45.580828] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-11-03T17:36:45.594708] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-11-03T17:36:45.594844] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-11-03T17:36:45.596276] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T17:36:45.603167] [DEBUG] [LOCAL ] BHR: Trimmed 30937 records to 21411 (keeping 200 days of data) [2025-11-03T17:36:45.721688] [DEBUG] [LOCAL ] BHR: Primary data saved (21411 records). [2025-11-03T17:36:45.721813] [INFO ] [MAIN ] BHR: Full history saved. [2025-11-03T17:36:45.721890] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHR took 18.6s. Estimated remaining: 4h 43m 42s. Rate: 7.4 symbols/min [2025-11-03T17:36:45.913521] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:45.913742] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-11-03T17:36:45.913789] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-11-03T17:36:45.913897] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-11-03T17:36:45.913939] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-11-03T17:36:45.913980] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-11-03T17:36:45.914012] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-11-03T17:36:46.257684] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:46.334852] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-11-03T17:36:46.995524] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T17:36:47.074357] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-11-03T17:36:47.134833] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-11-03T17:36:47.776857] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-11-03T17:36:47.934854] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-11-03T17:36:48.734855] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-11-03T17:36:48.861552] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T17:36:49.534931] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-11-03T17:36:49.951609] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-11-03T17:36:50.202190] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T17:36:50.334856] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-11-03T17:36:51.134860] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-11-03T17:36:51.916468] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:36:51.934853] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-11-03T17:36:52.080089] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T17:36:52.734854] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-11-03T17:36:52.942848] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T17:36:53.539909] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-11-03T17:36:53.542988] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T17:36:54.334867] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-11-03T17:36:54.572326] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-11-03T17:36:55.134816] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-11-03T17:36:55.316430] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-11-03T17:36:55.397734] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-11-03T17:36:55.934855] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-11. [2025-11-03T17:36:56.734916] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-11. [2025-11-03T17:36:57.054055] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T17:36:57.055327] [INFO ] [REMOTE ] BHK: Full fetch complete (31105 records). [2025-11-03T17:36:57.055403] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-11-03T17:36:57.422572] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-11-03T17:36:57.422683] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-11-03T17:36:57.423183] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-11-03T17:36:57.423225] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-11-03T17:36:57.424015] [DEBUG] [LOCAL ] BHK: Trimmed 31105 records to 24447 (keeping 200 days of data) [2025-11-03T17:36:57.537843] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-11. [2025-11-03T17:36:57.564079] [DEBUG] [LOCAL ] BHK: Primary data saved (24447 records). [2025-11-03T17:36:57.564196] [INFO ] [MAIN ] BHK: Full history saved. [2025-11-03T17:36:57.564266] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHK took 46.3s. Estimated remaining: 4h 44m 3s. Rate: 7.4 symbols/min [2025-11-03T17:36:57.733780] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:57.783730] [DEBUG] [LOCAL ] BHVN: Loaded 51366 existing records from primary storage. [2025-11-03T17:36:57.784064] [INFO ] [MAIN ] BHVN: Loaded 51366 existing records. [2025-11-03T17:36:57.869154] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T17:36:57.896374] [INFO ] [REMOTE ] BHE: Full fetch complete (36450 records). [2025-11-03T17:36:57.912149] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-11-03T17:36:57.996175] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:36:58.031259] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-11-03T17:36:58.045958] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-11-03T17:36:58.070422] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-11-03T17:36:58.080967] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-11-03T17:36:58.366547] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-11-03T17:36:58.771684] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-11-03T17:36:58.774832] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:58.774892] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-11-03T17:36:58.775410] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-11-03T17:36:58.775486] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-11-03T17:36:58.776403] [DEBUG] [LOCAL ] BHE: Trimmed 36450 records to 23165 (keeping 200 days of data) [2025-11-03T17:36:58.865329] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T17:36:58.916574] [DEBUG] [LOCAL ] BHE: Primary data saved (23165 records). [2025-11-03T17:36:58.916724] [INFO ] [MAIN ] BHE: Full history saved. [2025-11-03T17:36:58.916801] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHE took 50.4s. Estimated remaining: 4h 43m 3s. Rate: 7.4 symbols/min [2025-11-03T17:36:59.085381] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:36:59.131624] [DEBUG] [LOCAL ] BILL: Loaded 53265 existing records from primary storage. [2025-11-03T17:36:59.131972] [INFO ] [MAIN ] BILL: Loaded 53265 existing records. [2025-11-03T17:36:59.143069] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-11-03T17:36:59.313809] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:36:59.314049] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-11-03T17:36:59.314097] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-11-03T17:36:59.314916] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-11-03T17:36:59.314974] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-11-03T17:36:59.668836] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:36:59.934848] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-11-03T17:37:00.272568] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-11 (2.73 seconds). [2025-11-03T17:37:00.274164] [INFO ] [REMOTE ] BHP: Full fetch complete (77450 records). [2025-11-03T17:37:00.274275] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-11-03T17:37:00.386594] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-11-03T17:37:00.674900] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-11-03T17:37:00.674986] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-11-03T17:37:00.675866] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-11-03T17:37:00.675937] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-11-03T17:37:00.677435] [DEBUG] [LOCAL ] BHP: Trimmed 77450 records to 53360 (keeping 200 days of data) [2025-11-03T17:37:00.737250] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-11-03T17:37:00.993927] [DEBUG] [LOCAL ] BHP: Primary data saved (53360 records). [2025-11-03T17:37:00.994026] [INFO ] [MAIN ] BHP: Full history saved. [2025-11-03T17:37:00.994094] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHP took 37.2s. Estimated remaining: 4h 42m 9s. Rate: 7.4 symbols/min [2025-11-03T17:37:01.179116] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:01.207895] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-11-03T17:37:01.236409] [DEBUG] [LOCAL ] BIO: Loaded 23756 existing records from primary storage. [2025-11-03T17:37:01.236700] [INFO ] [MAIN ] BIO: Loaded 23756 existing records. [2025-11-03T17:37:01.419477] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:01.419738] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-11-03T17:37:01.419823] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-11-03T17:37:01.420261] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-11-03T17:37:01.420317] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-11-03T17:37:01.539966] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-11-03T17:37:01.815274] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:01.934943] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T17:37:02.334921] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-11-03T17:37:02.522727] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-11-03T17:37:03.134837] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-11-03T17:37:03.230943] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T17:37:03.420199] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-11-03T17:37:03.934841] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-11-03T17:37:04.734834] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-11-03T17:37:05.388511] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-11-03T17:37:05.463844] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T17:37:05.534829] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-11-03T17:37:06.334876] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-11-03T17:37:06.715893] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T17:37:07.134862] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-11-03T17:37:07.707768] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T17:37:07.934864] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-11-03T17:37:08.173075] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T17:37:08.734898] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-11-03T17:37:09.116391] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T17:37:09.534876] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-11-03T17:37:09.805278] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-11-03T17:37:10.063993] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:37:10.334857] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-11-03T17:37:11.134913] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-11-03T17:37:11.934841] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-11-03T17:37:12.038090] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-11-03T17:37:12.564916] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T17:37:12.680085] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:37:12.734843] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-11-03T17:37:13.534843] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-11-03T17:37:13.661667] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T17:37:13.893540] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-11-03T17:37:14.334863] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-11-03T17:37:15.134876] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-11-03T17:37:15.934860] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-11-03T17:37:16.052935] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-11-03T17:37:16.081586] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-11-03T17:37:16.228833] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T17:37:16.734891] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-11. [2025-11-03T17:37:17.083888] [DEBUG] [REMOTE ] BHV: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:37:17.084206] [WARN ] [REMOTE ] BHV: No data returned for month 2025-11 [2025-11-03T17:37:17.084301] [FATAL] [REMOTE ] BHV: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:37:17.084413] [FATAL] [MAIN ] BHV: Failed to fetch primary data. [2025-11-03T17:37:17.084509] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:37:17.084595] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-11-03T17:37:17.084709] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-11-03T17:37:17.084773] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-11-03T17:37:17.084835] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-11-03T17:37:17.084906] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BHV took 31.4s. Estimated remaining: 4h 43m 1s. Rate: 7.4 symbols/min [2025-11-03T17:37:17.262235] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:17.295663] [DEBUG] [LOCAL ] BIP: Loaded 39036 existing records from primary storage. [2025-11-03T17:37:17.295939] [INFO ] [MAIN ] BIP: Loaded 39036 existing records. [2025-11-03T17:37:17.471762] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:17.471979] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-11-03T17:37:17.472028] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-11-03T17:37:17.472861] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-11-03T17:37:17.472920] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-11-03T17:37:17.540070] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-11-03T17:37:17.832968] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:18.319099] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-11-03T17:37:18.334811] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-11-03T17:37:19.043244] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T17:37:19.134884] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-11-03T17:37:19.934898] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-11-03T17:37:20.241315] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:37:20.734846] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-11-03T17:37:20.777139] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-11-03T17:37:21.534824] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-11-03T17:37:21.730273] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T17:37:22.334889] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-11. [2025-11-03T17:37:22.824194] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:37:23.008055] [DEBUG] [REMOTE ] BIO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:37:23.008394] [WARN ] [REMOTE ] BIO: No data returned for month 2025-11 [2025-11-03T17:37:23.008464] [FATAL] [REMOTE ] BIO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:37:23.008531] [FATAL] [MAIN ] BIO: Failed to fetch primary data. [2025-11-03T17:37:23.008567] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:37:23.008604] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-11-03T17:37:23.008684] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-11-03T17:37:23.008739] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-11-03T17:37:23.008919] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-11-03T17:37:23.009002] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BIO took 22.0s. Estimated remaining: 4h 42m 37s. Rate: 7.4 symbols/min [2025-11-03T17:37:23.148207] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-11-03T17:37:23.180796] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:23.216004] [DEBUG] [LOCAL ] BIPC: Loaded 41234 existing records from primary storage. [2025-11-03T17:37:23.216295] [INFO ] [MAIN ] BIPC: Loaded 41234 existing records. [2025-11-03T17:37:23.388867] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:23.389078] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-11-03T17:37:23.389125] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-11-03T17:37:23.389840] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-11-03T17:37:23.389899] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-11-03T17:37:23.739896] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:23.934844] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-11-03T17:37:24.470492] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T17:37:24.734869] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-11-03T17:37:25.143073] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T17:37:25.534856] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-11-03T17:37:26.264340] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T17:37:26.334854] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-11-03T17:37:26.500768] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-11-03T17:37:27.134849] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-11-03T17:37:27.522856] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:37:27.934854] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-11-03T17:37:28.495158] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-11-03T17:37:28.734913] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-11-03T17:37:29.318503] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T17:37:29.534888] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-11-03T17:37:30.033306] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T17:37:30.334870] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-11-03T17:37:30.751995] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T17:37:31.134858] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-11-03T17:37:31.637092] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T17:37:31.934847] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-11-03T17:37:32.631380] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T17:37:32.734869] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-11-03T17:37:33.117718] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:37:33.534872] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-11-03T17:37:33.810045] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T17:37:34.334928] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-11-03T17:37:34.706097] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T17:37:35.134910] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-11-03T17:37:35.423481] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T17:37:35.934931] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-11-03T17:37:36.583678] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T17:37:36.734883] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-11-03T17:37:37.534842] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-11-03T17:37:37.621273] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T17:37:38.268480] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T17:37:38.334851] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-11. [2025-11-03T17:37:38.635539] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T17:37:39.134912] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-11. [2025-11-03T17:37:39.934860] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-11-03T17:37:40.694471] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-11 (2.36 seconds). [2025-11-03T17:37:40.695962] [INFO ] [REMOTE ] BHVN: Full fetch complete (71001 records). [2025-11-03T17:37:40.696066] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-11-03T17:37:40.739934] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-11-03T17:37:41.098231] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-11-03T17:37:41.098345] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-11-03T17:37:41.099227] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-11-03T17:37:41.099365] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-11-03T17:37:41.117996] [DEBUG] [LOCAL ] BHVN: Trimmed 71001 records to 50717 (keeping 200 days of data) [2025-11-03T17:37:41.131388] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T17:37:41.145630] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-11 (2.01 seconds). [2025-11-03T17:37:41.148452] [INFO ] [REMOTE ] BILL: Full fetch complete (76141 records). [2025-11-03T17:37:41.148628] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-11-03T17:37:41.539705] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-11-03T17:37:42.079186] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-11-03T17:37:42.079361] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-11-03T17:37:42.085560] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-11-03T17:37:42.091127] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-11-03T17:37:42.167973] [DEBUG] [LOCAL ] BILL: Trimmed 76141 records to 52547 (keeping 200 days of data) [2025-11-03T17:37:42.250386] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T17:37:42.263979] [DEBUG] [LOCAL ] BHVN: Primary data saved (50717 records). [2025-11-03T17:37:42.314244] [INFO ] [MAIN ] BHVN: Full history saved. [2025-11-03T17:37:42.323236] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BHVN took 44.8s. Estimated remaining: 4h 43m 53s. Rate: 7.4 symbols/min [2025-11-03T17:37:42.336688] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-11-03T17:37:42.526965] [DEBUG] [LOCAL ] BILL: Primary data saved (52547 records). [2025-11-03T17:37:42.527195] [INFO ] [MAIN ] BILL: Full history saved. [2025-11-03T17:37:42.528185] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BILL took 43.6s. Estimated remaining: 4h 42m 45s. Rate: 7.4 symbols/min [2025-11-03T17:37:42.678312] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T17:37:43.134946] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-11-03T17:37:43.599362] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T17:37:43.934871] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-11-03T17:37:44.220086] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T17:37:44.734828] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-11-03T17:37:44.778874] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T17:37:45.534865] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-11-03T17:37:46.004794] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T17:37:46.334947] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-11-03T17:37:46.592842] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-11-03T17:37:47.134854] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-11. [2025-11-03T17:37:47.404377] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T17:37:47.934870] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-11. [2025-11-03T17:37:48.948982] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T17:37:48.950387] [INFO ] [REMOTE ] BIPC: Full fetch complete (60309 records). [2025-11-03T17:37:48.950477] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-11-03T17:37:49.326628] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-11-03T17:37:49.326726] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-11-03T17:37:49.327387] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-11-03T17:37:49.327448] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-11-03T17:37:49.328626] [DEBUG] [LOCAL ] BIPC: Trimmed 60309 records to 40678 (keeping 200 days of data) [2025-11-03T17:37:49.570855] [DEBUG] [LOCAL ] BIPC: Primary data saved (40678 records). [2025-11-03T17:37:49.570979] [INFO ] [MAIN ] BIPC: Full history saved. [2025-11-03T17:37:49.571057] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIPC took 26.6s. Estimated remaining: 4h 42m 29s. Rate: 7.4 symbols/min [2025-11-03T17:37:49.576266] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-11 (1.64 seconds). [2025-11-03T17:37:49.577606] [INFO ] [REMOTE ] BIP: Full fetch complete (57920 records). [2025-11-03T17:37:49.577725] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-11-03T17:37:49.965931] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-11-03T17:37:49.966018] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-11-03T17:37:49.966753] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-11-03T17:37:49.966818] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-11-03T17:37:49.968101] [DEBUG] [LOCAL ] BIP: Trimmed 57920 records to 38452 (keeping 200 days of data) [2025-11-03T17:37:50.209074] [DEBUG] [LOCAL ] BIP: Primary data saved (38452 records). [2025-11-03T17:37:50.209214] [INFO ] [MAIN ] BIP: Full history saved. [2025-11-03T17:37:50.209927] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIP took 33.1s. Estimated remaining: 4h 41m 25s. Rate: 7.4 symbols/min [2025-11-03T17:37:50.797926] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:50.831543] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:50.897285] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:50.922570] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:37:50.926000] [DEBUG] [LOCAL ] BIPJ: Loaded 2954 existing records from primary storage. [2025-11-03T17:37:50.926852] [INFO ] [MAIN ] BIPJ: Loaded 2954 existing records. [2025-11-03T17:37:50.959386] [DEBUG] [LOCAL ] BIPH: Loaded 2121 existing records from primary storage. [2025-11-03T17:37:50.983591] [INFO ] [MAIN ] BIPH: Loaded 2121 existing records. [2025-11-03T17:37:51.004634] [DEBUG] [LOCAL ] BIPI: Loaded 2713 existing records from primary storage. [2025-11-03T17:37:51.061632] [INFO ] [MAIN ] BIPI: Loaded 2713 existing records. [2025-11-03T17:37:51.288908] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:51.338959] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-11-03T17:37:51.339701] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-11-03T17:37:51.390155] [DEBUG] [LOCAL ] BIRK: Loaded 51816 existing records from primary storage. [2025-11-03T17:37:51.453823] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-11-03T17:37:51.508709] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:51.509053] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-11-03T17:37:51.509178] [INFO ] [MAIN ] BIRK: Loaded 51816 existing records. [2025-11-03T17:37:51.504131] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-11-03T17:37:51.482209] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:51.561615] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-11-03T17:37:51.561390] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-11-03T17:37:51.652600] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-11-03T17:37:51.729310] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-11-03T17:37:51.724086] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-11-03T17:37:51.775434] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-11-03T17:37:51.813837] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-11-03T17:37:51.928107] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:37:52.023191] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-11-03T17:37:52.057902] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-11-03T17:37:52.203013] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-11-03T17:37:52.223537] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-11-03T17:37:52.896070] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:52.927349] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-11-03T17:37:53.039628] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:53.071291] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-11-03T17:37:53.142560] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:53.153622] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-11-03T17:37:53.231916] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:37:53.232163] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-11-03T17:37:53.480235] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T17:37:53.481398] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-11-03T17:37:53.605731] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T17:37:53.607333] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-11-03T17:37:53.703799] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T17:37:53.705095] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-11-03T17:37:53.767045] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T17:37:53.877411] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-11-03T17:37:54.030944] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T17:37:54.334838] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-11-03T17:37:54.555442] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T17:37:54.610255] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-11-03T17:37:55.134871] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-11-03T17:37:55.480072] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T17:37:55.934860] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-11-03T17:37:56.324561] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-11-03T17:37:56.734863] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-11-03T17:37:57.037234] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-11-03T17:37:57.534895] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-11-03T17:37:58.334927] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-11-03T17:37:58.758428] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T17:37:58.790223] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T17:37:59.134849] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-11-03T17:37:59.934864] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-11-03T17:38:00.268912] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-11-03T17:38:00.550542] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T17:38:00.734843] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-11-03T17:38:01.534849] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-11-03T17:38:01.901884] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T17:38:02.334854] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-11-03T17:38:03.134942] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-11-03T17:38:03.934876] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-11-03T17:38:04.123856] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-11-03T17:38:04.495906] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-11-03T17:38:04.734858] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-11-03T17:38:04.791990] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-11-03T17:38:05.433812] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T17:38:05.534823] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-11-03T17:38:05.836493] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-11-03T17:38:05.858254] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-11-03T17:38:06.334861] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-11-03T17:38:07.134874] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-11-03T17:38:07.461182] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T17:38:07.648396] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T17:38:07.934862] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-11-03T17:38:08.734883] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-11-03T17:38:09.024841] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T17:38:09.146149] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T17:38:09.534862] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-11-03T17:38:09.923086] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T17:38:10.334887] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-11. [2025-11-03T17:38:10.818720] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-11 (0.48 seconds). [2025-11-03T17:38:10.819368] [INFO ] [REMOTE ] BIPH: Full fetch complete (3524 records). [2025-11-03T17:38:10.819436] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-11-03T17:38:11.139974] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-11-03T17:38:11.206004] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-11-03T17:38:11.206090] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-11-03T17:38:11.206215] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-11-03T17:38:11.206263] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-11-03T17:38:11.206682] [DEBUG] [LOCAL ] BIPH: Trimmed 3524 records to 2058 (keeping 200 days of data) [2025-11-03T17:38:11.219509] [DEBUG] [LOCAL ] BIPH: Primary data saved (2058 records). [2025-11-03T17:38:11.220091] [INFO ] [MAIN ] BIPH: Full history saved. [2025-11-03T17:38:11.220184] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPH took 21.0s. Estimated remaining: 4h 42m 53s. Rate: 7.4 symbols/min [2025-11-03T17:38:11.388926] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:38:11.389091] [DEBUG] [LOCAL ] BIT: No existing data file found in primary storage. [2025-11-03T17:38:11.389128] [WARN ] [MAIN ] BIT: No existing data found, performing full refresh instead. [2025-11-03T17:38:11.389263] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-11-03T17:38:11.389331] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-11-03T17:38:11.389387] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-11-03T17:38:11.389421] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-11-03T17:38:11.740815] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:38:11.934867] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-11-03T17:38:12.521357] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:38:12.734816] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-11-03T17:38:12.802366] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T17:38:13.092319] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-11-03T17:38:13.534889] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-11-03T17:38:13.893502] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T17:38:14.334874] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-11-03T17:38:14.779686] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T17:38:15.134898] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-11-03T17:38:15.934854] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-11-03T17:38:16.529840] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T17:38:16.734894] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-11-03T17:38:16.878203] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-11-03T17:38:17.238254] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-11-03T17:38:17.534959] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-11-03T17:38:17.868188] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-11-03T17:38:18.334885] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-11-03T17:38:19.050051] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T17:38:19.134851] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-11-03T17:38:19.497672] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T17:38:19.934883] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-11-03T17:38:20.591152] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T17:38:20.734861] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-11-03T17:38:21.131498] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T17:38:21.534856] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-11-03T17:38:22.334859] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-11-03T17:38:22.888206] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-11-03T17:38:23.134836] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-11-03T17:38:23.192298] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-11-03T17:38:23.453469] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-11-03T17:38:23.934849] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-11. [2025-11-03T17:38:24.591365] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T17:38:24.592130] [INFO ] [REMOTE ] BIPI: Full fetch complete (4477 records). [2025-11-03T17:38:24.592200] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-11-03T17:38:24.741552] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-11-03T17:38:24.945947] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-11-03T17:38:24.946023] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-11-03T17:38:24.946162] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-11-03T17:38:24.946201] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-11-03T17:38:24.946534] [DEBUG] [LOCAL ] BIPI: Trimmed 4477 records to 2663 (keeping 200 days of data) [2025-11-03T17:38:24.963035] [DEBUG] [LOCAL ] BIPI: Primary data saved (2663 records). [2025-11-03T17:38:24.963096] [INFO ] [MAIN ] BIPI: Full history saved. [2025-11-03T17:38:24.963162] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIPI took 34.7s. Estimated remaining: 4h 43m 26s. Rate: 7.4 symbols/min [2025-11-03T17:38:25.132776] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:38:25.132988] [DEBUG] [LOCAL ] BJ: No existing data file found in primary storage. [2025-11-03T17:38:25.133043] [WARN ] [MAIN ] BJ: No existing data found, performing full refresh instead. [2025-11-03T17:38:25.133152] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-11-03T17:38:25.133194] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-11-03T17:38:25.133235] [DEBUG] [LOCAL ] BJ: No primary data file found to delete. [2025-11-03T17:38:25.133266] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-11-03T17:38:25.484097] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:38:25.494581] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:38:25.534811] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-11-03T17:38:26.334845] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-11-03T17:38:26.708023] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T17:38:27.134874] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-11. [2025-11-03T17:38:27.796581] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T17:38:27.797258] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4068 records). [2025-11-03T17:38:27.797325] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-11-03T17:38:27.936016] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-11-03T17:38:28.150782] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-11-03T17:38:28.257126] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-11-03T17:38:28.257207] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-11-03T17:38:28.257344] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-11-03T17:38:28.257381] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-11-03T17:38:28.257814] [DEBUG] [LOCAL ] BIPJ: Trimmed 4068 records to 2896 (keeping 200 days of data) [2025-11-03T17:38:28.276254] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2896 records). [2025-11-03T17:38:28.276379] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-11-03T17:38:28.276488] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIPJ took 38.1s. Estimated remaining: 4h 42m 42s. Rate: 7.4 symbols/min [2025-11-03T17:38:28.462081] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:38:28.515462] [DEBUG] [LOCAL ] BK: Loaded 54304 existing records from primary storage. [2025-11-03T17:38:28.515836] [INFO ] [MAIN ] BK: Loaded 54304 existing records. [2025-11-03T17:38:28.738389] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-11. [2025-11-03T17:38:28.812838] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T17:38:28.853134] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:38:28.853430] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-11-03T17:38:28.853504] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-11-03T17:38:28.854837] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-11-03T17:38:28.854914] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-11-03T17:38:29.382753] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:38:29.534890] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-11-03T17:38:30.339390] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-11-03T17:38:30.342904] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T17:38:30.768705] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-11 (2.03 seconds). [2025-11-03T17:38:30.770204] [INFO ] [REMOTE ] BIRK: Full fetch complete (73659 records). [2025-11-03T17:38:30.770320] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-11-03T17:38:31.141259] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-11-03T17:38:31.162542] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-11-03T17:38:31.162689] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-11-03T17:38:31.163619] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-11-03T17:38:31.163816] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-11-03T17:38:31.165389] [DEBUG] [LOCAL ] BIRK: Trimmed 73659 records to 51105 (keeping 200 days of data) [2025-11-03T17:38:31.461733] [DEBUG] [LOCAL ] BIRK: Primary data saved (51105 records). [2025-11-03T17:38:31.461961] [INFO ] [MAIN ] BIRK: Full history saved. [2025-11-03T17:38:31.462615] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIRK took 41.2s. Estimated remaining: 4h 41m 58s. Rate: 7.4 symbols/min [2025-11-03T17:38:31.629813] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:38:31.675145] [DEBUG] [LOCAL ] BKD: Loaded 51050 existing records from primary storage. [2025-11-03T17:38:31.675439] [INFO ] [MAIN ] BKD: Loaded 51050 existing records. [2025-11-03T17:38:31.854528] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:38:31.854766] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-11-03T17:38:31.854843] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-11-03T17:38:31.855807] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-11-03T17:38:31.855957] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-11-03T17:38:31.935361] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-11-03T17:38:32.047845] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-11-03T17:38:32.317022] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:38:32.325292] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T17:38:32.734879] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-11-03T17:38:33.289406] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T17:38:33.534861] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-11-03T17:38:33.905626] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:38:34.334867] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-11-03T17:38:34.593306] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T17:38:35.134928] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-11-03T17:38:35.587896] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:38:35.934878] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-11-03T17:38:36.593946] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T17:38:36.734826] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-11-03T17:38:36.843397] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T17:38:37.534850] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-11. [2025-11-03T17:38:38.339939] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-11-03T17:38:38.352837] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-11-03T17:38:38.767855] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-11 (1.23 seconds). [2025-11-03T17:38:38.769151] [INFO ] [REMOTE ] BIT: Full fetch complete (32508 records). [2025-11-03T17:38:38.769267] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-11-03T17:38:39.140032] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-11-03T17:38:39.220749] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-11-03T17:38:39.220858] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-11-03T17:38:39.221347] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-11-03T17:38:39.221390] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-11-03T17:38:39.222402] [DEBUG] [LOCAL ] BIT: Trimmed 32508 records to 23767 (keeping 200 days of data) [2025-11-03T17:38:39.366320] [DEBUG] [LOCAL ] BIT: Primary data saved (23767 records). [2025-11-03T17:38:39.366459] [INFO ] [MAIN ] BIT: Full history saved. [2025-11-03T17:38:39.366528] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BIT took 28.1s. Estimated remaining: 4h 41m 48s. Rate: 7.4 symbols/min [2025-11-03T17:38:39.550362] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:38:39.577700] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:38:39.613183] [DEBUG] [LOCAL ] BKE: Loaded 33393 existing records from primary storage. [2025-11-03T17:38:39.613493] [INFO ] [MAIN ] BKE: Loaded 33393 existing records. [2025-11-03T17:38:39.791637] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:38:39.791870] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-11-03T17:38:39.791916] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-11-03T17:38:39.792543] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-11-03T17:38:39.792603] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-11-03T17:38:39.939978] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-11-03T17:38:40.161594] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:38:40.502444] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T17:38:40.734869] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-11-03T17:38:41.129146] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:38:41.534850] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-11-03T17:38:42.149881] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T17:38:42.334848] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-11-03T17:38:42.671320] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T17:38:43.134871] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-11-03T17:38:43.765749] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T17:38:43.934860] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-11-03T17:38:44.263107] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:38:44.734865] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-11-03T17:38:45.215537] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T17:38:45.534865] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-11-03T17:38:46.013624] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T17:38:46.334904] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-11-03T17:38:46.446204] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T17:38:47.134862] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-11-03T17:38:47.514843] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T17:38:47.934923] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-11-03T17:38:48.172980] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T17:38:48.734854] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-11-03T17:38:49.088464] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T17:38:49.534894] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-11-03T17:38:49.975089] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T17:38:50.334877] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-11-03T17:38:50.989787] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-11-03T17:38:51.134843] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-11-03T17:38:51.454816] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-11-03T17:38:51.934866] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-11-03T17:38:52.469314] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T17:38:52.734879] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-11-03T17:38:53.089207] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T17:38:53.534854] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-11-03T17:38:54.046530] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T17:38:54.334872] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-11-03T17:38:54.808241] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T17:38:55.134851] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-11-03T17:38:55.723031] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T17:38:55.934856] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-11-03T17:38:56.556360] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T17:38:56.734900] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-11-03T17:38:57.264562] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T17:38:57.534871] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-11-03T17:38:57.982386] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:38:58.334895] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-11-03T17:38:58.437361] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T17:38:59.134952] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-11-03T17:38:59.712178] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T17:38:59.934865] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-11. [2025-11-03T17:39:00.164406] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T17:39:00.734849] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-11-03T17:39:01.130746] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T17:39:01.132249] [INFO ] [REMOTE ] BK: Full fetch complete (77661 records). [2025-11-03T17:39:01.132338] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-11-03T17:39:01.564756] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-11-03T17:39:01.592282] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-11-03T17:39:01.592362] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-11-03T17:39:01.593269] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-11-03T17:39:01.593461] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-11-03T17:39:01.595091] [DEBUG] [LOCAL ] BK: Trimmed 77661 records to 53524 (keeping 200 days of data) [2025-11-03T17:39:01.969267] [DEBUG] [LOCAL ] BK: Primary data saved (53524 records). [2025-11-03T17:39:01.969398] [INFO ] [MAIN ] BK: Full history saved. [2025-11-03T17:39:01.969477] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 33.7s. Estimated remaining: 4h 43m 25s. Rate: 7.3 symbols/min [2025-11-03T17:39:02.151637] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:02.185111] [DEBUG] [LOCAL ] BKH: Loaded 37991 existing records from primary storage. [2025-11-03T17:39:02.185382] [INFO ] [MAIN ] BKH: Loaded 37991 existing records. [2025-11-03T17:39:02.343872] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-11. [2025-11-03T17:39:02.392131] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:02.393355] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-11-03T17:39:02.393425] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-11-03T17:39:02.394174] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-11-03T17:39:02.394233] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-11-03T17:39:02.830665] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:02.854316] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T17:39:02.895913] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-11-03T17:39:03.134904] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-11-03T17:39:03.934842] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-11-03T17:39:04.164280] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T17:39:04.260765] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-11 (1.92 seconds). [2025-11-03T17:39:04.262427] [INFO ] [REMOTE ] BKD: Full fetch complete (72262 records). [2025-11-03T17:39:04.262531] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-11-03T17:39:04.653465] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-11-03T17:39:04.653539] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-11-03T17:39:04.654291] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-11-03T17:39:04.654353] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-11-03T17:39:04.655618] [DEBUG] [LOCAL ] BKD: Trimmed 72262 records to 50268 (keeping 200 days of data) [2025-11-03T17:39:04.736671] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-11-03T17:39:04.932026] [DEBUG] [LOCAL ] BKD: Primary data saved (50268 records). [2025-11-03T17:39:04.932146] [INFO ] [MAIN ] BKD: Full history saved. [2025-11-03T17:39:04.932819] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKD took 33.5s. Estimated remaining: 4h 42m 39s. Rate: 7.4 symbols/min [2025-11-03T17:39:05.105082] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:05.124985] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T17:39:05.162553] [DEBUG] [LOCAL ] BKKT: Loaded 38838 existing records from primary storage. [2025-11-03T17:39:05.162842] [INFO ] [MAIN ] BKKT: Loaded 38838 existing records. [2025-11-03T17:39:05.338989] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:05.339198] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-11-03T17:39:05.339244] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-11-03T17:39:05.339916] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-11-03T17:39:05.339973] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-11-03T17:39:05.546670] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-11-03T17:39:05.693148] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:06.020570] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:39:06.334865] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-11-03T17:39:06.459826] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T17:39:07.134880] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-11. [2025-11-03T17:39:07.256460] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T17:39:07.934849] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-11-03T17:39:08.450955] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T17:39:08.452100] [INFO ] [REMOTE ] BKE: Full fetch complete (49536 records). [2025-11-03T17:39:08.452201] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-11-03T17:39:08.737177] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-11-03T17:39:08.838285] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-11-03T17:39:08.838454] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-11-03T17:39:08.839063] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-11-03T17:39:08.839142] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-11-03T17:39:08.840328] [DEBUG] [LOCAL ] BKE: Trimmed 49536 records to 32806 (keeping 200 days of data) [2025-11-03T17:39:08.979326] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T17:39:09.060404] [DEBUG] [LOCAL ] BKE: Primary data saved (32806 records). [2025-11-03T17:39:09.060520] [INFO ] [MAIN ] BKE: Full history saved. [2025-11-03T17:39:09.061094] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKE took 29.7s. Estimated remaining: 4h 42m 2s. Rate: 7.4 symbols/min [2025-11-03T17:39:09.226200] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:09.235589] [DEBUG] [LOCAL ] BKN: Loaded 7378 existing records from primary storage. [2025-11-03T17:39:09.235829] [INFO ] [MAIN ] BKN: Loaded 7378 existing records. [2025-11-03T17:39:09.413188] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:09.413666] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-11-03T17:39:09.413726] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-11-03T17:39:09.414117] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-11-03T17:39:09.414173] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-11-03T17:39:09.539967] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-11-03T17:39:09.771001] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:10.091608] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T17:39:10.334914] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-11-03T17:39:10.732904] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T17:39:11.134854] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-11-03T17:39:11.683165] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T17:39:11.868142] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T17:39:11.934890] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-11-03T17:39:12.372503] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T17:39:12.734864] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-11-03T17:39:13.227488] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-11-03T17:39:13.534853] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-11. [2025-11-03T17:39:14.334917] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-11-03T17:39:15.102519] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T17:39:15.134829] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-11-03T17:39:15.906410] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T17:39:15.934841] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-11-03T17:39:16.021778] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-11 (2.49 seconds). [2025-11-03T17:39:16.023337] [INFO ] [REMOTE ] BJ: Full fetch complete (74377 records). [2025-11-03T17:39:16.023448] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-11-03T17:39:16.421087] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-11-03T17:39:16.421176] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-11-03T17:39:16.422011] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-11-03T17:39:16.422076] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-11-03T17:39:16.423460] [DEBUG] [LOCAL ] BJ: Trimmed 74377 records to 51371 (keeping 200 days of data) [2025-11-03T17:39:16.731633] [DEBUG] [LOCAL ] BJ: Primary data saved (51371 records). [2025-11-03T17:39:16.731817] [INFO ] [MAIN ] BJ: Full history saved. [2025-11-03T17:39:16.731896] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BJ took 51.8s. Estimated remaining: 4h 41m 50s. Rate: 7.4 symbols/min [2025-11-03T17:39:16.743286] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-11-03T17:39:16.908879] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:16.949226] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T17:39:16.972882] [DEBUG] [LOCAL ] BKSY: Loaded 49744 existing records from primary storage. [2025-11-03T17:39:16.973197] [INFO ] [MAIN ] BKSY: Loaded 49744 existing records. [2025-11-03T17:39:17.149683] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:17.149911] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-11-03T17:39:17.149995] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-11-03T17:39:17.150777] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-11-03T17:39:17.150835] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-11-03T17:39:17.511875] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:17.534824] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-11-03T17:39:17.889156] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T17:39:18.334858] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-11-03T17:39:18.944877] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T17:39:19.134936] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-11-03T17:39:19.455573] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T17:39:19.934840] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-11-03T17:39:20.046339] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T17:39:20.734809] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-11-03T17:39:20.929475] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T17:39:21.228866] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T17:39:21.534883] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-11-03T17:39:22.334860] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-11-03T17:39:22.917332] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T17:39:22.998924] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-11-03T17:39:23.134913] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-11-03T17:39:23.463351] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-11-03T17:39:23.934852] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-11-03T17:39:24.496076] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T17:39:24.734890] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-11-03T17:39:25.534880] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-11-03T17:39:26.223762] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-11-03T17:39:26.334864] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-11-03T17:39:26.592579] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T17:39:26.745325] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-11-03T17:39:27.134863] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-11. [2025-11-03T17:39:27.902608] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-11 (0.77 seconds). [2025-11-03T17:39:27.903401] [INFO ] [REMOTE ] BKN: Full fetch complete (11088 records). [2025-11-03T17:39:27.903470] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-11-03T17:39:27.940052] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-11-03T17:39:28.270000] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-11-03T17:39:28.270082] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-11-03T17:39:28.270342] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-11-03T17:39:28.270385] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-11-03T17:39:28.270930] [DEBUG] [LOCAL ] BKN: Trimmed 11088 records to 7311 (keeping 200 days of data) [2025-11-03T17:39:28.319353] [DEBUG] [LOCAL ] BKN: Primary data saved (7311 records). [2025-11-03T17:39:28.319509] [INFO ] [MAIN ] BKN: Full history saved. [2025-11-03T17:39:28.319615] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKN took 19.3s. Estimated remaining: 4h 42m 7s. Rate: 7.4 symbols/min [2025-11-03T17:39:28.504798] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:28.519114] [DEBUG] [LOCAL ] BKT: Loaded 13062 existing records from primary storage. [2025-11-03T17:39:28.519405] [INFO ] [MAIN ] BKT: Loaded 13062 existing records. [2025-11-03T17:39:28.736749] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-11-03T17:39:28.736592] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:28.737996] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-11-03T17:39:28.738063] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-11-03T17:39:28.738525] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-11-03T17:39:28.738715] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-11-03T17:39:29.118543] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:29.344256] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T17:39:29.534881] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-11-03T17:39:29.784348] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T17:39:30.092374] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-11-03T17:39:30.334868] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-11-03T17:39:31.134850] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-11-03T17:39:31.681610] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-11-03T17:39:31.741196] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T17:39:31.934856] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-11-03T17:39:32.734859] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-11-03T17:39:33.190789] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T17:39:33.534903] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-11-03T17:39:34.242405] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T17:39:34.334836] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-11-03T17:39:34.745817] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T17:39:35.134855] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-11-03T17:39:35.657193] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:39:35.934896] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-11-03T17:39:36.271102] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T17:39:36.734912] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-11-03T17:39:37.428237] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T17:39:37.534922] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-11-03T17:39:38.334864] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-11-03T17:39:38.470552] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-11-03T17:39:38.698519] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T17:39:38.827965] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-11-03T17:39:39.134874] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-11. [2025-11-03T17:39:39.934851] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-11-03T17:39:40.660270] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T17:39:40.661507] [INFO ] [REMOTE ] BKH: Full fetch complete (53516 records). [2025-11-03T17:39:40.661578] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-11-03T17:39:40.739922] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-11-03T17:39:41.041027] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-11-03T17:39:41.041108] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-11-03T17:39:41.041764] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-11-03T17:39:41.041830] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-11-03T17:39:41.042985] [DEBUG] [LOCAL ] BKH: Trimmed 53516 records to 37564 (keeping 200 days of data) [2025-11-03T17:39:41.266240] [DEBUG] [LOCAL ] BKH: Primary data saved (37564 records). [2025-11-03T17:39:41.266369] [INFO ] [MAIN ] BKH: Full history saved. [2025-11-03T17:39:41.266451] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKH took 39.3s. Estimated remaining: 4h 42m 33s. Rate: 7.3 symbols/min [2025-11-03T17:39:41.443622] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-11-03T17:39:41.445039] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:41.482429] [DEBUG] [LOCAL ] BKU: Loaded 42809 existing records from primary storage. [2025-11-03T17:39:41.482754] [INFO ] [MAIN ] BKU: Loaded 42809 existing records. [2025-11-03T17:39:41.540130] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-11-03T17:39:41.670297] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:41.670577] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-11-03T17:39:41.670633] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-11-03T17:39:41.671369] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-11-03T17:39:41.671426] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-11-03T17:39:42.027014] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:42.035077] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T17:39:42.086496] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-11-03T17:39:42.334863] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-11-03T17:39:43.134862] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-11-03T17:39:43.154731] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T17:39:43.934915] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-11-03T17:39:44.507061] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-11-03T17:39:44.734864] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-11-03T17:39:44.915315] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-11-03T17:39:45.534897] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-11-03T17:39:46.334869] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-11-03T17:39:46.457734] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-11-03T17:39:46.552161] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:39:47.134829] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-11. [2025-11-03T17:39:47.804028] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T17:39:47.934818] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-11-03T17:39:48.734858] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-11-03T17:39:49.268764] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T17:39:49.453524] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-11-03T17:39:49.534840] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-11-03T17:39:49.907055] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-11 (2.77 seconds). [2025-11-03T17:39:49.908825] [INFO ] [REMOTE ] BKKT: Full fetch complete (53097 records). [2025-11-03T17:39:49.908912] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-11-03T17:39:50.292973] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-11-03T17:39:50.293070] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-11-03T17:39:50.293692] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-11-03T17:39:50.293755] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-11-03T17:39:50.294826] [DEBUG] [LOCAL ] BKKT: Trimmed 53097 records to 38846 (keeping 200 days of data) [2025-11-03T17:39:50.343189] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-11-03T17:39:50.517255] [DEBUG] [LOCAL ] BKKT: Primary data saved (38846 records). [2025-11-03T17:39:50.517391] [INFO ] [MAIN ] BKKT: Full history saved. [2025-11-03T17:39:50.517466] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKKT took 45.6s. Estimated remaining: 4h 42m 32s. Rate: 7.3 symbols/min [2025-11-03T17:39:50.691623] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:50.720212] [DEBUG] [LOCAL ] BKV: Loaded 29640 existing records from primary storage. [2025-11-03T17:39:50.720495] [INFO ] [MAIN ] BKV: Loaded 29640 existing records. [2025-11-03T17:39:50.943919] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:50.944187] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-11-03T17:39:50.944267] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-11-03T17:39:50.944839] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-11-03T17:39:50.944901] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-11-03T17:39:51.148455] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-11-03T17:39:51.347775] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:51.383060] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-11-03T17:39:51.418564] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T17:39:51.934829] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-11-03T17:39:51.976789] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T17:39:52.734895] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-11. [2025-11-03T17:39:52.926752] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:39:53.534939] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-11-03T17:39:54.334859] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-11-03T17:39:54.687213] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T17:39:54.969601] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T17:39:55.134850] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-11. [2025-11-03T17:39:55.265824] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-11 (2.53 seconds). [2025-11-03T17:39:55.267285] [INFO ] [REMOTE ] BKSY: Full fetch complete (71106 records). [2025-11-03T17:39:55.267379] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-11-03T17:39:55.666297] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-11-03T17:39:55.666398] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-11-03T17:39:55.667178] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-11-03T17:39:55.667247] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-11-03T17:39:55.668684] [DEBUG] [LOCAL ] BKSY: Trimmed 71106 records to 49227 (keeping 200 days of data) [2025-11-03T17:39:55.945691] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-11-03T17:39:55.981776] [DEBUG] [LOCAL ] BKSY: Primary data saved (49227 records). [2025-11-03T17:39:55.982004] [INFO ] [MAIN ] BKSY: Full history saved. [2025-11-03T17:39:55.982806] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKSY took 39.3s. Estimated remaining: 4h 42m 5s. Rate: 7.3 symbols/min [2025-11-03T17:39:56.167540] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:56.202918] [DEBUG] [LOCAL ] BLCO: Loaded 34888 existing records from primary storage. [2025-11-03T17:39:56.203886] [INFO ] [MAIN ] BLCO: Loaded 34888 existing records. [2025-11-03T17:39:56.274823] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T17:39:56.297359] [INFO ] [REMOTE ] BKT: Full fetch complete (17063 records). [2025-11-03T17:39:56.307559] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-11-03T17:39:56.508773] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:56.519199] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-11-03T17:39:56.538225] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-11-03T17:39:56.569085] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-11-03T17:39:56.578851] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-11-03T17:39:56.750361] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-11-03T17:39:56.910087] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-11-03T17:39:56.923790] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-11-03T17:39:56.924190] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-11-03T17:39:56.929458] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-11-03T17:39:57.011500] [DEBUG] [LOCAL ] BKT: Trimmed 17063 records to 12932 (keeping 200 days of data) [2025-11-03T17:39:57.241287] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:57.267669] [DEBUG] [LOCAL ] BKT: Primary data saved (12932 records). [2025-11-03T17:39:57.267848] [INFO ] [MAIN ] BKT: Full history saved. [2025-11-03T17:39:57.267996] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKT took 28.9s. Estimated remaining: 4h 41m 8s. Rate: 7.4 symbols/min [2025-11-03T17:39:57.387409] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T17:39:57.477036] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:39:57.500912] [DEBUG] [LOCAL ] BLD: Loaded 26835 existing records from primary storage. [2025-11-03T17:39:57.501239] [INFO ] [MAIN ] BLD: Loaded 26835 existing records. [2025-11-03T17:39:57.544999] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-11-03T17:39:57.688547] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:39:57.688863] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-11-03T17:39:57.689045] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-11-03T17:39:57.689804] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-11-03T17:39:57.689866] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-11-03T17:39:57.809250] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T17:39:58.064138] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:39:58.334864] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-11-03T17:39:58.561173] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T17:39:59.134904] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-11-03T17:39:59.320305] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:39:59.934842] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-11-03T17:40:00.159220] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:40:00.734865] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-11-03T17:40:01.343560] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:40:01.534863] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-11-03T17:40:02.334868] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-11-03T17:40:02.911513] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-11-03T17:40:02.963889] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T17:40:03.134865] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-11-03T17:40:03.943242] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-11-03T17:40:03.944548] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T17:40:04.312590] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:40:04.734852] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-11-03T17:40:05.141553] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T17:40:05.534938] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-11-03T17:40:05.799420] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T17:40:06.334928] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-11-03T17:40:06.702476] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:40:07.134929] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-11-03T17:40:07.413845] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T17:40:07.934935] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-11-03T17:40:08.265877] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T17:40:08.734919] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-11-03T17:40:08.950983] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T17:40:09.534864] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-11-03T17:40:09.855492] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T17:40:10.334881] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-11-03T17:40:10.649194] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:40:11.134931] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-11-03T17:40:11.307109] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T17:40:11.934821] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-11-03T17:40:12.429448] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T17:40:12.734886] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-11-03T17:40:13.092387] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T17:40:13.534871] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-11-03T17:40:13.936940] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T17:40:14.334816] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-11. [2025-11-03T17:40:14.511522] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T17:40:15.134912] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-11-03T17:40:15.934826] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-11-03T17:40:16.080698] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-11-03T17:40:16.111594] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-11 (1.78 seconds). [2025-11-03T17:40:16.113018] [INFO ] [REMOTE ] BKU: Full fetch complete (61237 records). [2025-11-03T17:40:16.113137] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-11-03T17:40:16.544573] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-11-03T17:40:16.544698] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-11-03T17:40:16.545352] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-11-03T17:40:16.545396] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-11-03T17:40:16.546535] [DEBUG] [LOCAL ] BKU: Trimmed 61237 records to 42266 (keeping 200 days of data) [2025-11-03T17:40:16.749598] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-11-03T17:40:16.798290] [DEBUG] [LOCAL ] BKU: Primary data saved (42266 records). [2025-11-03T17:40:16.798408] [INFO ] [MAIN ] BKU: Full history saved. [2025-11-03T17:40:16.798482] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKU took 35.5s. Estimated remaining: 4h 42m 20s. Rate: 7.3 symbols/min [2025-11-03T17:40:16.966136] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T17:40:16.991004] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:17.046599] [DEBUG] [LOCAL ] BLDR: Loaded 52581 existing records from primary storage. [2025-11-03T17:40:17.046990] [INFO ] [MAIN ] BLDR: Loaded 52581 existing records. [2025-11-03T17:40:17.218758] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:40:17.218959] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-11-03T17:40:17.219006] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-11-03T17:40:17.219922] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-11-03T17:40:17.219980] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-11-03T17:40:17.568893] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-11-03T17:40:17.573820] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:17.589376] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-11-03T17:40:18.334834] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-11-03T17:40:18.399294] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-11-03T17:40:19.134889] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-11-03T17:40:19.175669] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T17:40:19.934856] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-11-03T17:40:20.734902] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-11-03T17:40:20.918584] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T17:40:21.208793] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-11-03T17:40:21.534864] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-11-03T17:40:21.913749] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T17:40:22.334861] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-11. [2025-11-03T17:40:22.411531] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T17:40:23.134867] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-11. [2025-11-03T17:40:23.710824] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-11 (1.38 seconds). [2025-11-03T17:40:23.712057] [INFO ] [REMOTE ] BKV: Full fetch complete (45203 records). [2025-11-03T17:40:23.712137] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-11-03T17:40:23.939996] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-11-03T17:40:23.957610] [DEBUG] [REMOTE ] BLCO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:40:23.974873] [WARN ] [REMOTE ] BLCO: No data returned for month 2025-11 [2025-11-03T17:40:23.986530] [FATAL] [REMOTE ] BLCO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:40:23.999485] [FATAL] [MAIN ] BLCO: Failed to fetch primary data. [2025-11-03T17:40:24.005870] [WARN ] [MAIN ] BLCO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:40:24.005979] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-11-03T17:40:24.006045] [DEBUG] [LOCAL ] BLCO: No primary data file found to delete. [2025-11-03T17:40:24.006082] [INFO ] [LOCAL ] BLCO: Starting deletion of derivative data. [2025-11-03T17:40:24.006279] [DEBUG] [LOCAL ] BLCO: Deleted derivative data file. [2025-11-03T17:40:24.007017] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 28.0s. Estimated remaining: 4h 42m 5s. Rate: 7.3 symbols/min [2025-11-03T17:40:24.244189] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-11-03T17:40:24.249932] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-11-03T17:40:24.260846] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-11-03T17:40:24.271312] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-11-03T17:40:24.330297] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:24.331234] [DEBUG] [LOCAL ] BKV: Trimmed 45203 records to 29322 (keeping 200 days of data) [2025-11-03T17:40:24.446313] [DEBUG] [LOCAL ] BLE: Loaded 13635 existing records from primary storage. [2025-11-03T17:40:24.451865] [INFO ] [MAIN ] BLE: Loaded 13635 existing records. [2025-11-03T17:40:24.736374] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-11-03T17:40:24.792621] [DEBUG] [LOCAL ] BKV: Primary data saved (29322 records). [2025-11-03T17:40:24.797101] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:40:24.797382] [INFO ] [MAIN ] BKV: Full history saved. [2025-11-03T17:40:24.798051] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BKV took 34.3s. Estimated remaining: 4h 41m 6s. Rate: 7.4 symbols/min [2025-11-03T17:40:24.798625] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-11-03T17:40:24.804436] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-11-03T17:40:24.868725] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-11-03T17:40:24.901497] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-11-03T17:40:25.270230] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:25.597967] [DEBUG] [LOCAL ] BLK: Loaded 34007 existing records from primary storage. [2025-11-03T17:40:25.629992] [INFO ] [MAIN ] BLK: Loaded 34007 existing records. [2025-11-03T17:40:25.661440] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:25.671729] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-11-03T17:40:25.799129] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-11-03T17:40:25.890175] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:40:25.890582] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-11-03T17:40:25.890680] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-11-03T17:40:25.897065] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-11-03T17:40:25.907565] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-11-03T17:40:25.977890] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T17:40:26.268192] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:26.334820] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-11-03T17:40:26.354191] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T17:40:27.134902] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-11-03T17:40:27.669905] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-11-03T17:40:27.735779] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T17:40:27.934855] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-11-03T17:40:28.593104] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T17:40:28.734883] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-11-03T17:40:29.534861] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-11-03T17:40:29.697458] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T17:40:30.334871] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-11-03T17:40:31.047449] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T17:40:31.134857] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-11-03T17:40:31.292180] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T17:40:31.934851] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-11-03T17:40:32.666618] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T17:40:32.734822] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-11-03T17:40:32.940450] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T17:40:33.534856] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-11-03T17:40:34.150539] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T17:40:34.334868] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-11. [2025-11-03T17:40:35.006907] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-11-03T17:40:35.134855] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-11-03T17:40:35.701847] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-11 (1.37 seconds). [2025-11-03T17:40:35.703089] [INFO ] [REMOTE ] BLD: Full fetch complete (39770 records). [2025-11-03T17:40:35.703167] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-11-03T17:40:35.944620] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-11-03T17:40:36.079024] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-11-03T17:40:36.079094] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-11-03T17:40:36.079614] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-11-03T17:40:36.079704] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-11-03T17:40:36.080711] [DEBUG] [LOCAL ] BLD: Trimmed 39770 records to 26638 (keeping 200 days of data) [2025-11-03T17:40:36.253420] [DEBUG] [LOCAL ] BLD: Primary data saved (26638 records). [2025-11-03T17:40:36.253716] [INFO ] [MAIN ] BLD: Full history saved. [2025-11-03T17:40:36.253857] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLD took 39.0s. Estimated remaining: 4h 41m 20s. Rate: 7.4 symbols/min [2025-11-03T17:40:36.431176] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:36.460992] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:40:36.505253] [DEBUG] [LOCAL ] BLND: Loaded 49905 existing records from primary storage. [2025-11-03T17:40:36.505566] [INFO ] [MAIN ] BLND: Loaded 49905 existing records. [2025-11-03T17:40:36.686313] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:40:36.686575] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-11-03T17:40:36.686669] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-11-03T17:40:36.687416] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-11-03T17:40:36.687474] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-11-03T17:40:36.742438] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-11-03T17:40:36.881053] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-11-03T17:40:37.069699] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:37.534848] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-11-03T17:40:38.334832] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-11-03T17:40:38.456942] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-11-03T17:40:38.863268] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T17:40:38.900637] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T17:40:39.134830] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-11-03T17:40:39.934903] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-11-03T17:40:40.494546] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T17:40:40.734902] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-11-03T17:40:41.405431] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T17:40:41.462972] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-11-03T17:40:41.534853] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-11-03T17:40:42.334918] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-11-03T17:40:42.917031] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T17:40:42.982722] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T17:40:43.134892] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-11-03T17:40:43.934858] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-11-03T17:40:44.652903] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T17:40:44.734846] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-11-03T17:40:45.534863] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-11-03T17:40:45.598263] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-11-03T17:40:45.997629] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T17:40:46.334896] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-11. [2025-11-03T17:40:46.712487] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T17:40:47.134863] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-11-03T17:40:47.934945] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-11-03T17:40:48.313970] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T17:40:48.547986] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T17:40:48.567925] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-11 (2.23 seconds). [2025-11-03T17:40:48.569418] [INFO ] [REMOTE ] BLDR: Full fetch complete (74780 records). [2025-11-03T17:40:48.569511] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-11-03T17:40:48.739922] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-11-03T17:40:49.056531] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-11-03T17:40:49.056632] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-11-03T17:40:49.057554] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-11-03T17:40:49.057638] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-11-03T17:40:49.059201] [DEBUG] [LOCAL ] BLDR: Trimmed 74780 records to 51859 (keeping 200 days of data) [2025-11-03T17:40:49.410769] [DEBUG] [LOCAL ] BLDR: Primary data saved (51859 records). [2025-11-03T17:40:49.410955] [INFO ] [MAIN ] BLDR: Full history saved. [2025-11-03T17:40:49.411042] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLDR took 32.6s. Estimated remaining: 4h 41m 47s. Rate: 7.3 symbols/min [2025-11-03T17:40:49.518569] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T17:40:49.539913] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-11-03T17:40:49.590967] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:49.591235] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-11-03T17:40:49.591285] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-11-03T17:40:49.591391] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-11-03T17:40:49.591431] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-11-03T17:40:49.591472] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-11-03T17:40:49.591504] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-11-03T17:40:49.933037] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:50.334852] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-11-03T17:40:50.918615] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-11-03T17:40:51.009855] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T17:40:51.134823] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-11-03T17:40:51.934844] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-11. [2025-11-03T17:40:52.330250] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T17:40:52.734915] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-11-03T17:40:52.795410] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T17:40:52.796288] [INFO ] [REMOTE ] BLE: Full fetch complete (19753 records). [2025-11-03T17:40:52.796356] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-11-03T17:40:53.153382] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-11-03T17:40:53.153460] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-11-03T17:40:53.153815] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-11-03T17:40:53.153876] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-11-03T17:40:53.154424] [DEBUG] [LOCAL ] BLE: Trimmed 19753 records to 13283 (keeping 200 days of data) [2025-11-03T17:40:53.231148] [DEBUG] [LOCAL ] BLE: Primary data saved (13283 records). [2025-11-03T17:40:53.231285] [INFO ] [MAIN ] BLE: Full history saved. [2025-11-03T17:40:53.231381] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLE took 29.2s. Estimated remaining: 4h 41m 9s. Rate: 7.3 symbols/min [2025-11-03T17:40:53.397756] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:53.410053] [DEBUG] [LOCAL ] BLW: Loaded 12840 existing records from primary storage. [2025-11-03T17:40:53.410242] [INFO ] [MAIN ] BLW: Loaded 12840 existing records. [2025-11-03T17:40:53.539967] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-11-03T17:40:53.617391] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:40:53.617628] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-11-03T17:40:53.617725] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-11-03T17:40:53.618096] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-11-03T17:40:53.618158] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-11-03T17:40:53.840283] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:40:53.879763] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-11-03T17:40:53.896099] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:40:53.912253] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-11-03T17:40:53.912332] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:40:53.912710] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-11-03T17:40:53.963743] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-11-03T17:40:53.990218] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:53.990735] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-11-03T17:40:53.991244] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-11-03T17:40:53.991381] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLSH took 4.6s. Estimated remaining: 4h 40m 10s. Rate: 7.4 symbols/min [2025-11-03T17:40:54.177628] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:40:54.196597] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T17:40:54.215634] [DEBUG] [LOCAL ] BLX: Loaded 15235 existing records from primary storage. [2025-11-03T17:40:54.215908] [INFO ] [MAIN ] BLX: Loaded 15235 existing records. [2025-11-03T17:40:54.339981] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-11-03T17:40:54.408501] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:40:54.408695] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-11-03T17:40:54.408757] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-11-03T17:40:54.409111] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-11-03T17:40:54.409171] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-11-03T17:40:54.765049] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:40:55.134868] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-11-03T17:40:55.475469] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T17:40:55.934849] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-11-03T17:40:56.483711] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T17:40:56.638720] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T17:40:56.734856] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-11-03T17:40:57.534870] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-11-03T17:40:57.734046] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T17:40:58.181795] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-11-03T17:40:58.334866] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-11-03T17:40:59.134853] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-11-03T17:40:59.488769] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T17:40:59.934872] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-11-03T17:41:00.385188] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T17:41:00.734853] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-11-03T17:41:01.166862] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T17:41:01.534880] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-11-03T17:41:02.334839] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-11-03T17:41:02.384357] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T17:41:02.611314] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-11-03T17:41:03.134853] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-11. [2025-11-03T17:41:03.934906] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-11-03T17:41:04.184100] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-11-03T17:41:04.626564] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T17:41:04.734852] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-11-03T17:41:05.450527] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T17:41:05.534874] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-11-03T17:41:05.733899] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-11 (2.60 seconds). [2025-11-03T17:41:05.735921] [INFO ] [REMOTE ] BLK: Full fetch complete (52529 records). [2025-11-03T17:41:05.736011] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-11-03T17:41:06.187010] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-11-03T17:41:06.187089] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-11-03T17:41:06.187717] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-11-03T17:41:06.187777] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-11-03T17:41:06.188759] [DEBUG] [LOCAL ] BLK: Trimmed 52529 records to 33489 (keeping 200 days of data) [2025-11-03T17:41:06.349455] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-11-03T17:41:06.403519] [DEBUG] [LOCAL ] BLK: Primary data saved (33489 records). [2025-11-03T17:41:06.403678] [INFO ] [MAIN ] BLK: Full history saved. [2025-11-03T17:41:06.403775] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLK took 41.6s. Estimated remaining: 4h 40m 31s. Rate: 7.4 symbols/min [2025-11-03T17:41:06.572903] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:06.602070] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T17:41:06.618201] [DEBUG] [LOCAL ] BMA: Loaded 37465 existing records from primary storage. [2025-11-03T17:41:06.618477] [INFO ] [MAIN ] BMA: Loaded 37465 existing records. [2025-11-03T17:41:06.808417] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:06.808678] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-11-03T17:41:06.808738] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-11-03T17:41:06.809458] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-11-03T17:41:06.809522] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-11-03T17:41:07.107540] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T17:41:07.138728] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-11-03T17:41:07.284842] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:07.700995] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-11-03T17:41:07.934890] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-11-03T17:41:08.581495] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T17:41:08.734863] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-11-03T17:41:09.306262] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-11-03T17:41:09.534851] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-11-03T17:41:10.334861] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-11-03T17:41:10.958082] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T17:41:10.986733] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-11-03T17:41:11.134859] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-11-03T17:41:11.934881] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-11-03T17:41:12.361112] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T17:41:12.734865] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-11-03T17:41:13.226315] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T17:41:13.308991] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T17:41:13.534859] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-11-03T17:41:14.334852] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-11-03T17:41:15.015776] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T17:41:15.065126] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T17:41:15.134819] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-11-03T17:41:15.902143] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T17:41:15.934848] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-11-03T17:41:16.734884] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-11-03T17:41:16.794173] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T17:41:17.494793] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T17:41:17.534922] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-11-03T17:41:18.334899] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-11-03T17:41:19.023787] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T17:41:19.093710] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T17:41:19.134884] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-11-03T17:41:19.934871] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-11. [2025-11-03T17:41:20.305316] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T17:41:20.734845] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-11-03T17:41:21.449341] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T17:41:21.534856] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-11. [2025-11-03T17:41:21.936187] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-11 (2.00 seconds). [2025-11-03T17:41:21.937665] [INFO ] [REMOTE ] BLND: Full fetch complete (72135 records). [2025-11-03T17:41:21.937751] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-11-03T17:41:22.320036] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-11-03T17:41:22.320119] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-11-03T17:41:22.320875] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-11-03T17:41:22.320937] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-11-03T17:41:22.322288] [DEBUG] [LOCAL ] BLND: Trimmed 72135 records to 49214 (keeping 200 days of data) [2025-11-03T17:41:22.365250] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-11. [2025-11-03T17:41:22.590803] [DEBUG] [LOCAL ] BLND: Primary data saved (49214 records). [2025-11-03T17:41:22.590920] [INFO ] [MAIN ] BLND: Full history saved. [2025-11-03T17:41:22.591743] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLND took 46.3s. Estimated remaining: 4h 41m 17s. Rate: 7.3 symbols/min [2025-11-03T17:41:22.661126] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T17:41:22.691105] [INFO ] [REMOTE ] BLW: Full fetch complete (19229 records). [2025-11-03T17:41:22.702102] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-11-03T17:41:22.882367] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:22.989444] [DEBUG] [REMOTE ] BLX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:41:23.041338] [DEBUG] [LOCAL ] BME: Loaded 11122 existing records from primary storage. [2025-11-03T17:41:23.041554] [INFO ] [MAIN ] BME: Loaded 11122 existing records. [2025-11-03T17:41:23.058810] [WARN ] [REMOTE ] BLX: No data returned for month 2025-11 [2025-11-03T17:41:23.097306] [FATAL] [REMOTE ] BLX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:41:23.138412] [FATAL] [MAIN ] BLX: Failed to fetch primary data. [2025-11-03T17:41:23.147306] [WARN ] [MAIN ] BLX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:41:23.138502] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-11-03T17:41:23.157918] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-11-03T17:41:23.175640] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-11-03T17:41:23.187232] [INFO ] [LOCAL ] BLX: Starting deletion of derivative data. [2025-11-03T17:41:23.225397] [DEBUG] [LOCAL ] BLX: Deleted derivative data file. [2025-11-03T17:41:23.271792] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BLX took 29.3s. Estimated remaining: 4h 40m 18s. Rate: 7.4 symbols/min [2025-11-03T17:41:23.329056] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-11-03T17:41:23.365575] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-11-03T17:41:23.410580] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-11-03T17:41:23.439342] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-11-03T17:41:23.439251] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:23.445158] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-11-03T17:41:23.456793] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-11-03T17:41:23.496536] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-11-03T17:41:23.496479] [DEBUG] [LOCAL ] BLW: Trimmed 19229 records to 12668 (keeping 200 days of data) [2025-11-03T17:41:23.496709] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-11-03T17:41:23.596534] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:23.762118] [DEBUG] [LOCAL ] BLW: Primary data saved (12668 records). [2025-11-03T17:41:23.797493] [INFO ] [MAIN ] BLW: Full history saved. [2025-11-03T17:41:23.815489] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BLW took 30.6s. Estimated remaining: 4h 39m 19s. Rate: 7.4 symbols/min [2025-11-03T17:41:23.895410] [DEBUG] [LOCAL ] BMEZ: Loaded 24854 existing records from primary storage. [2025-11-03T17:41:23.995215] [INFO ] [MAIN ] BMEZ: Loaded 24854 existing records. [2025-11-03T17:41:24.258410] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:24.295590] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-11-03T17:41:24.300142] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:24.389358] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:24.390086] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-11-03T17:41:24.390219] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-11-03T17:41:24.391304] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-11-03T17:41:24.391573] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-11-03T17:41:24.502931] [DEBUG] [LOCAL ] BMI: Loaded 24772 existing records from primary storage. [2025-11-03T17:41:24.564804] [INFO ] [MAIN ] BMI: Loaded 24772 existing records. [2025-11-03T17:41:24.609935] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T17:41:24.743401] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-11-03T17:41:25.015182] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:25.041296] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-11-03T17:41:25.044962] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:25.045050] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-11-03T17:41:25.046012] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-11-03T17:41:25.046078] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-11-03T17:41:25.337172] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T17:41:25.419281] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:25.534881] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-11-03T17:41:25.881797] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T17:41:26.334847] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-11-03T17:41:26.833637] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T17:41:27.134861] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-11-03T17:41:27.420914] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T17:41:27.934870] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-11-03T17:41:28.035418] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T17:41:28.419756] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-11-03T17:41:28.734877] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-11-03T17:41:28.792078] [DEBUG] [REMOTE ] BME: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-11-03T17:41:28.792335] [WARN ] [REMOTE ] BME: No data returned for month 2025-03 [2025-11-03T17:41:28.792424] [FATAL] [REMOTE ] BME: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:41:28.792531] [FATAL] [MAIN ] BME: Failed to fetch primary data. [2025-11-03T17:41:28.792599] [WARN ] [MAIN ] BME: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:41:28.792703] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-11-03T17:41:28.792770] [DEBUG] [LOCAL ] BME: No primary data file found to delete. [2025-11-03T17:41:28.792807] [INFO ] [LOCAL ] BME: Starting deletion of derivative data. [2025-11-03T17:41:28.792952] [DEBUG] [LOCAL ] BME: Deleted derivative data file. [2025-11-03T17:41:28.793016] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BME took 6.2s. Estimated remaining: 4h 38m 49s. Rate: 7.4 symbols/min [2025-11-03T17:41:28.958285] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:28.962151] [DEBUG] [LOCAL ] BMN: Loaded 2707 existing records from primary storage. [2025-11-03T17:41:28.962303] [INFO ] [MAIN ] BMN: Loaded 2707 existing records. [2025-11-03T17:41:29.148129] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:29.148350] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-11-03T17:41:29.148405] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-11-03T17:41:29.148600] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-11-03T17:41:29.148693] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-11-03T17:41:29.530679] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:29.534818] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-11-03T17:41:30.050245] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T17:41:30.334832] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-11-03T17:41:31.134855] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-11-03T17:41:31.426183] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T17:41:31.779062] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T17:41:31.934871] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-11-03T17:41:32.734856] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-11-03T17:41:32.994994] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T17:41:33.519778] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-11-03T17:41:33.534804] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-11-03T17:41:34.334864] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-11-03T17:41:34.545826] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-11-03T17:41:35.134869] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-11-03T17:41:35.156059] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T17:41:35.934827] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-11-03T17:41:36.456218] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T17:41:36.739928] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-11-03T17:41:36.750187] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T17:41:37.207633] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-11-03T17:41:37.534846] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-11-03T17:41:38.334861] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-11-03T17:41:38.630298] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-11-03T17:41:38.800933] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T17:41:39.134892] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-11-03T17:41:39.934842] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-11-03T17:41:40.249943] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-11-03T17:41:40.734842] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-11. [2025-11-03T17:41:40.885209] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T17:41:41.534849] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-11-03T17:41:42.022704] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T17:41:42.334908] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-11-03T17:41:42.516933] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-11 (1.78 seconds). [2025-11-03T17:41:42.518839] [INFO ] [REMOTE ] BMA: Full fetch complete (52989 records). [2025-11-03T17:41:42.518936] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-11-03T17:41:42.903271] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-11-03T17:41:42.903350] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-11-03T17:41:42.903952] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-11-03T17:41:42.904014] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-11-03T17:41:42.905068] [DEBUG] [LOCAL ] BMA: Trimmed 52989 records to 36868 (keeping 200 days of data) [2025-11-03T17:41:43.026137] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T17:41:43.139963] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-11-03T17:41:43.148298] [DEBUG] [LOCAL ] BMA: Primary data saved (36868 records). [2025-11-03T17:41:43.148381] [INFO ] [MAIN ] BMA: Full history saved. [2025-11-03T17:41:43.148456] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BMA took 36.7s. Estimated remaining: 4h 39m 23s. Rate: 7.4 symbols/min [2025-11-03T17:41:43.320630] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:43.359844] [DEBUG] [LOCAL ] BMO: Loaded 41022 existing records from primary storage. [2025-11-03T17:41:43.360140] [INFO ] [MAIN ] BMO: Loaded 41022 existing records. [2025-11-03T17:41:43.539301] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:43.539479] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-11-03T17:41:43.539531] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-11-03T17:41:43.540292] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-11-03T17:41:43.540374] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-11-03T17:41:43.896293] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:43.912139] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T17:41:43.934805] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-11-03T17:41:44.734866] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-11-03T17:41:45.002354] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T17:41:45.534879] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-11-03T17:41:45.592734] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T17:41:45.875085] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T17:41:46.334862] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-11-03T17:41:47.058152] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T17:41:47.134829] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-11-03T17:41:47.821403] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-11-03T17:41:47.934826] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-11-03T17:41:48.734819] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-11-03T17:41:48.807013] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T17:41:49.534849] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-11-03T17:41:49.672627] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T17:41:49.767533] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-11-03T17:41:50.334848] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-11-03T17:41:50.650562] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-11-03T17:41:51.134875] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-11-03T17:41:51.463841] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-11-03T17:41:51.934848] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-11-03T17:41:52.734876] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-11-03T17:41:53.035132] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T17:41:53.501391] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T17:41:53.534815] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-11. [2025-11-03T17:41:54.334860] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-11-03T17:41:54.540163] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T17:41:54.541591] [INFO ] [REMOTE ] BMEZ: Full fetch complete (38440 records). [2025-11-03T17:41:54.541710] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-11-03T17:41:54.949788] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-11-03T17:41:54.949900] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-11-03T17:41:54.950385] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-11-03T17:41:54.950427] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-11-03T17:41:54.951272] [DEBUG] [LOCAL ] BMEZ: Trimmed 38440 records to 24406 (keeping 200 days of data) [2025-11-03T17:41:55.098135] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24406 records). [2025-11-03T17:41:55.098259] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-11-03T17:41:55.098337] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMEZ took 31.8s. Estimated remaining: 4h 39m 40s. Rate: 7.4 symbols/min [2025-11-03T17:41:55.139973] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-11-03T17:41:55.278210] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:41:55.293975] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T17:41:55.343296] [DEBUG] [LOCAL ] BMY: Loaded 54537 existing records from primary storage. [2025-11-03T17:41:55.343632] [INFO ] [MAIN ] BMY: Loaded 54537 existing records. [2025-11-03T17:41:55.526669] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:41:55.526930] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-11-03T17:41:55.526991] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-11-03T17:41:55.527914] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-11-03T17:41:55.527972] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-11-03T17:41:55.881788] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:41:55.934814] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-11-03T17:41:56.520901] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:41:56.734866] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-11-03T17:41:57.395019] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T17:41:57.534811] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-11-03T17:41:57.875122] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T17:41:58.334847] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-11-03T17:41:58.764274] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T17:41:58.851583] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T17:41:59.134855] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-11-03T17:41:59.934852] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-11-03T17:42:00.502398] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T17:42:00.734835] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-11-03T17:42:01.129525] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T17:42:01.534827] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-11-03T17:42:01.565788] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T17:42:02.334966] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-11. [2025-11-03T17:42:02.784186] [DEBUG] [REMOTE ] BMN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:42:02.784481] [WARN ] [REMOTE ] BMN: No data returned for month 2025-11 [2025-11-03T17:42:02.784585] [FATAL] [REMOTE ] BMN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:42:02.784714] [FATAL] [MAIN ] BMN: Failed to fetch primary data. [2025-11-03T17:42:02.784784] [WARN ] [MAIN ] BMN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:42:02.784852] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-11-03T17:42:02.784915] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-11-03T17:42:02.784950] [INFO ] [LOCAL ] BMN: Starting deletion of derivative data. [2025-11-03T17:42:02.785115] [DEBUG] [LOCAL ] BMN: Deleted derivative data file. [2025-11-03T17:42:02.785210] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 34.0s. Estimated remaining: 4h 39m 29s. Rate: 7.4 symbols/min [2025-11-03T17:42:02.954617] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:03.002100] [DEBUG] [LOCAL ] BN: Loaded 53747 existing records from primary storage. [2025-11-03T17:42:03.002421] [INFO ] [MAIN ] BN: Loaded 53747 existing records. [2025-11-03T17:42:03.140851] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-11-03T17:42:03.181066] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:03.181255] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-11-03T17:42:03.181302] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-11-03T17:42:03.182190] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-11-03T17:42:03.182247] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-11-03T17:42:03.536012] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:03.934832] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-11-03T17:42:04.152183] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.62 seconds). [2025-11-03T17:42:04.182888] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-11-03T17:42:04.734938] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-11. [2025-11-03T17:42:05.534880] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-11-03T17:42:05.592447] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T17:42:06.287494] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-11 (1.55 seconds). [2025-11-03T17:42:06.288516] [INFO ] [REMOTE ] BMI: Full fetch complete (34326 records). [2025-11-03T17:42:06.288591] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-11-03T17:42:06.342806] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-11-03T17:42:06.685404] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-11-03T17:42:06.685637] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-11-03T17:42:06.686209] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-11-03T17:42:06.686442] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-11-03T17:42:06.688025] [DEBUG] [LOCAL ] BMI: Trimmed 34326 records to 24317 (keeping 200 days of data) [2025-11-03T17:42:06.845134] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T17:42:06.870301] [DEBUG] [LOCAL ] BMI: Primary data saved (24317 records). [2025-11-03T17:42:06.870430] [INFO ] [MAIN ] BMI: Full history saved. [2025-11-03T17:42:06.870510] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMI took 43.0s. Estimated remaining: 4h 38m 54s. Rate: 7.4 symbols/min [2025-11-03T17:42:07.042124] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:07.067103] [DEBUG] [LOCAL ] BNED: Loaded 28078 existing records from primary storage. [2025-11-03T17:42:07.067500] [INFO ] [MAIN ] BNED: Loaded 28078 existing records. [2025-11-03T17:42:07.141757] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-11-03T17:42:07.249472] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:07.249791] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-11-03T17:42:07.249853] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-11-03T17:42:07.250797] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-11-03T17:42:07.250872] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-11-03T17:42:07.611491] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:07.936485] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-11-03T17:42:07.941694] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-11-03T17:42:08.734827] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-11-03T17:42:08.991546] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-11-03T17:42:09.029593] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T17:42:09.534906] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-11-03T17:42:09.901828] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T17:42:10.334885] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-11-03T17:42:11.017521] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T17:42:11.134876] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-11-03T17:42:11.840053] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T17:42:11.934892] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-11-03T17:42:12.621751] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T17:42:12.739960] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-11-03T17:42:12.748579] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T17:42:13.534897] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-11-03T17:42:14.113170] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T17:42:14.334845] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-11-03T17:42:14.477472] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T17:42:15.134904] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-11-03T17:42:15.854240] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-11-03T17:42:15.934832] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-11-03T17:42:16.031915] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T17:42:16.734947] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-11-03T17:42:17.534899] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-11-03T17:42:17.681819] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T17:42:17.777705] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T17:42:18.334875] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-11-03T17:42:19.140424] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-11-03T17:42:19.161189] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-11-03T17:42:19.934834] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-11-03T17:42:20.009274] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-11-03T17:42:20.487409] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T17:42:20.734903] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-11-03T17:42:21.364948] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T17:42:21.534867] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-11-03T17:42:21.768515] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T17:42:22.334874] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-11-03T17:42:22.730576] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T17:42:23.134841] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-11-03T17:42:23.775802] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T17:42:23.934886] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-11-03T17:42:24.299202] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T17:42:24.734882] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-11-03T17:42:24.861990] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T17:42:25.534868] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-11-03T17:42:25.800068] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T17:42:26.334864] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-11-03T17:42:27.032519] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T17:42:27.134898] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-11. [2025-11-03T17:42:27.934866] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-11-03T17:42:28.271965] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-11-03T17:42:28.734860] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-11. [2025-11-03T17:42:29.063832] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-11 (1.93 seconds). [2025-11-03T17:42:29.065346] [INFO ] [REMOTE ] BMO: Full fetch complete (59723 records). [2025-11-03T17:42:29.065461] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-11-03T17:42:29.465250] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-11-03T17:42:29.465330] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-11-03T17:42:29.465982] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-11-03T17:42:29.466068] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-11-03T17:42:29.467311] [DEBUG] [LOCAL ] BMO: Trimmed 59723 records to 40320 (keeping 200 days of data) [2025-11-03T17:42:29.555318] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-11-03T17:42:29.716253] [DEBUG] [LOCAL ] BMO: Primary data saved (40320 records). [2025-11-03T17:42:29.716368] [INFO ] [MAIN ] BMO: Full history saved. [2025-11-03T17:42:29.717328] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BMO took 46.6s. Estimated remaining: 4h 40m 23s. Rate: 7.3 symbols/min [2025-11-03T17:42:29.908198] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:29.915810] [DEBUG] [LOCAL ] BNH: Loaded 4529 existing records from primary storage. [2025-11-03T17:42:29.916025] [INFO ] [MAIN ] BNH: Loaded 4529 existing records. [2025-11-03T17:42:30.096155] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:30.096369] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-11-03T17:42:30.096522] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-11-03T17:42:30.096764] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-11-03T17:42:30.096821] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-11-03T17:42:30.281236] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (2.35 seconds). [2025-11-03T17:42:30.384986] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-11. [2025-11-03T17:42:30.529193] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:30.548624] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T17:42:31.134855] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-11-03T17:42:31.186299] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-11 (2.45 seconds). [2025-11-03T17:42:31.188013] [INFO ] [REMOTE ] BN: Full fetch complete (76953 records). [2025-11-03T17:42:31.188139] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-11-03T17:42:31.589954] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-11-03T17:42:31.590050] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-11-03T17:42:31.590954] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-11-03T17:42:31.591021] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-11-03T17:42:31.592498] [DEBUG] [LOCAL ] BN: Trimmed 76953 records to 52965 (keeping 200 days of data) [2025-11-03T17:42:31.927875] [DEBUG] [LOCAL ] BN: Primary data saved (52965 records). [2025-11-03T17:42:31.928172] [INFO ] [MAIN ] BN: Full history saved. [2025-11-03T17:42:31.929065] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BN took 29.1s. Estimated remaining: 4h 39m 35s. Rate: 7.3 symbols/min [2025-11-03T17:42:31.940836] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-11-03T17:42:32.118216] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:32.139224] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-11-03T17:42:32.138253] [DEBUG] [LOCAL ] BNJ: Loaded 2471 existing records from primary storage. [2025-11-03T17:42:32.139512] [INFO ] [MAIN ] BNJ: Loaded 2471 existing records. [2025-11-03T17:42:32.237000] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-11 (1.85 seconds). [2025-11-03T17:42:32.268411] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-11-03T17:42:32.271828] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-11-03T17:42:32.480365] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:32.490894] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-11-03T17:42:32.509890] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-11-03T17:42:32.523980] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-11-03T17:42:32.561356] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-11-03T17:42:32.739935] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-11-03T17:42:33.051067] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:42:33.056743] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-11-03T17:42:33.083190] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-11-03T17:42:33.085884] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-11-03T17:42:33.091512] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-11-03T17:42:33.169776] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:33.170695] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-11-03T17:42:33.494705] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-11-03T17:42:33.494860] [INFO ] [MAIN ] BMY: Full history saved. [2025-11-03T17:42:33.494941] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BMY took 38.4s. Estimated remaining: 4h 38m 44s. Rate: 7.4 symbols/min [2025-11-03T17:42:33.538594] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-11-03T17:42:33.676055] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:33.690990] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-11-03T17:42:33.736196] [DEBUG] [LOCAL ] BNL: Loaded 47483 existing records from primary storage. [2025-11-03T17:42:33.736557] [INFO ] [MAIN ] BNL: Loaded 47483 existing records. [2025-11-03T17:42:33.925859] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:33.926157] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-11-03T17:42:33.926287] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-11-03T17:42:33.927133] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-11-03T17:42:33.927190] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-11-03T17:42:34.000350] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T17:42:34.307970] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:34.334815] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-11-03T17:42:35.134862] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-11. [2025-11-03T17:42:35.384499] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T17:42:35.934853] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-11-03T17:42:36.307101] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T17:42:36.308616] [INFO ] [REMOTE ] BNED: Full fetch complete (40935 records). [2025-11-03T17:42:36.308972] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-11-03T17:42:36.380928] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T17:42:36.703325] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-11-03T17:42:36.703400] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-11-03T17:42:36.703913] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-11-03T17:42:36.703974] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-11-03T17:42:36.704824] [DEBUG] [LOCAL ] BNED: Trimmed 40935 records to 27494 (keeping 200 days of data) [2025-11-03T17:42:36.750708] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-11-03T17:42:36.861208] [DEBUG] [LOCAL ] BNED: Primary data saved (27494 records). [2025-11-03T17:42:36.861376] [INFO ] [MAIN ] BNED: Full history saved. [2025-11-03T17:42:36.861468] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BNED took 30.0s. Estimated remaining: 4h 38m 5s. Rate: 7.4 symbols/min [2025-11-03T17:42:37.036260] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:37.081393] [DEBUG] [LOCAL ] BNS: Loaded 52009 existing records from primary storage. [2025-11-03T17:42:37.081720] [INFO ] [MAIN ] BNS: Loaded 52009 existing records. [2025-11-03T17:42:37.255911] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:37.256101] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-11-03T17:42:37.256147] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-11-03T17:42:37.257128] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-11-03T17:42:37.257189] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-11-03T17:42:37.540048] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-11-03T17:42:37.611133] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:37.975416] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T17:42:38.082107] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T17:42:38.334910] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-11-03T17:42:39.134856] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-11-03T17:42:39.606740] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:42:39.638377] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-11-03T17:42:39.934862] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-11-03T17:42:40.270298] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T17:42:40.734847] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-11-03T17:42:41.156602] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T17:42:41.534856] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-11-03T17:42:41.901659] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-11-03T17:42:42.334864] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-11-03T17:42:43.134844] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-11-03T17:42:43.712087] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T17:42:43.934866] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-11-03T17:42:44.337272] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T17:42:44.609777] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T17:42:44.734850] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-11-03T17:42:45.492429] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:42:45.534826] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-11-03T17:42:45.889865] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-11-03T17:42:46.334855] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-11-03T17:42:46.662776] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-11-03T17:42:47.134862] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-11-03T17:42:47.934868] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-11-03T17:42:48.345891] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-11-03T17:42:48.604215] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T17:42:48.734848] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-11-03T17:42:49.534850] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-11-03T17:42:49.927860] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T17:42:49.954826] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T17:42:50.334866] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-11-03T17:42:51.134866] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-11-03T17:42:51.473564] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-11-03T17:42:51.616563] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T17:42:51.934868] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-11-03T17:42:52.250919] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-11-03T17:42:52.734874] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-11-03T17:42:53.534875] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-11-03T17:42:54.005936] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T17:42:54.034145] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:42:54.334856] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-11-03T17:42:55.134889] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-11-03T17:42:55.940630] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-11-03T17:42:55.956626] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-11-03T17:42:56.309087] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-11-03T17:42:56.496831] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T17:42:56.734912] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-11-03T17:42:57.240196] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T17:42:57.534836] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-11. [2025-11-03T17:42:58.084628] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T17:42:58.085326] [INFO ] [REMOTE ] BNH: Full fetch complete (6825 records). [2025-11-03T17:42:58.085392] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-11-03T17:42:58.339983] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-11-03T17:42:58.446438] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-11-03T17:42:58.446522] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-11-03T17:42:58.446817] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-11-03T17:42:58.446880] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-11-03T17:42:58.447325] [DEBUG] [LOCAL ] BNH: Trimmed 6825 records to 4473 (keeping 200 days of data) [2025-11-03T17:42:58.487733] [DEBUG] [LOCAL ] BNH: Primary data saved (4473 records). [2025-11-03T17:42:58.487900] [INFO ] [MAIN ] BNH: Full history saved. [2025-11-03T17:42:58.487995] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNH took 28.8s. Estimated remaining: 4h 39m 24s. Rate: 7.3 symbols/min [2025-11-03T17:42:58.708037] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:42:58.713804] [DEBUG] [LOCAL ] BNT: Loaded 3366 existing records from primary storage. [2025-11-03T17:42:58.714003] [INFO ] [MAIN ] BNT: Loaded 3366 existing records. [2025-11-03T17:42:58.810337] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-11-03T17:42:58.948331] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:42:58.948597] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-11-03T17:42:58.948699] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-11-03T17:42:58.948926] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-11-03T17:42:58.948987] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-11-03T17:42:59.139998] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-11-03T17:42:59.375484] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:42:59.934847] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-11-03T17:43:00.615367] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T17:43:00.648197] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T17:43:00.734855] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-11-03T17:43:01.534934] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-11-03T17:43:01.871211] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T17:43:02.321283] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-11-03T17:43:02.334809] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-11-03T17:43:03.134892] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-11-03T17:43:03.518813] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-11-03T17:43:03.588361] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T17:43:03.934878] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-11-03T17:43:04.734895] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-11-03T17:43:05.353868] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:43:05.534895] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-11. [2025-11-03T17:43:06.297225] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-11-03T17:43:06.334871] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-11-03T17:43:06.388186] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-11 (0.85 seconds). [2025-11-03T17:43:06.389006] [INFO ] [REMOTE ] BNJ: Full fetch complete (3842 records). [2025-11-03T17:43:06.389091] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-11-03T17:43:06.806896] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-11-03T17:43:06.806994] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-11-03T17:43:06.811509] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-11-03T17:43:06.811352] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-11-03T17:43:06.813503] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-11-03T17:43:06.813887] [DEBUG] [LOCAL ] BNJ: Trimmed 3842 records to 2447 (keeping 200 days of data) [2025-11-03T17:43:06.828904] [DEBUG] [LOCAL ] BNJ: Primary data saved (2447 records). [2025-11-03T17:43:06.828974] [INFO ] [MAIN ] BNJ: Full history saved. [2025-11-03T17:43:06.829050] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNJ took 34.9s. Estimated remaining: 4h 39m 17s. Rate: 7.3 symbols/min [2025-11-03T17:43:06.993991] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:07.002582] [DEBUG] [LOCAL ] BNY: Loaded 7272 existing records from primary storage. [2025-11-03T17:43:07.002832] [INFO ] [MAIN ] BNY: Loaded 7272 existing records. [2025-11-03T17:43:07.140089] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-11. [2025-11-03T17:43:07.179413] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:07.179868] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-11-03T17:43:07.179920] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-11-03T17:43:07.180170] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-11-03T17:43:07.180227] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-11-03T17:43:07.531532] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:07.934876] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-11-03T17:43:08.734858] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-11-03T17:43:08.855627] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T17:43:08.956043] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-11 (1.82 seconds). [2025-11-03T17:43:08.957575] [INFO ] [REMOTE ] BNL: Full fetch complete (67538 records). [2025-11-03T17:43:08.957768] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-11-03T17:43:09.340919] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-11-03T17:43:09.341043] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-11-03T17:43:09.341995] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-11-03T17:43:09.342059] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-11-03T17:43:09.343385] [DEBUG] [LOCAL ] BNL: Trimmed 67538 records to 46766 (keeping 200 days of data) [2025-11-03T17:43:09.545741] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-11-03T17:43:09.623948] [DEBUG] [LOCAL ] BNL: Primary data saved (46766 records). [2025-11-03T17:43:09.624126] [INFO ] [MAIN ] BNL: Full history saved. [2025-11-03T17:43:09.624230] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNL took 36.1s. Estimated remaining: 4h 38m 34s. Rate: 7.4 symbols/min [2025-11-03T17:43:10.272173] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T17:43:10.334834] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-11-03T17:43:10.507936] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-11-03T17:43:10.905244] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-11-03T17:43:11.134852] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-11-03T17:43:11.482154] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T17:43:11.934869] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-11-03T17:43:12.734861] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-11-03T17:43:13.255305] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:43:13.281867] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-11-03T17:43:13.534916] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-11-03T17:43:14.013367] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T17:43:14.334891] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-11-03T17:43:14.639950] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-11-03T17:43:15.134896] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-11-03T17:43:15.545846] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T17:43:15.934894] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-11-03T17:43:16.290009] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-11-03T17:43:16.734929] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-11-03T17:43:17.534854] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-11-03T17:43:18.011559] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T17:43:18.276799] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T17:43:18.334879] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-11-03T17:43:19.134929] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-11-03T17:43:19.732520] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T17:43:19.732283] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T17:43:19.934874] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-11-03T17:43:20.226473] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-11-03T17:43:20.734852] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-11. [2025-11-03T17:43:21.534870] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-11-03T17:43:21.688754] [DEBUG] [REMOTE ] BNS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:43:21.689047] [WARN ] [REMOTE ] BNS: No data returned for month 2025-11 [2025-11-03T17:43:21.689134] [FATAL] [REMOTE ] BNS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:43:21.689209] [FATAL] [MAIN ] BNS: Failed to fetch primary data. [2025-11-03T17:43:21.689274] [WARN ] [MAIN ] BNS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:43:21.689321] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-11-03T17:43:21.689377] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-11-03T17:43:21.689412] [INFO ] [LOCAL ] BNS: Starting deletion of derivative data. [2025-11-03T17:43:21.689593] [DEBUG] [LOCAL ] BNS: Deleted derivative data file. [2025-11-03T17:43:21.690380] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNS took 44.8s. Estimated remaining: 4h 38m 51s. Rate: 7.3 symbols/min [2025-11-03T17:43:22.089026] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-11-03T17:43:22.334860] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-11-03T17:43:22.881847] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T17:43:23.134905] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-11. [2025-11-03T17:43:23.934855] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-11-03T17:43:23.984707] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-11 (0.85 seconds). [2025-11-03T17:43:23.985488] [INFO ] [REMOTE ] BNY: Full fetch complete (10509 records). [2025-11-03T17:43:23.985555] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-11-03T17:43:24.352582] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-11-03T17:43:24.352703] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-11-03T17:43:24.352957] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-11-03T17:43:24.352996] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-11-03T17:43:24.353414] [DEBUG] [LOCAL ] BNY: Trimmed 10509 records to 7240 (keeping 200 days of data) [2025-11-03T17:43:24.394335] [DEBUG] [LOCAL ] BNY: Primary data saved (7240 records). [2025-11-03T17:43:24.394428] [INFO ] [MAIN ] BNY: Full history saved. [2025-11-03T17:43:24.394500] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNY took 17.6s. Estimated remaining: 4h 38m 8s. Rate: 7.4 symbols/min [2025-11-03T17:43:24.518596] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T17:43:24.734915] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-11-03T17:43:25.210396] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-11-03T17:43:25.534836] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-11. [2025-11-03T17:43:25.946089] [DEBUG] [REMOTE ] BNT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:43:25.946388] [WARN ] [REMOTE ] BNT: No data returned for month 2025-11 [2025-11-03T17:43:25.946472] [FATAL] [REMOTE ] BNT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:43:25.946548] [FATAL] [MAIN ] BNT: Failed to fetch primary data. [2025-11-03T17:43:25.946622] [WARN ] [MAIN ] BNT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:43:25.946728] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-11-03T17:43:25.946792] [DEBUG] [LOCAL ] BNT: No primary data file found to delete. [2025-11-03T17:43:25.946828] [INFO ] [LOCAL ] BNT: Starting deletion of derivative data. [2025-11-03T17:43:25.947192] [DEBUG] [LOCAL ] BNT: Deleted derivative data file. [2025-11-03T17:43:25.947486] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BNT took 27.5s. Estimated remaining: 4h 37m 18s. Rate: 7.4 symbols/min [2025-11-03T17:43:26.595834] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:26.669700] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:26.688506] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:26.685414] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:26.725255] [DEBUG] [LOCAL ] BOC: Loaded 18029 existing records from primary storage. [2025-11-03T17:43:26.732746] [DEBUG] [LOCAL ] BOE: Loaded 17571 existing records from primary storage. [2025-11-03T17:43:26.741273] [INFO ] [MAIN ] BOC: Loaded 18029 existing records. [2025-11-03T17:43:26.733095] [INFO ] [MAIN ] BOE: Loaded 17571 existing records. [2025-11-03T17:43:26.831879] [DEBUG] [LOCAL ] BOH: Loaded 30929 existing records from primary storage. [2025-11-03T17:43:26.869311] [DEBUG] [LOCAL ] BOND: Loaded 32750 existing records from primary storage. [2025-11-03T17:43:26.917920] [INFO ] [MAIN ] BOND: Loaded 32750 existing records. [2025-11-03T17:43:26.907503] [INFO ] [MAIN ] BOH: Loaded 30929 existing records. [2025-11-03T17:43:27.267922] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:27.314439] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-11-03T17:43:27.346432] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-11-03T17:43:27.362393] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:27.396558] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-11-03T17:43:27.407785] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-11-03T17:43:27.399578] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-11-03T17:43:27.444000] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:27.458293] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-11-03T17:43:27.479763] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-11-03T17:43:27.488128] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-11-03T17:43:27.520824] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:27.536071] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-11-03T17:43:27.530698] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-11-03T17:43:27.536465] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-11-03T17:43:27.541694] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-11-03T17:43:27.536414] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-11-03T17:43:27.570258] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-11-03T17:43:27.684195] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-11-03T17:43:27.722782] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-11-03T17:43:28.808403] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:28.908304] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-11-03T17:43:28.879548] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:28.922421] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-11-03T17:43:28.985704] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:28.989063] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:28.990160] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-11-03T17:43:28.989849] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-11-03T17:43:29.956972] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T17:43:29.963467] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-11-03T17:43:29.976537] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:43:30.141486] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T17:43:30.238041] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T17:43:30.334811] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-11-03T17:43:30.737927] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T17:43:31.134837] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-11-03T17:43:31.178933] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T17:43:31.933016] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T17:43:31.938262] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-11-03T17:43:32.618324] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T17:43:32.734918] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-11-03T17:43:33.534862] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-11-03T17:43:33.752083] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T17:43:34.276856] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T17:43:34.334835] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-11-03T17:43:35.134850] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-11-03T17:43:35.178490] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T17:43:35.934900] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-11-03T17:43:36.228083] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T17:43:36.543579] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T17:43:36.734842] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-11-03T17:43:37.493787] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T17:43:37.534822] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-11-03T17:43:38.334847] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-11-03T17:43:38.654207] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T17:43:39.032762] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T17:43:39.134868] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-11-03T17:43:39.934869] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-11-03T17:43:40.233893] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T17:43:40.734920] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-11-03T17:43:40.882769] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T17:43:41.534927] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-11-03T17:43:41.919294] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:43:42.334817] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-11-03T17:43:42.514332] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-11-03T17:43:43.134973] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-11-03T17:43:43.218708] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-11-03T17:43:43.934917] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-11-03T17:43:44.007690] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-11-03T17:43:44.734928] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-11-03T17:43:44.845186] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T17:43:45.438082] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T17:43:45.534867] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-11-03T17:43:46.252556] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T17:43:46.334807] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-11-03T17:43:46.974706] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T17:43:47.134878] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-11-03T17:43:47.934853] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-11-03T17:43:48.044784] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T17:43:48.629981] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T17:43:48.734817] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-11-03T17:43:49.534873] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-11-03T17:43:49.847672] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T17:43:50.271062] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T17:43:50.334817] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-11-03T17:43:51.072618] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T17:43:51.134841] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-11-03T17:43:51.708160] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-11-03T17:43:51.934870] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-11. [2025-11-03T17:43:52.734902] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-11-03T17:43:53.104352] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T17:43:53.105313] [INFO ] [REMOTE ] BOC: Full fetch complete (25756 records). [2025-11-03T17:43:53.105383] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-11-03T17:43:53.462543] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-11-03T17:43:53.462618] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-11-03T17:43:53.463015] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-11-03T17:43:53.463068] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-11-03T17:43:53.463693] [DEBUG] [LOCAL ] BOC: Trimmed 25756 records to 17827 (keeping 200 days of data) [2025-11-03T17:43:53.536354] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-11-03T17:43:53.566945] [DEBUG] [LOCAL ] BOC: Primary data saved (17827 records). [2025-11-03T17:43:53.567140] [INFO ] [MAIN ] BOC: Full history saved. [2025-11-03T17:43:53.567229] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOC took 27.6s. Estimated remaining: 4h 39m 14s. Rate: 7.3 symbols/min [2025-11-03T17:43:53.734370] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:53.777391] [DEBUG] [LOCAL ] BOOT: Loaded 39665 existing records from primary storage. [2025-11-03T17:43:53.777758] [INFO ] [MAIN ] BOOT: Loaded 39665 existing records. [2025-11-03T17:43:53.994748] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:53.995156] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-11-03T17:43:53.995316] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-11-03T17:43:54.002162] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-11-03T17:43:54.013806] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-11-03T17:43:54.020290] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:43:54.340006] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-11-03T17:43:54.466088] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:54.633001] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T17:43:55.134859] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-11-03T17:43:55.450205] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T17:43:55.934921] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-11-03T17:43:56.074892] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T17:43:56.734861] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-11-03T17:43:57.398513] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T17:43:57.518917] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-11-03T17:43:57.534798] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-11. [2025-11-03T17:43:58.334888] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-11-03T17:43:58.519999] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T17:43:58.520927] [INFO ] [REMOTE ] BOE: Full fetch complete (26597 records). [2025-11-03T17:43:58.521000] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-11-03T17:43:58.887680] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-11-03T17:43:58.887766] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-11-03T17:43:58.888153] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-11-03T17:43:58.888191] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-11-03T17:43:58.888863] [DEBUG] [LOCAL ] BOE: Trimmed 26597 records to 17068 (keeping 200 days of data) [2025-11-03T17:43:58.990129] [DEBUG] [LOCAL ] BOE: Primary data saved (17068 records). [2025-11-03T17:43:58.990266] [INFO ] [MAIN ] BOE: Full history saved. [2025-11-03T17:43:58.990349] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOE took 33.0s. Estimated remaining: 4h 38m 48s. Rate: 7.3 symbols/min [2025-11-03T17:43:59.157835] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-11-03T17:43:59.160403] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:43:59.238214] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-11-03T17:43:59.248023] [DEBUG] [LOCAL ] BORR: Loaded 51788 existing records from primary storage. [2025-11-03T17:43:59.248792] [INFO ] [MAIN ] BORR: Loaded 51788 existing records. [2025-11-03T17:43:59.464093] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:43:59.464293] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-11-03T17:43:59.464340] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-11-03T17:43:59.465081] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-11-03T17:43:59.465137] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-11-03T17:43:59.831356] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:43:59.934884] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-11-03T17:44:00.017447] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T17:44:00.734917] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-11-03T17:44:01.534859] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-11-03T17:44:01.651415] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-11-03T17:44:01.984441] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T17:44:02.334901] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-11-03T17:44:02.672159] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T17:44:03.134895] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-11-03T17:44:03.569572] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T17:44:03.934890] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-11. [2025-11-03T17:44:04.468701] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T17:44:04.734903] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-11-03T17:44:05.534900] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-11. [2025-11-03T17:44:05.680598] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-11 (1.75 seconds). [2025-11-03T17:44:05.681808] [INFO ] [REMOTE ] BOND: Full fetch complete (46689 records). [2025-11-03T17:44:05.681901] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-11-03T17:44:06.076136] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-11-03T17:44:06.076286] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-11-03T17:44:06.076986] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-11-03T17:44:06.077134] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-11-03T17:44:06.078416] [DEBUG] [LOCAL ] BOND: Trimmed 46689 records to 32325 (keeping 200 days of data) [2025-11-03T17:44:06.230564] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T17:44:06.342392] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-11-03T17:44:06.342301] [DEBUG] [LOCAL ] BOND: Primary data saved (32325 records). [2025-11-03T17:44:06.342679] [INFO ] [MAIN ] BOND: Full history saved. [2025-11-03T17:44:06.343590] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOND took 40.4s. Estimated remaining: 4h 38m 35s. Rate: 7.3 symbols/min [2025-11-03T17:44:06.521188] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:44:06.542061] [DEBUG] [LOCAL ] BOW: Loaded 22802 existing records from primary storage. [2025-11-03T17:44:06.542313] [INFO ] [MAIN ] BOW: Loaded 22802 existing records. [2025-11-03T17:44:06.723457] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:44:06.723699] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-11-03T17:44:06.723758] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-11-03T17:44:06.724207] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-11-03T17:44:06.724264] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-11-03T17:44:07.093839] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:44:07.134809] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-11-03T17:44:07.204458] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T17:44:07.206119] [INFO ] [REMOTE ] BOH: Full fetch complete (45537 records). [2025-11-03T17:44:07.206216] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-11-03T17:44:07.581257] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-11-03T17:44:07.581335] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-11-03T17:44:07.581843] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-11-03T17:44:07.581906] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-11-03T17:44:07.582864] [DEBUG] [LOCAL ] BOH: Trimmed 45537 records to 30352 (keeping 200 days of data) [2025-11-03T17:44:07.767304] [DEBUG] [LOCAL ] BOH: Primary data saved (30352 records). [2025-11-03T17:44:07.767534] [INFO ] [MAIN ] BOH: Full history saved. [2025-11-03T17:44:07.767622] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOH took 41.8s. Estimated remaining: 4h 37m 44s. Rate: 7.4 symbols/min [2025-11-03T17:44:07.947776] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:44:07.948246] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-11-03T17:44:07.971526] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T17:44:07.998209] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-11-03T17:44:08.048660] [DEBUG] [LOCAL ] BOX: Loaded 50712 existing records from primary storage. [2025-11-03T17:44:08.049113] [INFO ] [MAIN ] BOX: Loaded 50712 existing records. [2025-11-03T17:44:08.275916] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:44:08.276176] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-11-03T17:44:08.276226] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-11-03T17:44:08.277144] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-11-03T17:44:08.277216] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-11-03T17:44:08.711506] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:44:08.734875] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-11-03T17:44:09.433283] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T17:44:09.534934] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-11-03T17:44:10.248172] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-11-03T17:44:10.334860] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-11-03T17:44:10.704446] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T17:44:11.134924] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-11-03T17:44:11.801888] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T17:44:11.934921] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-11-03T17:44:12.299321] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T17:44:12.734893] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-11-03T17:44:13.175993] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T17:44:13.256435] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T17:44:13.534864] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-11-03T17:44:14.334824] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-11-03T17:44:14.525152] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T17:44:15.134920] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-11-03T17:44:15.302198] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T17:44:15.934872] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-11-03T17:44:16.317250] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T17:44:16.734841] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-11-03T17:44:17.149854] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T17:44:17.539999] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-11-03T17:44:17.550752] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T17:44:18.334880] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-11-03T17:44:18.577476] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T17:44:19.134921] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-11-03T17:44:19.468966] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T17:44:19.934852] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-11-03T17:44:20.095434] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T17:44:20.734868] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-11-03T17:44:21.456596] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T17:44:21.534832] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-11-03T17:44:22.242517] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T17:44:22.334936] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-11. [2025-11-03T17:44:23.134909] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-11-03T17:44:23.284869] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-11-03T17:44:23.401705] [DEBUG] [REMOTE ] BOOT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:44:23.402025] [WARN ] [REMOTE ] BOOT: No data returned for month 2025-11 [2025-11-03T17:44:23.402219] [FATAL] [REMOTE ] BOOT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:44:23.402347] [FATAL] [MAIN ] BOOT: Failed to fetch primary data. [2025-11-03T17:44:23.402431] [WARN ] [MAIN ] BOOT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:44:23.402525] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-11-03T17:44:23.402617] [DEBUG] [LOCAL ] BOOT: No primary data file found to delete. [2025-11-03T17:44:23.402697] [INFO ] [LOCAL ] BOOT: Starting deletion of derivative data. [2025-11-03T17:44:23.403119] [DEBUG] [LOCAL ] BOOT: Deleted derivative data file. [2025-11-03T17:44:23.403224] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BOOT took 29.8s. Estimated remaining: 4h 38m 23s. Rate: 7.3 symbols/min [2025-11-03T17:44:23.571949] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:44:23.618823] [DEBUG] [LOCAL ] BP: Loaded 54485 existing records from primary storage. [2025-11-03T17:44:23.619224] [INFO ] [MAIN ] BP: Loaded 54485 existing records. [2025-11-03T17:44:23.795320] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:44:23.795515] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-11-03T17:44:23.795560] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-11-03T17:44:23.796381] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-11-03T17:44:23.796438] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-11-03T17:44:23.940246] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-11-03T17:44:24.007893] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T17:44:24.166491] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:44:24.734927] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-11-03T17:44:25.370205] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-11-03T17:44:25.534853] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-11-03T17:44:26.272796] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T17:44:26.334881] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-11-03T17:44:26.905405] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T17:44:27.134900] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-11-03T17:44:27.934860] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-11-03T17:44:28.073626] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-11-03T17:44:28.469557] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T17:44:28.640512] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T17:44:28.734872] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-11-03T17:44:29.497995] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-11-03T17:44:29.534813] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-11-03T17:44:30.334912] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-11-03T17:44:30.758269] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T17:44:31.134867] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-11-03T17:44:31.910923] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-11-03T17:44:31.934817] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-11-03T17:44:32.484250] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T17:44:32.734857] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-11-03T17:44:33.534834] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-11. [2025-11-03T17:44:33.582923] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T17:44:33.672098] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T17:44:34.334822] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-11-03T17:44:35.134867] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-11. [2025-11-03T17:44:35.508700] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-11 (1.97 seconds). [2025-11-03T17:44:35.510181] [INFO ] [REMOTE ] BORR: Full fetch complete (74523 records). [2025-11-03T17:44:35.510266] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-11-03T17:44:35.903399] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-11-03T17:44:35.903599] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-11-03T17:44:35.904455] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-11-03T17:44:35.904518] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-11-03T17:44:35.905902] [DEBUG] [LOCAL ] BORR: Trimmed 74523 records to 51042 (keeping 200 days of data) [2025-11-03T17:44:35.951141] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-11-03T17:44:36.219668] [DEBUG] [LOCAL ] BORR: Primary data saved (51042 records). [2025-11-03T17:44:36.220453] [INFO ] [MAIN ] BORR: Full history saved. [2025-11-03T17:44:36.221562] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-11-03T17:44:36.222428] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BORR took 37.2s. Estimated remaining: 4h 38m 43s. Rate: 7.3 symbols/min [2025-11-03T17:44:36.390081] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-11 (1.26 seconds). [2025-11-03T17:44:36.406673] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:44:36.408032] [INFO ] [REMOTE ] BOW: Full fetch complete (32376 records). [2025-11-03T17:44:36.408105] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-11-03T17:44:36.727365] [DEBUG] [LOCAL ] BR: Loaded 34946 existing records from primary storage. [2025-11-03T17:44:36.743868] [INFO ] [MAIN ] BR: Loaded 34946 existing records. [2025-11-03T17:44:36.738388] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-11-03T17:44:36.927594] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-11-03T17:44:36.938003] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-11-03T17:44:36.943694] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-11-03T17:44:36.943803] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-11-03T17:44:37.003317] [DEBUG] [LOCAL ] BOW: Trimmed 32376 records to 22332 (keeping 200 days of data) [2025-11-03T17:44:37.003129] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:44:37.004012] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-11-03T17:44:37.004403] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-11-03T17:44:37.005127] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-11-03T17:44:37.005190] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-11-03T17:44:37.442807] [DEBUG] [LOCAL ] BOW: Primary data saved (22332 records). [2025-11-03T17:44:37.443142] [INFO ] [MAIN ] BOW: Full history saved. [2025-11-03T17:44:37.443585] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BOW took 31.1s. Estimated remaining: 4h 37m 52s. Rate: 7.3 symbols/min [2025-11-03T17:44:37.587298] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:44:37.622025] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-11-03T17:44:37.694508] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:44:37.722952] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-11-03T17:44:37.773090] [DEBUG] [LOCAL ] BRBR: Loaded 52641 existing records from primary storage. [2025-11-03T17:44:37.773401] [INFO ] [MAIN ] BRBR: Loaded 52641 existing records. [2025-11-03T17:44:37.946527] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:44:37.946723] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-11-03T17:44:37.946791] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-11-03T17:44:37.947703] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-11-03T17:44:37.947766] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-11-03T17:44:38.290516] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:44:38.334804] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-11-03T17:44:38.657257] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-11-03T17:44:38.839143] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T17:44:39.134898] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-11-03T17:44:39.548928] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T17:44:39.934876] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-11-03T17:44:40.174238] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:44:40.734915] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-11-03T17:44:41.094254] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T17:44:41.534923] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-11-03T17:44:42.336909] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-11-03T17:44:42.343038] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-11-03T17:44:42.794991] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T17:44:43.134858] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-11-03T17:44:43.722517] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T17:44:43.934849] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-11-03T17:44:44.734905] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-11-03T17:44:44.788171] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-11-03T17:44:45.076944] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T17:44:45.534885] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-11-03T17:44:46.056556] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T17:44:46.334850] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-11-03T17:44:46.693919] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T17:44:47.134869] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-11-03T17:44:47.653340] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T17:44:47.934811] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-11-03T17:44:48.084801] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T17:44:48.734901] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-11-03T17:44:49.139782] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T17:44:49.534879] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-11-03T17:44:50.334895] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-11-03T17:44:50.439213] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-11-03T17:44:50.774810] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T17:44:51.134861] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-11-03T17:44:51.552531] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T17:44:51.934915] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-11-03T17:44:52.197581] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T17:44:52.734857] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-11. [2025-11-03T17:44:53.361694] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T17:44:53.534918] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-11-03T17:44:54.334875] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-11-03T17:44:54.600900] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T17:44:54.633134] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-11 (1.90 seconds). [2025-11-03T17:44:54.634639] [INFO ] [REMOTE ] BOX: Full fetch complete (72408 records). [2025-11-03T17:44:54.634774] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-11-03T17:44:55.048784] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-11-03T17:44:55.048862] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-11-03T17:44:55.049632] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-11-03T17:44:55.049712] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-11-03T17:44:55.050981] [DEBUG] [LOCAL ] BOX: Trimmed 72408 records to 49989 (keeping 200 days of data) [2025-11-03T17:44:55.142517] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-11-03T17:44:55.341616] [DEBUG] [LOCAL ] BOX: Primary data saved (49989 records). [2025-11-03T17:44:55.341800] [INFO ] [MAIN ] BOX: Full history saved. [2025-11-03T17:44:55.342571] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BOX took 47.6s. Estimated remaining: 4h 38m 44s. Rate: 7.3 symbols/min [2025-11-03T17:44:55.517058] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:44:55.517323] [DEBUG] [LOCAL ] BRC: No existing data file found in primary storage. [2025-11-03T17:44:55.517431] [WARN ] [MAIN ] BRC: No existing data found, performing full refresh instead. [2025-11-03T17:44:55.517640] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-11-03T17:44:55.517800] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-11-03T17:44:55.517950] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-11-03T17:44:55.518011] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-11-03T17:44:55.844177] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T17:44:55.935264] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-11-03T17:44:55.935184] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:44:56.734910] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-11-03T17:44:57.082741] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-11-03T17:44:57.124343] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T17:44:57.532380] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T17:44:57.537202] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-11-03T17:44:58.334944] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-11-03T17:44:58.456033] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T17:44:59.134908] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-11. [2025-11-03T17:44:59.595474] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T17:44:59.934858] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-11. [2025-11-03T17:45:00.735897] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-11-03T17:45:00.736578] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-11 (1.60 seconds). [2025-11-03T17:45:00.738912] [INFO ] [REMOTE ] BR: Full fetch complete (50329 records). [2025-11-03T17:45:00.739018] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-11-03T17:45:01.121338] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-11-03T17:45:01.121431] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-11-03T17:45:01.122043] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-11-03T17:45:01.122108] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-11-03T17:45:01.123301] [DEBUG] [LOCAL ] BR: Trimmed 50329 records to 34608 (keeping 200 days of data) [2025-11-03T17:45:01.330467] [DEBUG] [LOCAL ] BR: Primary data saved (34608 records). [2025-11-03T17:45:01.330592] [INFO ] [MAIN ] BR: Full history saved. [2025-11-03T17:45:01.331210] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BR took 25.1s. Estimated remaining: 4h 38m 22s. Rate: 7.3 symbols/min [2025-11-03T17:45:01.499972] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:01.539740] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-11-03T17:45:01.541292] [DEBUG] [LOCAL ] BRCC: Loaded 40657 existing records from primary storage. [2025-11-03T17:45:01.541714] [INFO ] [MAIN ] BRCC: Loaded 40657 existing records. [2025-11-03T17:45:01.721885] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:01.722096] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-11-03T17:45:01.722145] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-11-03T17:45:01.722803] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-11-03T17:45:01.722863] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-11-03T17:45:02.051740] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T17:45:02.147230] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:02.334850] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-11-03T17:45:02.964907] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-11 (3.03 seconds). [2025-11-03T17:45:02.966694] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-11-03T17:45:02.966814] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-11-03T17:45:03.144998] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-11-03T17:45:03.374747] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-11-03T17:45:03.375077] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-11-03T17:45:03.376119] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-11-03T17:45:03.376258] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-11-03T17:45:03.393444] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53705 (keeping 200 days of data) [2025-11-03T17:45:03.397500] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:45:03.436131] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-11-03T17:45:03.760624] [DEBUG] [LOCAL ] BP: Primary data saved (53705 records). [2025-11-03T17:45:03.760847] [INFO ] [MAIN ] BP: Full history saved. [2025-11-03T17:45:03.760940] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BP took 40.4s. Estimated remaining: 4h 37m 38s. Rate: 7.3 symbols/min [2025-11-03T17:45:03.927730] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:03.927897] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-11-03T17:45:03.927955] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-11-03T17:45:03.928067] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-11-03T17:45:03.928113] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-11-03T17:45:03.928239] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-11-03T17:45:03.928297] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-11-03T17:45:03.941102] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-11-03T17:45:04.282633] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:04.559295] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T17:45:04.734832] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-11-03T17:45:05.534844] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-11-03T17:45:05.643188] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-11-03T17:45:06.223426] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T17:45:06.334855] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-11-03T17:45:06.522625] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T17:45:07.134897] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-11-03T17:45:07.876116] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T17:45:07.934869] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-11. [2025-11-03T17:45:07.990950] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-11-03T17:45:08.734894] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-11-03T17:45:09.534867] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-11-03T17:45:09.681337] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-11 (1.75 seconds). [2025-11-03T17:45:09.682811] [INFO ] [REMOTE ] BRBR: Full fetch complete (73544 records). [2025-11-03T17:45:09.682906] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-11-03T17:45:09.727256] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:45:09.769176] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-11-03T17:45:09.788547] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:45:09.791088] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-11-03T17:45:09.791239] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:45:09.791688] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-11-03T17:45:09.802348] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-11-03T17:45:09.802452] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-11-03T17:45:09.807722] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-11-03T17:45:09.807836] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRCE took 6.0s. Estimated remaining: 4h 37m 17s. Rate: 7.3 symbols/min [2025-11-03T17:45:10.186568] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:10.192322] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-11-03T17:45:10.202593] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-11-03T17:45:10.234739] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-11-03T17:45:10.244564] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-11-03T17:45:10.259526] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-11-03T17:45:10.265068] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-11-03T17:45:10.347010] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-11-03T17:45:10.376410] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-11-03T17:45:10.384329] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-11-03T17:45:10.388774] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-11-03T17:45:10.389142] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-11-03T17:45:10.475965] [DEBUG] [LOCAL ] BRBR: Trimmed 73544 records to 52050 (keeping 200 days of data) [2025-11-03T17:45:10.768815] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:10.899758] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-11-03T17:45:11.006295] [DEBUG] [LOCAL ] BRBR: Primary data saved (52050 records). [2025-11-03T17:45:11.006433] [INFO ] [MAIN ] BRBR: Full history saved. [2025-11-03T17:45:11.007156] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BRBR took 33.6s. Estimated remaining: 4h 36m 26s. Rate: 7.4 symbols/min [2025-11-03T17:45:11.138773] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-11-03T17:45:11.185402] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:11.237683] [DEBUG] [LOCAL ] BRO: Loaded 52889 existing records from primary storage. [2025-11-03T17:45:11.237999] [INFO ] [MAIN ] BRO: Loaded 52889 existing records. [2025-11-03T17:45:11.437537] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:11.439428] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T17:45:11.439891] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-11-03T17:45:11.445306] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-11-03T17:45:11.446356] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-11-03T17:45:11.446425] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-11-03T17:45:11.794964] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:11.934899] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-11-03T17:45:12.367637] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T17:45:12.734932] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-11-03T17:45:13.312733] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T17:45:13.534892] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-11-03T17:45:14.078373] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T17:45:14.334914] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-11-03T17:45:14.706230] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:45:15.048681] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T17:45:15.134828] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-11-03T17:45:15.934692] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T17:45:15.934928] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-11-03T17:45:16.734876] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-11-03T17:45:17.110612] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T17:45:17.534913] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-11-03T17:45:18.016434] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T17:45:18.334866] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-11-03T17:45:18.689937] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T17:45:19.134944] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-11-03T17:45:19.296362] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:45:19.296713] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-11-03T17:45:19.296816] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:45:19.296943] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-11-03T17:45:19.297029] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:45:19.297123] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-11-03T17:45:19.297206] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-11-03T17:45:19.297245] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-11-03T17:45:19.297285] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-11-03T17:45:19.297331] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRIE took 9.5s. Estimated remaining: 4h 36m 19s. Rate: 7.4 symbols/min [2025-11-03T17:45:19.463100] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:19.510201] [DEBUG] [LOCAL ] BROS: Loaded 54073 existing records from primary storage. [2025-11-03T17:45:19.510493] [INFO ] [MAIN ] BROS: Loaded 54073 existing records. [2025-11-03T17:45:19.687740] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:19.688043] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-11-03T17:45:19.688173] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-11-03T17:45:19.688994] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-11-03T17:45:19.689053] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-11-03T17:45:19.942375] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-11-03T17:45:20.075896] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:20.078492] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-11-03T17:45:20.734888] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-11-03T17:45:21.341185] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T17:45:21.534869] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-11-03T17:45:22.086265] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-11-03T17:45:22.334878] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-11-03T17:45:23.020751] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T17:45:23.134809] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-11-03T17:45:23.432783] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T17:45:23.934925] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-11-03T17:45:24.696007] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T17:45:24.734882] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-11-03T17:45:25.107582] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-11-03T17:45:25.534857] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-11. [2025-11-03T17:45:26.334857] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-11-03T17:45:26.354498] [DEBUG] [REMOTE ] BRCC: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:45:26.382497] [WARN ] [REMOTE ] BRCC: No data returned for month 2025-11 [2025-11-03T17:45:26.382907] [FATAL] [REMOTE ] BRCC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:45:26.383193] [FATAL] [MAIN ] BRCC: Failed to fetch primary data. [2025-11-03T17:45:26.384065] [WARN ] [MAIN ] BRCC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:45:26.387411] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-11-03T17:45:26.399003] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-11-03T17:45:26.399985] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-11-03T17:45:26.400455] [INFO ] [LOCAL ] BRCC: Starting deletion of derivative data. [2025-11-03T17:45:26.400818] [DEBUG] [LOCAL ] BRCC: Deleted derivative data file. [2025-11-03T17:45:26.401732] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRCC took 25.1s. Estimated remaining: 4h 36m 4s. Rate: 7.4 symbols/min [2025-11-03T17:45:26.586680] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:26.586862] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-11-03T17:45:26.586931] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-11-03T17:45:26.587052] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-11-03T17:45:26.587097] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-11-03T17:45:26.587140] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-11-03T17:45:26.587173] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-11-03T17:45:26.961014] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:27.134858] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-11-03T17:45:27.291203] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:45:27.291511] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-11-03T17:45:27.291598] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:45:27.291678] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-11-03T17:45:27.291745] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:45:27.291822] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-11-03T17:45:27.291898] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-11-03T17:45:27.291952] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-11-03T17:45:27.291995] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-11-03T17:45:27.292051] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRSL took 0.9s. Estimated remaining: 4h 35m 12s. Rate: 7.4 symbols/min [2025-11-03T17:45:27.445945] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T17:45:27.503941] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:27.537038] [DEBUG] [LOCAL ] BRSP: Loaded 36442 existing records from primary storage. [2025-11-03T17:45:27.537316] [INFO ] [MAIN ] BRSP: Loaded 36442 existing records. [2025-11-03T17:45:27.719080] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:27.719311] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-11-03T17:45:27.719359] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-11-03T17:45:27.719952] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-11-03T17:45:27.720010] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-11-03T17:45:27.940098] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-11-03T17:45:28.082278] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:28.734825] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-11-03T17:45:29.534841] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-11-03T17:45:29.684435] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-11-03T17:45:30.117787] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T17:45:30.321078] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:45:30.334812] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-11. [2025-11-03T17:45:31.134867] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-11-03T17:45:31.512220] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-11 (1.18 seconds). [2025-11-03T17:45:31.513226] [INFO ] [REMOTE ] BRC: Full fetch complete (28242 records). [2025-11-03T17:45:31.513295] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-11-03T17:45:31.887427] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-11-03T17:45:31.887505] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-11-03T17:45:31.887996] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-11-03T17:45:31.888065] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-11-03T17:45:31.888725] [DEBUG] [LOCAL ] BRC: Trimmed 28242 records to 17883 (keeping 200 days of data) [2025-11-03T17:45:31.935168] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-11-03T17:45:32.017932] [DEBUG] [LOCAL ] BRC: Primary data saved (17883 records). [2025-11-03T17:45:32.018126] [INFO ] [MAIN ] BRC: Full history saved. [2025-11-03T17:45:32.018232] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BRC took 36.7s. Estimated remaining: 4h 34m 43s. Rate: 7.4 symbols/min [2025-11-03T17:45:32.210390] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:32.216620] [DEBUG] [LOCAL ] BRT: Loaded 5279 existing records from primary storage. [2025-11-03T17:45:32.216823] [INFO ] [MAIN ] BRT: Loaded 5279 existing records. [2025-11-03T17:45:32.400067] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:32.400319] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-11-03T17:45:32.400399] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-11-03T17:45:32.400735] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-11-03T17:45:32.400794] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-11-03T17:45:32.740841] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-11-03T17:45:32.785888] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:32.817847] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T17:45:33.534926] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-11-03T17:45:33.803412] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-11-03T17:45:33.925386] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:45:34.060780] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T17:45:34.334844] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-11-03T17:45:34.705304] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T17:45:35.134895] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-11-03T17:45:35.529578] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-11-03T17:45:35.934918] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-11-03T17:45:36.429710] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T17:45:36.734873] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-11-03T17:45:37.534889] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-11-03T17:45:37.772222] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:45:37.939037] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T17:45:38.334820] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-11-03T17:45:38.749554] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T17:45:39.134880] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-11-03T17:45:39.934858] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-11-03T17:45:40.529938] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T17:45:40.734904] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-11-03T17:45:41.419891] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T17:45:41.534880] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-11-03T17:45:42.099070] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T17:45:42.334862] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-11-03T17:45:42.995304] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T17:45:43.134856] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-11-03T17:45:43.329576] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T17:45:43.592617] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-11-03T17:45:43.934847] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-11-03T17:45:44.734850] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-11-03T17:45:45.114208] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:45:45.534879] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-11-03T17:45:46.067737] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T17:45:46.334840] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-11-03T17:45:46.417094] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-11-03T17:45:47.134859] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-11-03T17:45:47.540492] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-11-03T17:45:47.801135] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-11-03T17:45:47.934873] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-11-03T17:45:48.734924] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-11-03T17:45:49.505286] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-11-03T17:45:49.534885] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-11-03T17:45:49.651807] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T17:45:50.334850] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-11-03T17:45:51.134871] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-11. [2025-11-03T17:45:51.287133] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T17:45:51.317839] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T17:45:51.934871] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-11-03T17:45:52.734843] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-11-03T17:45:52.950823] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T17:45:53.098558] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T17:45:53.229854] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-11 (2.09 seconds). [2025-11-03T17:45:53.231391] [INFO ] [REMOTE ] BRO: Full fetch complete (75213 records). [2025-11-03T17:45:53.231482] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-11-03T17:45:53.539986] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-11-03T17:45:53.635030] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-11-03T17:45:53.635116] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-11-03T17:45:53.635987] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-11-03T17:45:53.636054] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-11-03T17:45:53.637585] [DEBUG] [LOCAL ] BRO: Trimmed 75213 records to 52143 (keeping 200 days of data) [2025-11-03T17:45:53.943909] [DEBUG] [LOCAL ] BRO: Primary data saved (52143 records). [2025-11-03T17:45:53.944030] [INFO ] [MAIN ] BRO: Full history saved. [2025-11-03T17:45:53.944893] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BRO took 42.9s. Estimated remaining: 4h 35m 58s. Rate: 7.4 symbols/min [2025-11-03T17:45:54.111448] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:54.130930] [DEBUG] [LOCAL ] BRW: Loaded 21124 existing records from primary storage. [2025-11-03T17:45:54.131163] [INFO ] [MAIN ] BRW: Loaded 21124 existing records. [2025-11-03T17:45:54.309213] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:54.309446] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-11-03T17:45:54.309519] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-11-03T17:45:54.309997] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-11-03T17:45:54.310057] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-11-03T17:45:54.340771] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-11. [2025-11-03T17:45:54.637546] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T17:45:54.701781] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:55.134926] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-11-03T17:45:55.723271] [DEBUG] [REMOTE ] BROS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:45:55.723567] [WARN ] [REMOTE ] BROS: No data returned for month 2025-11 [2025-11-03T17:45:55.723676] [FATAL] [REMOTE ] BROS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:45:55.723786] [FATAL] [MAIN ] BROS: Failed to fetch primary data. [2025-11-03T17:45:55.723855] [WARN ] [MAIN ] BROS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:45:55.723927] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-11-03T17:45:55.723990] [DEBUG] [LOCAL ] BROS: No primary data file found to delete. [2025-11-03T17:45:55.724026] [INFO ] [LOCAL ] BROS: Starting deletion of derivative data. [2025-11-03T17:45:55.724163] [DEBUG] [LOCAL ] BROS: Deleted derivative data file. [2025-11-03T17:45:55.724227] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BROS took 36.4s. Estimated remaining: 4h 35m 12s. Rate: 7.4 symbols/min [2025-11-03T17:45:55.901839] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:55.946268] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-11. [2025-11-03T17:45:55.949047] [DEBUG] [LOCAL ] BRX: Loaded 52585 existing records from primary storage. [2025-11-03T17:45:55.949310] [INFO ] [MAIN ] BRX: Loaded 52585 existing records. [2025-11-03T17:45:56.131227] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:56.136635] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-11-03T17:45:56.145008] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-11-03T17:45:56.146012] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T17:45:56.147917] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-11-03T17:45:56.151766] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-11-03T17:45:56.516237] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:56.734849] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-11-03T17:45:56.788562] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T17:45:56.789263] [INFO ] [REMOTE ] BRT: Full fetch complete (7141 records). [2025-11-03T17:45:56.789331] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-11-03T17:45:57.140761] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-11-03T17:45:57.140839] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-11-03T17:45:57.141023] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-11-03T17:45:57.141061] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-11-03T17:45:57.141465] [DEBUG] [LOCAL ] BRT: Trimmed 7141 records to 5241 (keeping 200 days of data) [2025-11-03T17:45:57.172535] [DEBUG] [LOCAL ] BRT: Primary data saved (5241 records). [2025-11-03T17:45:57.172671] [INFO ] [MAIN ] BRT: Full history saved. [2025-11-03T17:45:57.172767] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BRT took 25.2s. Estimated remaining: 4h 34m 24s. Rate: 7.4 symbols/min [2025-11-03T17:45:57.339895] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:45:57.369749] [DEBUG] [LOCAL ] BSAC: Loaded 32655 existing records from primary storage. [2025-11-03T17:45:57.370004] [INFO ] [MAIN ] BSAC: Loaded 32655 existing records. [2025-11-03T17:45:57.545987] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:45:57.540441] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-11-03T17:45:57.547015] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-11-03T17:45:57.547069] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-11-03T17:45:57.547661] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-11-03T17:45:57.547799] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-11-03T17:45:57.897175] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:45:58.171816] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T17:45:58.273360] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T17:45:58.334833] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-11-03T17:45:59.100010] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T17:45:59.134846] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-11-03T17:45:59.813969] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-11-03T17:45:59.934853] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-11-03T17:46:00.734894] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-11-03T17:46:00.809155] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-11-03T17:46:01.534878] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-11-03T17:46:01.715863] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T17:46:02.196024] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T17:46:02.334909] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-11-03T17:46:03.134857] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-11-03T17:46:03.578233] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:46:03.934869] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-11-03T17:46:03.965391] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T17:46:04.734860] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-11-03T17:46:05.340431] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:46:05.435201] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T17:46:05.534831] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-11-03T17:46:06.334897] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-11-03T17:46:06.741982] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T17:46:07.082929] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T17:46:07.134853] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-11-03T17:46:07.934847] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-11-03T17:46:08.047551] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T17:46:08.734944] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-11-03T17:46:09.319359] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T17:46:09.534845] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-11-03T17:46:09.950393] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T17:46:10.334827] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-11-03T17:46:10.520485] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T17:46:11.134885] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-11-03T17:46:11.703679] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T17:46:11.934859] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-11-03T17:46:12.349605] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T17:46:12.734909] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-11-03T17:46:13.195839] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T17:46:13.534889] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-11-03T17:46:13.811791] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T17:46:14.315078] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-11-03T17:46:14.334823] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-11. [2025-11-03T17:46:15.134867] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-11-03T17:46:15.528900] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T17:46:15.529896] [INFO ] [REMOTE ] BRW: Full fetch complete (29697 records). [2025-11-03T17:46:15.529975] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-11-03T17:46:15.928245] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-11-03T17:46:15.928325] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-11-03T17:46:15.928920] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-11-03T17:46:15.928983] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-11-03T17:46:15.929890] [DEBUG] [LOCAL ] BRW: Trimmed 29697 records to 20936 (keeping 200 days of data) [2025-11-03T17:46:15.976055] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-11. [2025-11-03T17:46:16.050338] [DEBUG] [LOCAL ] BRW: Primary data saved (20936 records). [2025-11-03T17:46:16.050483] [INFO ] [MAIN ] BRW: Full history saved. [2025-11-03T17:46:16.050569] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRW took 22.1s. Estimated remaining: 4h 35m 20s. Rate: 7.4 symbols/min [2025-11-03T17:46:16.228184] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:46:16.259611] [DEBUG] [LOCAL ] BSBR: Loaded 36001 existing records from primary storage. [2025-11-03T17:46:16.259940] [INFO ] [MAIN ] BSBR: Loaded 36001 existing records. [2025-11-03T17:46:16.442940] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:46:16.443278] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-11-03T17:46:16.443414] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-11-03T17:46:16.444050] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-11-03T17:46:16.444112] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-11-03T17:46:16.603399] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T17:46:16.740519] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-11-03T17:46:16.845722] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:46:17.534864] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-11-03T17:46:17.571098] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-11 (1.60 seconds). [2025-11-03T17:46:17.572369] [INFO ] [REMOTE ] BRSP: Full fetch complete (54012 records). [2025-11-03T17:46:17.572450] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-11-03T17:46:17.959924] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-11-03T17:46:17.960066] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-11-03T17:46:17.960706] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-11-03T17:46:17.960767] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-11-03T17:46:17.961755] [DEBUG] [LOCAL ] BRSP: Trimmed 54012 records to 35774 (keeping 200 days of data) [2025-11-03T17:46:18.165247] [DEBUG] [LOCAL ] BRSP: Primary data saved (35774 records). [2025-11-03T17:46:18.165484] [INFO ] [MAIN ] BRSP: Full history saved. [2025-11-03T17:46:18.165579] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BRSP took 50.9s. Estimated remaining: 4h 34m 36s. Rate: 7.4 symbols/min [2025-11-03T17:46:18.338726] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-11-03T17:46:18.370378] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-11-03T17:46:18.372620] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:46:18.394468] [DEBUG] [LOCAL ] BSL: Loaded 8059 existing records from primary storage. [2025-11-03T17:46:18.394665] [INFO ] [MAIN ] BSL: Loaded 8059 existing records. [2025-11-03T17:46:18.578687] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:46:18.579170] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-11-03T17:46:18.579274] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-11-03T17:46:18.579584] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-11-03T17:46:18.579681] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-11-03T17:46:18.775951] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T17:46:18.989436] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:46:19.134839] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-11-03T17:46:19.363876] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T17:46:19.651466] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T17:46:19.934942] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-11-03T17:46:20.734860] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-11-03T17:46:21.360384] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T17:46:21.539907] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-11-03T17:46:21.558589] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-11-03T17:46:22.163288] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-11-03T17:46:22.334864] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-11-03T17:46:22.870169] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T17:46:23.134843] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-11-03T17:46:23.624435] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T17:46:23.934921] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-11-03T17:46:24.734855] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-11-03T17:46:25.226967] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T17:46:25.231022] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T17:46:25.534891] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-11-03T17:46:26.334913] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-11-03T17:46:26.487110] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T17:46:27.134907] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-11. [2025-11-03T17:46:27.444271] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:46:27.934839] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-11-03T17:46:28.035157] [DEBUG] [REMOTE ] BRX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:46:28.035453] [WARN ] [REMOTE ] BRX: No data returned for month 2025-11 [2025-11-03T17:46:28.035540] [FATAL] [REMOTE ] BRX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:46:28.035620] [FATAL] [MAIN ] BRX: Failed to fetch primary data. [2025-11-03T17:46:28.035704] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:46:28.035776] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-11-03T17:46:28.035843] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-11-03T17:46:28.035878] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-11-03T17:46:28.036044] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-11-03T17:46:28.036133] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BRX took 32.3s. Estimated remaining: 4h 34m 38s. Rate: 7.4 symbols/min [2025-11-03T17:46:28.207346] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:46:28.237758] [DEBUG] [LOCAL ] BSM: Loaded 32110 existing records from primary storage. [2025-11-03T17:46:28.238303] [INFO ] [MAIN ] BSM: Loaded 32110 existing records. [2025-11-03T17:46:28.417758] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:46:28.418187] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-11-03T17:46:28.418247] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-11-03T17:46:28.419008] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-11-03T17:46:28.419067] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-11-03T17:46:28.532544] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-11-03T17:46:28.739934] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-11-03T17:46:28.792143] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:46:29.534819] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-11-03T17:46:29.733001] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T17:46:30.334863] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-11-03T17:46:30.591878] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T17:46:30.845978] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T17:46:31.134854] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-11-03T17:46:31.934888] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-11-03T17:46:32.020744] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T17:46:32.734838] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-11-03T17:46:32.775957] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T17:46:33.534908] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-11-03T17:46:33.733702] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T17:46:34.165801] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T17:46:34.334883] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-11-03T17:46:35.134888] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-11-03T17:46:35.324039] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T17:46:35.684623] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T17:46:35.934853] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-11-03T17:46:36.734898] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-11-03T17:46:37.047442] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T17:46:37.534881] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-11. [2025-11-03T17:46:37.699899] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T17:46:38.334870] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-11-03T17:46:38.977939] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-11 (1.44 seconds). [2025-11-03T17:46:38.979461] [INFO ] [REMOTE ] BSAC: Full fetch complete (45780 records). [2025-11-03T17:46:38.979545] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-11-03T17:46:39.139996] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-11. [2025-11-03T17:46:39.448594] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-11-03T17:46:39.448880] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-11-03T17:46:39.449875] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-11-03T17:46:39.450144] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-11-03T17:46:39.475857] [DEBUG] [LOCAL ] BSAC: Trimmed 45780 records to 31986 (keeping 200 days of data) [2025-11-03T17:46:39.478810] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:46:39.672728] [DEBUG] [LOCAL ] BSAC: Primary data saved (31986 records). [2025-11-03T17:46:39.672871] [INFO ] [MAIN ] BSAC: Full history saved. [2025-11-03T17:46:39.673680] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BSAC took 42.5s. Estimated remaining: 4h 34m 50s. Rate: 7.4 symbols/min [2025-11-03T17:46:39.722236] [DEBUG] [REMOTE ] BSL: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:46:39.757274] [WARN ] [REMOTE ] BSL: No data returned for month 2025-11 [2025-11-03T17:46:39.773508] [FATAL] [REMOTE ] BSL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:46:39.784538] [FATAL] [MAIN ] BSL: Failed to fetch primary data. [2025-11-03T17:46:39.785112] [WARN ] [MAIN ] BSL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:46:39.795718] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-11-03T17:46:39.800960] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-11-03T17:46:39.811265] [INFO ] [LOCAL ] BSL: Starting deletion of derivative data. [2025-11-03T17:46:39.840977] [DEBUG] [LOCAL ] BSL: Deleted derivative data file. [2025-11-03T17:46:39.857294] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSL took 21.7s. Estimated remaining: 4h 33m 55s. Rate: 7.4 symbols/min [2025-11-03T17:46:39.858870] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:46:39.939952] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-11-03T17:46:40.043063] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:46:40.050707] [DEBUG] [LOCAL ] BST: Loaded 18214 existing records from primary storage. [2025-11-03T17:46:40.051179] [INFO ] [MAIN ] BST: Loaded 18214 existing records. [2025-11-03T17:46:40.242688] [DEBUG] [LOCAL ] BSTZ: Loaded 24457 existing records from primary storage. [2025-11-03T17:46:40.264376] [INFO ] [MAIN ] BSTZ: Loaded 24457 existing records. [2025-11-03T17:46:40.264169] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:46:40.333983] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-11-03T17:46:40.355569] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-11-03T17:46:40.371736] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-11-03T17:46:40.371848] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-11-03T17:46:40.548623] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:46:40.560993] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-11-03T17:46:40.561151] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-11-03T17:46:40.567132] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-11-03T17:46:40.567245] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-11-03T17:46:40.761684] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-11-03T17:46:41.191184] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:46:41.264364] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:46:41.282535] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T17:46:41.534856] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-11-03T17:46:42.050273] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:46:42.334849] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-11-03T17:46:42.428409] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:46:43.134853] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-11-03T17:46:43.325283] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T17:46:43.934857] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-11-03T17:46:44.301135] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T17:46:44.734836] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-11-03T17:46:44.825145] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T17:46:45.514783] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T17:46:45.534826] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-11-03T17:46:46.334849] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-11-03T17:46:46.477823] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T17:46:47.134849] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-11-03T17:46:47.207590] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-11-03T17:46:47.934876] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-11-03T17:46:48.199040] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T17:46:48.734881] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-11-03T17:46:48.787166] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T17:46:49.534857] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-11-03T17:46:49.666129] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T17:46:50.334920] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-11-03T17:46:50.711500] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T17:46:51.134863] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-11-03T17:46:51.502122] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T17:46:51.934881] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-11-03T17:46:52.365909] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T17:46:52.734839] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-11. [2025-11-03T17:46:52.796154] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-11-03T17:46:53.534898] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-11-03T17:46:53.551233] [DEBUG] [REMOTE ] BSBR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:46:53.551802] [WARN ] [REMOTE ] BSBR: No data returned for month 2025-11 [2025-11-03T17:46:53.551906] [FATAL] [REMOTE ] BSBR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:46:53.552013] [FATAL] [MAIN ] BSBR: Failed to fetch primary data. [2025-11-03T17:46:53.552081] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:46:53.552187] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-11-03T17:46:53.552271] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-11-03T17:46:53.552312] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-11-03T17:46:53.552820] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-11-03T17:46:53.553087] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BSBR took 37.5s. Estimated remaining: 4h 34m 20s. Rate: 7.4 symbols/min [2025-11-03T17:46:53.724962] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:46:53.774196] [DEBUG] [LOCAL ] BSX: Loaded 54468 existing records from primary storage. [2025-11-03T17:46:53.774493] [INFO ] [MAIN ] BSX: Loaded 54468 existing records. [2025-11-03T17:46:53.953794] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:46:53.954032] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-11-03T17:46:53.954094] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-11-03T17:46:53.955242] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-11-03T17:46:53.955313] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-11-03T17:46:54.309934] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:46:54.334822] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-11-03T17:46:54.608603] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T17:46:55.134927] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-11-03T17:46:55.906294] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-11-03T17:46:55.934817] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-11-03T17:46:56.087095] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-11-03T17:46:56.734916] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-11-03T17:46:57.517339] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-11-03T17:46:57.534804] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-11-03T17:46:57.633115] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-11-03T17:46:58.287072] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:46:58.334828] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-11-03T17:46:59.134824] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-11-03T17:46:59.223851] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T17:46:59.934861] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-11-03T17:47:00.734858] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-11-03T17:47:00.842050] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-11-03T17:47:01.017156] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T17:47:01.534916] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-11-03T17:47:02.233085] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T17:47:02.334896] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-11-03T17:47:03.134914] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-11-03T17:47:03.276833] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-11-03T17:47:03.300042] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T17:47:03.934894] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-11-03T17:47:04.026281] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T17:47:04.734899] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-11-03T17:47:04.842027] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T17:47:05.516066] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T17:47:05.534817] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-11. [2025-11-03T17:47:06.334943] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-11-03T17:47:06.799581] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-11 (1.26 seconds). [2025-11-03T17:47:06.800790] [INFO ] [REMOTE ] BSM: Full fetch complete (46469 records). [2025-11-03T17:47:06.800867] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-11-03T17:47:07.161688] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-11-03T17:47:07.194362] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-11-03T17:47:07.194470] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-11-03T17:47:07.195100] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-11-03T17:47:07.195182] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-11-03T17:47:07.212127] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T17:47:07.218330] [DEBUG] [LOCAL ] BSM: Trimmed 46469 records to 31597 (keeping 200 days of data) [2025-11-03T17:47:07.420119] [DEBUG] [LOCAL ] BSM: Primary data saved (31597 records). [2025-11-03T17:47:07.420254] [INFO ] [MAIN ] BSM: Full history saved. [2025-11-03T17:47:07.420329] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BSM took 39.4s. Estimated remaining: 4h 34m 45s. Rate: 7.4 symbols/min [2025-11-03T17:47:07.589896] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:07.596831] [DEBUG] [LOCAL ] BTA: Loaded 5637 existing records from primary storage. [2025-11-03T17:47:07.597039] [INFO ] [MAIN ] BTA: Loaded 5637 existing records. [2025-11-03T17:47:07.770364] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:07.770584] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-11-03T17:47:07.770631] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-11-03T17:47:07.770876] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-11-03T17:47:07.770932] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-11-03T17:47:07.940576] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-11-03T17:47:08.122175] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:08.674747] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-11-03T17:47:08.734843] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-11-03T17:47:08.879500] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T17:47:09.534873] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-11-03T17:47:10.163714] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T17:47:10.334821] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-11-03T17:47:10.400320] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T17:47:10.986255] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-11-03T17:47:11.134855] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-11-03T17:47:11.575155] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T17:47:11.934832] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-11-03T17:47:12.734923] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-11-03T17:47:13.107678] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-11-03T17:47:13.475934] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T17:47:13.534857] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-11-03T17:47:14.334920] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-11. [2025-11-03T17:47:15.047002] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T17:47:15.134879] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-11-03T17:47:15.445453] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-11-03T17:47:15.473054] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T17:47:15.474201] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36116 records). [2025-11-03T17:47:15.474278] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-11-03T17:47:15.839567] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-11-03T17:47:15.839669] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-11-03T17:47:15.840156] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-11-03T17:47:15.840197] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-11-03T17:47:15.840994] [DEBUG] [LOCAL ] BSTZ: Trimmed 36116 records to 24246 (keeping 200 days of data) [2025-11-03T17:47:15.944943] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-11-03T17:47:15.989767] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24246 records). [2025-11-03T17:47:15.989891] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-11-03T17:47:15.989967] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BSTZ took 36.1s. Estimated remaining: 4h 34m 39s. Rate: 7.4 symbols/min [2025-11-03T17:47:16.162686] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:16.209963] [DEBUG] [LOCAL ] BTE: Loaded 53417 existing records from primary storage. [2025-11-03T17:47:16.210280] [INFO ] [MAIN ] BTE: Loaded 53417 existing records. [2025-11-03T17:47:16.386342] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:16.386572] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-11-03T17:47:16.386679] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-11-03T17:47:16.387552] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-11-03T17:47:16.387610] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-11-03T17:47:16.740141] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-11-03T17:47:16.743755] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:17.149175] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T17:47:17.346959] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T17:47:17.534883] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-11-03T17:47:18.334920] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-11-03T17:47:19.134927] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-11-03T17:47:19.577617] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-11-03T17:47:19.724514] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T17:47:19.891003] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T17:47:19.934857] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-11-03T17:47:20.734916] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-11. [2025-11-03T17:47:21.259809] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T17:47:21.534971] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-11-03T17:47:21.903808] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T17:47:21.904735] [INFO ] [REMOTE ] BST: Full fetch complete (28220 records). [2025-11-03T17:47:21.904804] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-11-03T17:47:22.262352] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-11-03T17:47:22.262425] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-11-03T17:47:22.262787] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-11-03T17:47:22.262849] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-11-03T17:47:22.263477] [DEBUG] [LOCAL ] BST: Trimmed 28220 records to 17860 (keeping 200 days of data) [2025-11-03T17:47:22.338598] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-11-03T17:47:22.368613] [DEBUG] [LOCAL ] BST: Primary data saved (17860 records). [2025-11-03T17:47:22.368727] [INFO ] [MAIN ] BST: Full history saved. [2025-11-03T17:47:22.368809] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BST took 42.7s. Estimated remaining: 4h 34m 21s. Rate: 7.4 symbols/min [2025-11-03T17:47:22.538340] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:22.584132] [DEBUG] [LOCAL ] BTI: Loaded 54363 existing records from primary storage. [2025-11-03T17:47:22.584420] [INFO ] [MAIN ] BTI: Loaded 54363 existing records. [2025-11-03T17:47:22.757192] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:22.757399] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-11-03T17:47:22.757445] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-11-03T17:47:22.758368] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-11-03T17:47:22.758425] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-11-03T17:47:23.107721] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:23.140068] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-11-03T17:47:23.153744] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T17:47:23.717582] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:47:23.722228] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T17:47:23.934873] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-11-03T17:47:24.734855] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-11-03T17:47:25.194178] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T17:47:25.534864] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-11-03T17:47:26.334839] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-11. [2025-11-03T17:47:26.432690] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-11-03T17:47:26.910759] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T17:47:27.134866] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-11-03T17:47:27.604999] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-11-03T17:47:27.687565] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T17:47:27.689199] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-11-03T17:47:27.689323] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-11-03T17:47:27.944169] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-11-03T17:47:28.087755] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-11-03T17:47:28.087835] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-11-03T17:47:28.088620] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-11-03T17:47:28.088694] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-11-03T17:47:28.090121] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-11-03T17:47:28.398511] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-11-03T17:47:28.398661] [INFO ] [MAIN ] BSX: Full history saved. [2025-11-03T17:47:28.399447] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BSX took 34.8s. Estimated remaining: 4h 34m 0s. Rate: 7.4 symbols/min [2025-11-03T17:47:28.567705] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:28.578229] [DEBUG] [LOCAL ] BTO: Loaded 8698 existing records from primary storage. [2025-11-03T17:47:28.578439] [INFO ] [MAIN ] BTO: Loaded 8698 existing records. [2025-11-03T17:47:28.747896] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-11-03T17:47:28.752598] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:28.754167] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-11-03T17:47:28.754232] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-11-03T17:47:28.754482] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-11-03T17:47:28.754541] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-11-03T17:47:29.103909] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:29.440531] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-11-03T17:47:29.465123] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T17:47:29.534866] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-11-03T17:47:30.334849] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-11-03T17:47:30.570339] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T17:47:31.134860] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-11-03T17:47:31.637971] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T17:47:31.857739] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T17:47:31.934850] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-11-03T17:47:32.734907] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-11-03T17:47:33.402586] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T17:47:33.534815] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-11-03T17:47:34.334835] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-11-03T17:47:34.377991] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T17:47:35.021776] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T17:47:35.020474] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-11-03T17:47:35.134805] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-11-03T17:47:35.934849] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-11-03T17:47:36.734867] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-11-03T17:47:36.908387] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-11-03T17:47:37.146183] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T17:47:37.431245] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T17:47:37.534891] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-11-03T17:47:38.334862] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-11-03T17:47:38.815809] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T17:47:38.929821] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T17:47:39.134873] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-11-03T17:47:39.553573] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T17:47:39.934849] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-11-03T17:47:40.734849] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-11-03T17:47:41.364927] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T17:47:41.521509] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-11-03T17:47:41.534796] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-11-03T17:47:42.334885] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-11-03T17:47:42.958496] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T17:47:43.134833] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-11. [2025-11-03T17:47:43.241630] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-11-03T17:47:43.608051] [DEBUG] [REMOTE ] BTA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:47:43.608374] [WARN ] [REMOTE ] BTA: No data returned for month 2025-11 [2025-11-03T17:47:43.608464] [FATAL] [REMOTE ] BTA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:47:43.608544] [FATAL] [MAIN ] BTA: Failed to fetch primary data. [2025-11-03T17:47:43.608609] [WARN ] [MAIN ] BTA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:47:43.608726] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-11-03T17:47:43.608811] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-11-03T17:47:43.608852] [INFO ] [LOCAL ] BTA: Starting deletion of derivative data. [2025-11-03T17:47:43.609024] [DEBUG] [LOCAL ] BTA: Deleted derivative data file. [2025-11-03T17:47:43.609111] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BTA took 36.2s. Estimated remaining: 4h 34m 33s. Rate: 7.3 symbols/min [2025-11-03T17:47:43.785442] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:43.800029] [DEBUG] [LOCAL ] BTT: Loaded 15157 existing records from primary storage. [2025-11-03T17:47:43.800262] [INFO ] [MAIN ] BTT: Loaded 15157 existing records. [2025-11-03T17:47:43.943495] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-11-03T17:47:43.985066] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:43.985417] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-11-03T17:47:43.985468] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-11-03T17:47:43.985858] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-11-03T17:47:43.985916] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-11-03T17:47:44.374755] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:44.531619] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T17:47:44.734876] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-11-03T17:47:45.345784] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T17:47:45.534857] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-11-03T17:47:46.055412] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-11-03T17:47:46.334922] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-11-03T17:47:47.134874] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-11-03T17:47:47.255912] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T17:47:47.934871] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-11-03T17:47:48.734897] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-11-03T17:47:48.815424] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-11-03T17:47:49.359175] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T17:47:49.426407] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T17:47:49.534858] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-11. [2025-11-03T17:47:50.334915] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-11-03T17:47:51.134862] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-11-03T17:47:51.758275] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-11-03T17:47:51.817846] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-11 (2.28 seconds). [2025-11-03T17:47:51.819454] [INFO ] [REMOTE ] BTE: Full fetch complete (76346 records). [2025-11-03T17:47:51.819558] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-11-03T17:47:51.949309] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-11-03T17:47:51.982303] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-11-03T17:47:52.249837] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-11-03T17:47:52.249914] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-11-03T17:47:52.250710] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-11-03T17:47:52.250773] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-11-03T17:47:52.252148] [DEBUG] [LOCAL ] BTE: Trimmed 76346 records to 52656 (keeping 200 days of data) [2025-11-03T17:47:52.546850] [DEBUG] [LOCAL ] BTE: Primary data saved (52656 records). [2025-11-03T17:47:52.546995] [INFO ] [MAIN ] BTE: Full history saved. [2025-11-03T17:47:52.547681] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BTE took 36.6s. Estimated remaining: 4h 34m 29s. Rate: 7.3 symbols/min [2025-11-03T17:47:52.721689] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T17:47:52.723872] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:52.734840] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-11. [2025-11-03T17:47:52.781008] [DEBUG] [LOCAL ] BTU: Loaded 54096 existing records from primary storage. [2025-11-03T17:47:52.781329] [INFO ] [MAIN ] BTU: Loaded 54096 existing records. [2025-11-03T17:47:52.954732] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:52.954951] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-11-03T17:47:52.955005] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-11-03T17:47:52.955942] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-11-03T17:47:52.955999] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-11-03T17:47:53.297412] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:53.534901] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-11-03T17:47:53.606857] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T17:47:53.607618] [INFO ] [REMOTE ] BTO: Full fetch complete (13193 records). [2025-11-03T17:47:53.607711] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-11-03T17:47:53.965251] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-11-03T17:47:53.965342] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-11-03T17:47:53.965603] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-11-03T17:47:53.965662] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-11-03T17:47:53.966122] [DEBUG] [LOCAL ] BTO: Trimmed 13193 records to 8590 (keeping 200 days of data) [2025-11-03T17:47:54.016782] [DEBUG] [LOCAL ] BTO: Primary data saved (8590 records). [2025-11-03T17:47:54.016919] [INFO ] [MAIN ] BTO: Full history saved. [2025-11-03T17:47:54.017024] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTO took 25.6s. Estimated remaining: 4h 33m 42s. Rate: 7.4 symbols/min [2025-11-03T17:47:54.190062] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:54.190171] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-11-03T17:47:54.190208] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-11-03T17:47:54.190335] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-11-03T17:47:54.190389] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-11-03T17:47:54.190434] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-11-03T17:47:54.190465] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-11-03T17:47:54.344739] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-11-03T17:47:54.557831] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:54.910845] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T17:47:55.134831] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-11-03T17:47:55.276481] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T17:47:55.934895] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-11-03T17:47:56.092256] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:47:56.092573] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-11-03T17:47:56.092690] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:47:56.092745] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-11-03T17:47:56.092808] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:47:56.092883] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-11-03T17:47:56.093000] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-11-03T17:47:56.093084] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-11-03T17:47:56.093176] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-11-03T17:47:56.093266] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTX took 2.1s. Estimated remaining: 4h 32m 60s. Rate: 7.4 symbols/min [2025-11-03T17:47:56.283383] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:47:56.303610] [DEBUG] [LOCAL ] BTZ: Loaded 22174 existing records from primary storage. [2025-11-03T17:47:56.303891] [INFO ] [MAIN ] BTZ: Loaded 22174 existing records. [2025-11-03T17:47:56.480946] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:47:56.481169] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-11-03T17:47:56.481309] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-11-03T17:47:56.481844] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-11-03T17:47:56.481904] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-11-03T17:47:56.744687] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-11-03T17:47:56.848038] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:47:56.880318] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T17:47:57.534899] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-11. [2025-11-03T17:47:57.984678] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:47:58.334871] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-11-03T17:47:59.134888] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-11-03T17:47:59.432920] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T17:47:59.870191] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-11 (2.34 seconds). [2025-11-03T17:47:59.871688] [INFO ] [REMOTE ] BTI: Full fetch complete (77660 records). [2025-11-03T17:47:59.871776] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-11-03T17:47:59.940019] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-11-03T17:48:00.297896] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-11-03T17:48:00.297972] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-11-03T17:48:00.298777] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-11-03T17:48:00.298838] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-11-03T17:48:00.300173] [DEBUG] [LOCAL ] BTI: Trimmed 77660 records to 53585 (keeping 200 days of data) [2025-11-03T17:48:00.617897] [DEBUG] [LOCAL ] BTI: Primary data saved (53585 records). [2025-11-03T17:48:00.618022] [INFO ] [MAIN ] BTI: Full history saved. [2025-11-03T17:48:00.618836] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BTI took 38.2s. Estimated remaining: 4h 32m 31s. Rate: 7.4 symbols/min [2025-11-03T17:48:00.740007] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-11-03T17:48:00.789083] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:00.837055] [DEBUG] [LOCAL ] BUD: Loaded 53356 existing records from primary storage. [2025-11-03T17:48:00.837384] [INFO ] [MAIN ] BUD: Loaded 53356 existing records. [2025-11-03T17:48:01.017455] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:01.031239] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T17:48:01.030325] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-11-03T17:48:01.036617] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-11-03T17:48:01.037971] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-11-03T17:48:01.038033] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-11-03T17:48:01.249867] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-11-03T17:48:01.431813] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:01.534826] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-11-03T17:48:01.662917] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T17:48:02.334868] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-11-03T17:48:02.925326] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T17:48:03.134883] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-11-03T17:48:03.313515] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-11-03T17:48:03.934835] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-11-03T17:48:03.957413] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T17:48:04.734874] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-11-03T17:48:05.498561] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T17:48:05.534808] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-11-03T17:48:05.638153] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T17:48:06.334856] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-11-03T17:48:06.857056] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T17:48:07.134853] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-11-03T17:48:07.240043] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T17:48:07.803669] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T17:48:07.934897] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-11-03T17:48:08.734897] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-11-03T17:48:09.338947] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T17:48:09.511593] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T17:48:09.534821] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-11-03T17:48:10.295435] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:48:10.334876] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-11-03T17:48:11.076323] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T17:48:11.134852] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-11-03T17:48:11.841207] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T17:48:11.934860] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-11-03T17:48:12.734849] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-11-03T17:48:13.383991] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-11-03T17:48:13.534824] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-11-03T17:48:13.648347] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-11-03T17:48:14.046365] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T17:48:14.334902] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-11-03T17:48:15.134836] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-11-03T17:48:15.171364] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T17:48:15.934850] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-11. [2025-11-03T17:48:16.672880] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-11-03T17:48:16.734826] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-11-03T17:48:16.793559] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T17:48:16.794500] [INFO ] [REMOTE ] BTT: Full fetch complete (22453 records). [2025-11-03T17:48:16.794573] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-11-03T17:48:17.153524] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-11-03T17:48:17.153671] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-11-03T17:48:17.154275] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-11-03T17:48:17.154345] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-11-03T17:48:17.155116] [DEBUG] [LOCAL ] BTT: Trimmed 22453 records to 14839 (keeping 200 days of data) [2025-11-03T17:48:17.242713] [DEBUG] [LOCAL ] BTT: Primary data saved (14839 records). [2025-11-03T17:48:17.242852] [INFO ] [MAIN ] BTT: Full history saved. [2025-11-03T17:48:17.242933] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTT took 33.6s. Estimated remaining: 4h 33m 11s. Rate: 7.4 symbols/min [2025-11-03T17:48:17.417909] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:17.429295] [DEBUG] [LOCAL ] BUI: Loaded 11667 existing records from primary storage. [2025-11-03T17:48:17.429510] [INFO ] [MAIN ] BUI: Loaded 11667 existing records. [2025-11-03T17:48:17.540396] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-11-03T17:48:17.615783] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:17.616006] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-11-03T17:48:17.616055] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-11-03T17:48:17.616410] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-11-03T17:48:17.616470] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-11-03T17:48:18.012330] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:18.177494] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T17:48:18.342750] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-11-03T17:48:18.344960] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-11-03T17:48:19.135155] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-11-03T17:48:19.207308] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-11-03T17:48:19.934852] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-11. [2025-11-03T17:48:20.734939] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-11-03T17:48:21.010335] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-11-03T17:48:21.460144] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T17:48:21.461182] [INFO ] [REMOTE ] BTZ: Full fetch complete (33136 records). [2025-11-03T17:48:21.461254] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-11-03T17:48:21.540052] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-11-03T17:48:21.831727] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-11-03T17:48:21.831828] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-11-03T17:48:21.832350] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-11-03T17:48:21.832411] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-11-03T17:48:21.833244] [DEBUG] [LOCAL ] BTZ: Trimmed 33136 records to 21646 (keeping 200 days of data) [2025-11-03T17:48:21.961749] [DEBUG] [LOCAL ] BTZ: Primary data saved (21646 records). [2025-11-03T17:48:21.961869] [INFO ] [MAIN ] BTZ: Full history saved. [2025-11-03T17:48:21.961943] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BTZ took 25.9s. Estimated remaining: 4h 32m 43s. Rate: 7.4 symbols/min [2025-11-03T17:48:22.137584] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:22.168282] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T17:48:22.212170] [DEBUG] [LOCAL ] BUR: Loaded 46244 existing records from primary storage. [2025-11-03T17:48:22.212609] [INFO ] [MAIN ] BUR: Loaded 46244 existing records. [2025-11-03T17:48:22.339933] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-11-03T17:48:22.389260] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:22.389502] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-11-03T17:48:22.389549] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-11-03T17:48:22.390384] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-11-03T17:48:22.390443] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-11-03T17:48:22.735204] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:22.925352] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T17:48:23.133617] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-11-03T17:48:23.143939] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-11-03T17:48:23.934842] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-11-03T17:48:24.734535] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-11-03T17:48:24.738968] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-11-03T17:48:25.093344] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T17:48:25.534869] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-11-03T17:48:26.334850] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-11-03T17:48:26.383327] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-11-03T17:48:26.969424] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-11-03T17:48:27.094794] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T17:48:27.134810] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-11-03T17:48:27.699607] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-11-03T17:48:27.934849] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-11-03T17:48:28.734860] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-11-03T17:48:29.286383] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-11-03T17:48:29.534876] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-11-03T17:48:30.311357] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:48:30.334877] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-11-03T17:48:30.799708] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T17:48:31.134887] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-11-03T17:48:31.914603] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-11-03T17:48:31.934822] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-11. [2025-11-03T17:48:32.347678] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T17:48:32.734866] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-11-03T17:48:33.534883] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-11-03T17:48:34.196811] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-11-03T17:48:34.242169] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-11 (2.31 seconds). [2025-11-03T17:48:34.244277] [INFO ] [REMOTE ] BTU: Full fetch complete (77313 records). [2025-11-03T17:48:34.244408] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-11-03T17:48:34.335389] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-11-03T17:48:34.710758] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-11-03T17:48:34.710922] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-11-03T17:48:34.711770] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-11-03T17:48:34.711879] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-11-03T17:48:34.714678] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-11-03T17:48:34.727956] [DEBUG] [LOCAL ] BTU: Trimmed 77313 records to 53319 (keeping 200 days of data) [2025-11-03T17:48:34.962025] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T17:48:35.052092] [DEBUG] [LOCAL ] BTU: Primary data saved (53319 records). [2025-11-03T17:48:35.052223] [INFO ] [MAIN ] BTU: Full history saved. [2025-11-03T17:48:35.052992] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BTU took 42.5s. Estimated remaining: 4h 33m 3s. Rate: 7.4 symbols/min [2025-11-03T17:48:35.134816] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-11-03T17:48:35.934887] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-11-03T17:48:36.508199] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-11-03T17:48:36.709239] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-11-03T17:48:36.734833] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-11-03T17:48:37.534954] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-11. [2025-11-03T17:48:38.249564] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T17:48:38.334916] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-11-03T17:48:38.849370] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T17:48:39.134833] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-11-03T17:48:39.719375] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-11 (2.18 seconds). [2025-11-03T17:48:39.730259] [INFO ] [REMOTE ] BUD: Full fetch complete (76492 records). [2025-11-03T17:48:39.730769] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T17:48:39.734246] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-11-03T17:48:39.940707] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-11-03T17:48:40.169552] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-11-03T17:48:40.169632] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-11-03T17:48:40.170440] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-11-03T17:48:40.170489] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-11-03T17:48:40.171949] [DEBUG] [LOCAL ] BUD: Trimmed 76492 records to 52579 (keeping 200 days of data) [2025-11-03T17:48:40.472591] [DEBUG] [LOCAL ] BUD: Primary data saved (52579 records). [2025-11-03T17:48:40.472743] [INFO ] [MAIN ] BUD: Full history saved. [2025-11-03T17:48:40.473428] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BUD took 39.9s. Estimated remaining: 4h 32m 40s. Rate: 7.4 symbols/min [2025-11-03T17:48:40.731725] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:48:40.734829] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-11-03T17:48:41.534905] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-11. [2025-11-03T17:48:42.057830] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T17:48:42.334853] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-11-03T17:48:42.465965] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T17:48:42.467076] [INFO ] [REMOTE ] BUI: Full fetch complete (16392 records). [2025-11-03T17:48:42.467415] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-11-03T17:48:42.827320] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-11-03T17:48:42.827425] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-11-03T17:48:42.827815] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-11-03T17:48:42.827878] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-11-03T17:48:42.828554] [DEBUG] [LOCAL ] BUI: Trimmed 16392 records to 11477 (keeping 200 days of data) [2025-11-03T17:48:42.897429] [DEBUG] [LOCAL ] BUI: Primary data saved (11477 records). [2025-11-03T17:48:42.897563] [INFO ] [MAIN ] BUI: Full history saved. [2025-11-03T17:48:42.897664] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUI took 25.7s. Estimated remaining: 4h 31m 59s. Rate: 7.4 symbols/min [2025-11-03T17:48:43.653180] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T17:48:43.663620] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-11-03T17:48:45.037350] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T17:48:45.047986] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-11-03T17:48:46.381922] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T17:48:46.392023] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-11-03T17:48:47.815398] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:48:47.826475] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-11. [2025-11-03T17:48:49.571146] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-11 (1.74 seconds). [2025-11-03T17:48:49.572941] [INFO ] [REMOTE ] BUR: Full fetch complete (65026 records). [2025-11-03T17:48:49.573076] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-11-03T17:48:49.963796] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-11-03T17:48:49.963903] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-11-03T17:48:49.964665] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-11-03T17:48:49.964728] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-11-03T17:48:49.965998] [DEBUG] [LOCAL ] BUR: Trimmed 65026 records to 45527 (keeping 200 days of data) [2025-11-03T17:48:50.237667] [DEBUG] [LOCAL ] BUR: Primary data saved (45527 records). [2025-11-03T17:48:50.237813] [INFO ] [MAIN ] BUR: Full history saved. [2025-11-03T17:48:50.238411] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BUR took 28.3s. Estimated remaining: 4h 31m 47s. Rate: 7.4 symbols/min [2025-11-03T17:48:50.838828] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:50.956584] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:50.936844] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:50.960354] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:48:50.978027] [DEBUG] [LOCAL ] BUXX: Loaded 15309 existing records from primary storage. [2025-11-03T17:48:50.978327] [INFO ] [MAIN ] BUXX: Loaded 15309 existing records. [2025-11-03T17:48:51.215399] [DEBUG] [LOCAL ] BV: Loaded 38890 existing records from primary storage. [2025-11-03T17:48:51.238088] [DEBUG] [LOCAL ] BURL: Loaded 45657 existing records from primary storage. [2025-11-03T17:48:51.233445] [DEBUG] [LOCAL ] BVN: Loaded 45248 existing records from primary storage. [2025-11-03T17:48:51.237246] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:51.238742] [INFO ] [MAIN ] BVN: Loaded 45248 existing records. [2025-11-03T17:48:51.238905] [INFO ] [MAIN ] BV: Loaded 38890 existing records. [2025-11-03T17:48:51.239293] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-11-03T17:48:51.250034] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-11-03T17:48:51.239539] [INFO ] [MAIN ] BURL: Loaded 45657 existing records. [2025-11-03T17:48:51.329392] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-11-03T17:48:51.452039] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-11-03T17:48:51.891265] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:51.905422] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-11-03T17:48:51.907763] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-11-03T17:48:51.870717] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:51.928960] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:48:51.929079] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-11-03T17:48:51.950000] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-11-03T17:48:51.934293] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-11-03T17:48:51.944820] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-11-03T17:48:51.955432] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-11-03T17:48:51.950205] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-11-03T17:48:51.986540] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-11-03T17:48:52.002197] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-11-03T17:48:52.046750] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-11-03T17:48:52.062986] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-11-03T17:48:52.715142] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:52.766679] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-11-03T17:48:53.243810] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:53.260478] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-11-03T17:48:53.350136] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:53.350815] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-11-03T17:48:53.346662] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:48:53.351064] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-11-03T17:48:53.705387] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T17:48:53.708261] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-11-03T17:48:54.196794] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T17:48:54.199516] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-11-03T17:48:54.216579] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T17:48:54.222900] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-11-03T17:48:54.368269] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T17:48:54.377043] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-11-03T17:48:54.405753] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T17:48:54.414915] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-11-03T17:48:54.782228] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T17:48:54.785620] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-11-03T17:48:55.054316] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T17:48:55.061981] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-11-03T17:48:55.469552] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T17:48:55.481590] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-11-03T17:48:55.496459] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-11-03T17:48:55.714412] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T17:48:55.934986] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-11-03T17:48:56.032807] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T17:48:56.734889] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-11-03T17:48:56.775518] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T17:48:57.347685] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:48:57.374360] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-11-03T17:48:57.534873] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-11-03T17:48:58.334910] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-11-03T17:48:58.898509] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T17:48:59.134939] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-11-03T17:48:59.484232] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T17:48:59.707773] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-11-03T17:48:59.934856] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-11-03T17:49:00.734893] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-11-03T17:49:01.115511] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T17:49:01.534913] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-11-03T17:49:02.334885] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-11-03T17:49:02.401906] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T17:49:02.970290] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-11-03T17:49:03.134880] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-11-03T17:49:03.625567] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:49:03.858966] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T17:49:03.934866] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-11-03T17:49:04.571530] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-11-03T17:49:04.734864] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-11-03T17:49:05.534830] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-11-03T17:49:05.650925] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T17:49:06.334836] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-11-03T17:49:06.773302] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T17:49:07.134847] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-11-03T17:49:07.814376] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T17:49:07.934862] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-11-03T17:49:08.170672] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T17:49:08.734846] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-11-03T17:49:09.153917] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T17:49:09.534907] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-11. [2025-11-03T17:49:09.817560] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T17:49:10.334879] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-11-03T17:49:10.622527] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-11 (1.09 seconds). [2025-11-03T17:49:10.623333] [INFO ] [REMOTE ] BUXX: Full fetch complete (20894 records). [2025-11-03T17:49:10.623421] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-11-03T17:49:10.975465] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-11-03T17:49:10.975543] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-11-03T17:49:10.975944] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-11-03T17:49:10.976004] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-11-03T17:49:10.976568] [DEBUG] [LOCAL ] BUXX: Trimmed 20894 records to 15026 (keeping 200 days of data) [2025-11-03T17:49:11.064224] [DEBUG] [LOCAL ] BUXX: Primary data saved (15026 records). [2025-11-03T17:49:11.064348] [INFO ] [MAIN ] BUXX: Full history saved. [2025-11-03T17:49:11.064424] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BUXX took 20.8s. Estimated remaining: 4h 32m 49s. Rate: 7.3 symbols/min [2025-11-03T17:49:11.140049] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-11-03T17:49:11.232368] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:49:11.267256] [DEBUG] [LOCAL ] BW: Loaded 41078 existing records from primary storage. [2025-11-03T17:49:11.267536] [INFO ] [MAIN ] BW: Loaded 41078 existing records. [2025-11-03T17:49:11.447256] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:49:11.447605] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-11-03T17:49:11.447720] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-11-03T17:49:11.448418] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-11-03T17:49:11.448475] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-11-03T17:49:11.774595] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T17:49:11.834888] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:49:11.934822] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-11-03T17:49:12.331077] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T17:49:12.734857] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-11-03T17:49:13.203988] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:49:13.534828] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-11-03T17:49:13.756937] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T17:49:14.334855] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-11-03T17:49:14.674723] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T17:49:15.134893] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-11-03T17:49:15.547364] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T17:49:15.934842] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-11-03T17:49:16.254687] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:49:16.734864] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-11. [2025-11-03T17:49:17.305909] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T17:49:17.534932] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-11-03T17:49:18.334895] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-11-03T17:49:18.476676] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-11 (1.74 seconds). [2025-11-03T17:49:18.477910] [INFO ] [REMOTE ] BV: Full fetch complete (55416 records). [2025-11-03T17:49:18.477995] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-11-03T17:49:18.886364] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-11-03T17:49:18.886540] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-11-03T17:49:18.887494] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-11-03T17:49:18.887584] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-11-03T17:49:18.889191] [DEBUG] [LOCAL ] BV: Trimmed 55416 records to 38370 (keeping 200 days of data) [2025-11-03T17:49:19.124732] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T17:49:19.141250] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-11-03T17:49:19.162464] [DEBUG] [LOCAL ] BV: Primary data saved (38370 records). [2025-11-03T17:49:19.164051] [INFO ] [MAIN ] BV: Full history saved. [2025-11-03T17:49:19.164171] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BV took 28.9s. Estimated remaining: 4h 32m 41s. Rate: 7.3 symbols/min [2025-11-03T17:49:19.342150] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:49:19.371441] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:49:19.422273] [DEBUG] [LOCAL ] BWA: Loaded 52776 existing records from primary storage. [2025-11-03T17:49:19.422672] [INFO ] [MAIN ] BWA: Loaded 52776 existing records. [2025-11-03T17:49:19.597734] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:49:19.597953] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-11-03T17:49:19.598003] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-11-03T17:49:19.598934] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-11-03T17:49:19.598993] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-11-03T17:49:19.940485] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-11. [2025-11-03T17:49:19.984543] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:49:20.414074] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T17:49:20.734957] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-11-03T17:49:21.534883] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-11-03T17:49:21.936540] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T17:49:22.248975] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-11 (2.31 seconds). [2025-11-03T17:49:22.250699] [INFO ] [REMOTE ] BVN: Full fetch complete (64055 records). [2025-11-03T17:49:22.250814] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-11-03T17:49:22.340101] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-11-03T17:49:22.674570] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-11-03T17:49:22.674712] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-11-03T17:49:22.675484] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-11-03T17:49:22.675636] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-11-03T17:49:22.691479] [DEBUG] [LOCAL ] BVN: Trimmed 64055 records to 44730 (keeping 200 days of data) [2025-11-03T17:49:22.702957] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T17:49:22.963398] [DEBUG] [LOCAL ] BVN: Primary data saved (44730 records). [2025-11-03T17:49:22.963536] [INFO ] [MAIN ] BVN: Full history saved. [2025-11-03T17:49:22.964632] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BVN took 32.7s. Estimated remaining: 4h 32m 9s. Rate: 7.4 symbols/min [2025-11-03T17:49:23.134453] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:49:23.134912] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-11-03T17:49:23.148126] [DEBUG] [LOCAL ] BWG: Loaded 12491 existing records from primary storage. [2025-11-03T17:49:23.148385] [INFO ] [MAIN ] BWG: Loaded 12491 existing records. [2025-11-03T17:49:23.324325] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:49:23.324529] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-11-03T17:49:23.324577] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-11-03T17:49:23.324899] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-11-03T17:49:23.324957] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-11-03T17:49:23.695135] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:49:23.820505] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-11-03T17:49:23.934904] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-11-03T17:49:24.413432] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T17:49:24.734834] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-11-03T17:49:24.865517] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T17:49:25.534870] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-11-03T17:49:26.063488] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T17:49:26.334897] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-11-03T17:49:26.836392] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T17:49:26.864289] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-11-03T17:49:27.134875] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-11-03T17:49:27.934901] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-11-03T17:49:28.455482] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-11-03T17:49:28.486407] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:49:28.734856] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-11-03T17:49:29.227663] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T17:49:29.534905] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-11-03T17:49:30.334871] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-11. [2025-11-03T17:49:30.599114] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T17:49:31.134867] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-11-03T17:49:31.419869] [DEBUG] [REMOTE ] BURL: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:49:31.420188] [WARN ] [REMOTE ] BURL: No data returned for month 2025-11 [2025-11-03T17:49:31.420298] [FATAL] [REMOTE ] BURL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:49:31.420413] [FATAL] [MAIN ] BURL: Failed to fetch primary data. [2025-11-03T17:49:31.420502] [WARN ] [MAIN ] BURL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:49:31.420594] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-11-03T17:49:31.420708] [DEBUG] [LOCAL ] BURL: No primary data file found to delete. [2025-11-03T17:49:31.420763] [INFO ] [LOCAL ] BURL: Starting deletion of derivative data. [2025-11-03T17:49:31.420913] [DEBUG] [LOCAL ] BURL: Deleted derivative data file. [2025-11-03T17:49:31.420981] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BURL took 41.2s. Estimated remaining: 4h 32m 2s. Rate: 7.4 symbols/min [2025-11-03T17:49:31.590465] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:49:31.620114] [DEBUG] [LOCAL ] BWLP: Loaded 32174 existing records from primary storage. [2025-11-03T17:49:31.620385] [INFO ] [MAIN ] BWLP: Loaded 32174 existing records. [2025-11-03T17:49:31.800062] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:49:31.800341] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-11-03T17:49:31.800401] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-11-03T17:49:31.801117] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-11-03T17:49:31.801176] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-11-03T17:49:31.950109] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-11-03T17:49:32.176054] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:49:32.645354] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T17:49:32.734854] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-11-03T17:49:33.534851] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-11-03T17:49:33.779475] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-11-03T17:49:34.074192] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T17:49:34.334874] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-11-03T17:49:34.592532] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T17:49:35.085260] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:49:35.134879] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-11-03T17:49:35.658050] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-11-03T17:49:35.934867] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-11-03T17:49:36.563710] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-11-03T17:49:36.734853] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-11-03T17:49:37.308798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T17:49:37.534880] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-11-03T17:49:38.188519] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-11-03T17:49:38.334860] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-11-03T17:49:38.774693] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-11-03T17:49:39.134849] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-11. [2025-11-03T17:49:39.934838] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-11-03T17:49:40.019106] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T17:49:40.019965] [INFO ] [REMOTE ] BWG: Full fetch complete (17263 records). [2025-11-03T17:49:40.020036] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-11-03T17:49:40.406616] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-11-03T17:49:40.406729] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-11-03T17:49:40.407140] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-11-03T17:49:40.407203] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-11-03T17:49:40.407926] [DEBUG] [LOCAL ] BWG: Trimmed 17263 records to 12380 (keeping 200 days of data) [2025-11-03T17:49:40.478798] [DEBUG] [LOCAL ] BWG: Primary data saved (12380 records). [2025-11-03T17:49:40.478927] [INFO ] [MAIN ] BWG: Full history saved. [2025-11-03T17:49:40.479004] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWG took 17.5s. Estimated remaining: 4h 31m 59s. Rate: 7.4 symbols/min [2025-11-03T17:49:40.644950] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:49:40.653615] [DEBUG] [LOCAL ] BWMX: Loaded 8178 existing records from primary storage. [2025-11-03T17:49:40.653826] [INFO ] [MAIN ] BWMX: Loaded 8178 existing records. [2025-11-03T17:49:40.742944] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-11-03T17:49:40.831303] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:49:40.831521] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-11-03T17:49:40.831570] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-11-03T17:49:40.831882] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-11-03T17:49:40.831940] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-11-03T17:49:41.190976] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:49:41.285448] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T17:49:41.534859] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-11-03T17:49:41.786284] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:49:42.334878] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-11-03T17:49:42.859034] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T17:49:42.861904] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T17:49:43.134858] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-11-03T17:49:43.934852] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-11-03T17:49:44.296038] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-11-03T17:49:44.740042] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-11-03T17:49:44.760224] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T17:49:45.534868] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-11-03T17:49:46.191126] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T17:49:46.334849] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-11-03T17:49:46.807504] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:49:47.134867] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-11. [2025-11-03T17:49:47.683705] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T17:49:47.934849] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-11-03T17:49:48.734868] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-11-03T17:49:49.115047] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:49:49.142112] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-11 (2.01 seconds). [2025-11-03T17:49:49.143545] [INFO ] [REMOTE ] BW: Full fetch complete (59382 records). [2025-11-03T17:49:49.143626] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-11-03T17:49:49.540704] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-11-03T17:49:49.544767] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-11-03T17:49:49.544858] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-11-03T17:49:49.545527] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-11-03T17:49:49.545721] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-11-03T17:49:49.547035] [DEBUG] [LOCAL ] BW: Trimmed 59382 records to 40518 (keeping 200 days of data) [2025-11-03T17:49:49.787489] [DEBUG] [LOCAL ] BW: Primary data saved (40518 records). [2025-11-03T17:49:49.787722] [INFO ] [MAIN ] BW: Full history saved. [2025-11-03T17:49:49.788619] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BW took 38.7s. Estimated remaining: 4h 31m 57s. Rate: 7.4 symbols/min [2025-11-03T17:49:49.968996] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:49:49.986221] [DEBUG] [LOCAL ] BWNB: Loaded 4037 existing records from primary storage. [2025-11-03T17:49:50.004596] [INFO ] [MAIN ] BWNB: Loaded 4037 existing records. [2025-11-03T17:49:50.085122] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T17:49:50.207910] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:49:50.208176] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-11-03T17:49:50.208229] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-11-03T17:49:50.208472] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-11-03T17:49:50.208534] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-11-03T17:49:50.340057] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-11-03T17:49:50.590556] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:49:50.705887] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T17:49:50.894481] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-11-03T17:49:51.134920] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-11-03T17:49:51.629659] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T17:49:51.934842] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-11-03T17:49:52.734914] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-11-03T17:49:53.027524] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T17:49:53.331187] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T17:49:53.534890] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-11-03T17:49:54.334861] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-11-03T17:49:54.859375] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-11-03T17:49:55.040083] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-11-03T17:49:55.134833] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-11-03T17:49:55.934875] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-11-03T17:49:56.501225] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T17:49:56.519962] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T17:49:56.734860] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-11-03T17:49:57.534898] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-11-03T17:49:57.900386] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T17:49:57.993325] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-11-03T17:49:58.334847] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-11-03T17:49:59.134826] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-11-03T17:49:59.307313] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T17:49:59.934864] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-11-03T17:50:00.357479] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-11-03T17:50:00.618943] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T17:50:00.734851] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-11. [2025-11-03T17:50:01.534917] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-11-03T17:50:01.935994] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T17:50:02.334879] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-11-03T17:50:02.628304] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-11-03T17:50:02.959918] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-11 (2.23 seconds). [2025-11-03T17:50:02.961398] [INFO ] [REMOTE ] BWA: Full fetch complete (75849 records). [2025-11-03T17:50:02.961506] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-11-03T17:50:03.139265] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-11-03T17:50:03.357320] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-11-03T17:50:03.357462] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-11-03T17:50:03.358308] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-11-03T17:50:03.358373] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-11-03T17:50:03.359849] [DEBUG] [LOCAL ] BWA: Trimmed 75849 records to 52015 (keeping 200 days of data) [2025-11-03T17:50:03.660994] [DEBUG] [LOCAL ] BWA: Primary data saved (52015 records). [2025-11-03T17:50:03.661123] [INFO ] [MAIN ] BWA: Full history saved. [2025-11-03T17:50:03.661201] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWA took 44.5s. Estimated remaining: 4h 32m 20s. Rate: 7.3 symbols/min [2025-11-03T17:50:03.862158] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:03.868980] [DEBUG] [LOCAL ] BWSN: Loaded 5066 existing records from primary storage. [2025-11-03T17:50:03.869219] [INFO ] [MAIN ] BWSN: Loaded 5066 existing records. [2025-11-03T17:50:03.947942] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-11-03T17:50:04.097532] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:50:04.097785] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-11-03T17:50:04.097837] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-11-03T17:50:04.098070] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-11-03T17:50:04.098127] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-11-03T17:50:04.550015] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:04.557756] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T17:50:04.580052] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T17:50:04.734908] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-11-03T17:50:05.534877] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-11-03T17:50:05.999139] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T17:50:05.999903] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-11-03T17:50:06.334850] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-11-03T17:50:07.035154] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T17:50:07.134827] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-11-03T17:50:07.599741] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-11-03T17:50:07.934855] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-11-03T17:50:08.510059] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-11-03T17:50:08.734867] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-11. [2025-11-03T17:50:09.534849] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-11. [2025-11-03T17:50:10.296841] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-11 (0.76 seconds). [2025-11-03T17:50:10.297806] [INFO ] [REMOTE ] BWMX: Full fetch complete (10188 records). [2025-11-03T17:50:10.297887] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-11-03T17:50:10.340022] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-11-03T17:50:10.476746] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-11 (1.74 seconds). [2025-11-03T17:50:10.531317] [INFO ] [REMOTE ] BWLP: Full fetch complete (47730 records). [2025-11-03T17:50:10.591343] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-11-03T17:50:10.812817] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-11-03T17:50:10.823785] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-11-03T17:50:10.842885] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-11-03T17:50:10.859286] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-11-03T17:50:10.901097] [DEBUG] [LOCAL ] BWMX: Trimmed 10188 records to 8148 (keeping 200 days of data) [2025-11-03T17:50:10.900961] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-11-03T17:50:11.072231] [DEBUG] [LOCAL ] BWMX: Primary data saved (8148 records). [2025-11-03T17:50:11.082613] [INFO ] [MAIN ] BWMX: Full history saved. [2025-11-03T17:50:11.087879] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWMX took 30.6s. Estimated remaining: 4h 32m 8s. Rate: 7.3 symbols/min [2025-11-03T17:50:11.145227] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-11-03T17:50:11.220308] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-11-03T17:50:11.233386] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-11-03T17:50:11.260161] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-11-03T17:50:11.264244] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-11-03T17:50:11.317446] [DEBUG] [LOCAL ] BWLP: Trimmed 47730 records to 31767 (keeping 200 days of data) [2025-11-03T17:50:11.334849] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:11.535044] [DEBUG] [LOCAL ] BWLP: Primary data saved (31767 records). [2025-11-03T17:50:11.548436] [INFO ] [MAIN ] BWLP: Full history saved. [2025-11-03T17:50:11.549451] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BWLP took 40.1s. Estimated remaining: 4h 31m 18s. Rate: 7.4 symbols/min [2025-11-03T17:50:11.596560] [DEBUG] [LOCAL ] BWXT: Loaded 47790 existing records from primary storage. [2025-11-03T17:50:11.632514] [INFO ] [MAIN ] BWXT: Loaded 47790 existing records. [2025-11-03T17:50:11.744118] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-11-03T17:50:11.855755] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:11.917858] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:50:11.918148] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-11-03T17:50:11.918202] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-11-03T17:50:11.919060] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-11-03T17:50:11.919119] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-11-03T17:50:11.939907] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-11-03T17:50:12.248695] [DEBUG] [LOCAL ] BX: Loaded 54261 existing records from primary storage. [2025-11-03T17:50:12.271568] [INFO ] [MAIN ] BX: Loaded 54261 existing records. [2025-11-03T17:50:12.381215] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:12.427463] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-11-03T17:50:12.517723] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:50:12.518009] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-11-03T17:50:12.518073] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-11-03T17:50:12.519064] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-11-03T17:50:12.519145] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-11-03T17:50:12.744060] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-11-03T17:50:12.895559] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:13.108987] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-11-03T17:50:13.534909] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-11-03T17:50:14.334878] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-11-03T17:50:14.708737] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-11-03T17:50:15.134883] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-11-03T17:50:15.584509] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T17:50:15.934887] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-11-03T17:50:16.214482] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-11-03T17:50:16.501995] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-11-03T17:50:16.734918] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-11. [2025-11-03T17:50:17.303175] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T17:50:17.304043] [INFO ] [REMOTE ] BWNB: Full fetch complete (5579 records). [2025-11-03T17:50:17.304117] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-11-03T17:50:17.543078] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-11-03T17:50:17.701544] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-11-03T17:50:17.701667] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-11-03T17:50:17.701868] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-11-03T17:50:17.701908] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-11-03T17:50:17.702278] [DEBUG] [LOCAL ] BWNB: Trimmed 5579 records to 3995 (keeping 200 days of data) [2025-11-03T17:50:17.726225] [DEBUG] [LOCAL ] BWNB: Primary data saved (3995 records). [2025-11-03T17:50:17.726315] [INFO ] [MAIN ] BWNB: Full history saved. [2025-11-03T17:50:17.726390] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWNB took 27.9s. Estimated remaining: 4h 30m 59s. Rate: 7.4 symbols/min [2025-11-03T17:50:17.912482] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:17.912678] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-11-03T17:50:17.912734] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-11-03T17:50:17.912849] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-11-03T17:50:17.912890] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-11-03T17:50:17.912930] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-11-03T17:50:17.912962] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-11-03T17:50:18.268041] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:18.334882] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-11-03T17:50:18.751403] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-11-03T17:50:19.120687] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T17:50:19.134799] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-11-03T17:50:19.934909] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-11-03T17:50:20.407047] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T17:50:20.578371] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-11-03T17:50:20.734871] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-11-03T17:50:21.418854] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T17:50:21.534860] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-11-03T17:50:22.157724] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T17:50:22.334833] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-11-03T17:50:22.960448] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T17:50:23.134893] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-11-03T17:50:23.489701] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-11-03T17:50:23.934847] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-11-03T17:50:24.390430] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-11-03T17:50:24.734862] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-11-03T17:50:25.534851] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-11-03T17:50:26.334931] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-11-03T17:50:26.437215] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-11-03T17:50:26.662341] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T17:50:26.888887] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T17:50:27.134854] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-11-03T17:50:27.934845] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-11-03T17:50:28.323858] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-11-03T17:50:28.369951] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T17:50:28.734854] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-11. [2025-11-03T17:50:29.364505] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-11 (0.63 seconds). [2025-11-03T17:50:29.365161] [INFO ] [REMOTE ] BWSN: Full fetch complete (6456 records). [2025-11-03T17:50:29.365228] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-11-03T17:50:29.545938] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-11-03T17:50:29.755452] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-11-03T17:50:29.755532] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-11-03T17:50:29.755741] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-11-03T17:50:29.755807] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-11-03T17:50:29.756191] [DEBUG] [LOCAL ] BWSN: Trimmed 6456 records to 5022 (keeping 200 days of data) [2025-11-03T17:50:29.787960] [DEBUG] [LOCAL ] BWSN: Primary data saved (5022 records). [2025-11-03T17:50:29.788048] [INFO ] [MAIN ] BWSN: Full history saved. [2025-11-03T17:50:29.788120] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BWSN took 26.1s. Estimated remaining: 4h 31m 12s. Rate: 7.4 symbols/min [2025-11-03T17:50:29.956358] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:29.997374] [DEBUG] [LOCAL ] BXMT: Loaded 47854 existing records from primary storage. [2025-11-03T17:50:29.997698] [INFO ] [MAIN ] BXMT: Loaded 47854 existing records. [2025-11-03T17:50:30.182094] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:50:30.182312] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-11-03T17:50:30.182359] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-11-03T17:50:30.190779] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-11-03T17:50:30.191865] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-11-03T17:50:30.191766] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-11-03T17:50:30.349507] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-11-03T17:50:30.564300] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:31.134881] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-11-03T17:50:31.877983] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-11-03T17:50:31.934851] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-11-03T17:50:32.533750] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T17:50:32.734840] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-11-03T17:50:32.817832] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-11-03T17:50:33.534910] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-11-03T17:50:34.315902] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-11-03T17:50:34.334825] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-11-03T17:50:34.795618] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T17:50:35.134886] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-11-03T17:50:35.784311] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-11-03T17:50:35.934827] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-11-03T17:50:36.622110] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T17:50:36.734843] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-11-03T17:50:36.983161] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-11-03T17:50:37.534842] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-11-03T17:50:38.057681] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T17:50:38.334871] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-11-03T17:50:38.912129] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T17:50:39.134830] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-11-03T17:50:39.243677] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-11-03T17:50:39.934836] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-11-03T17:50:40.007208] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T17:50:40.734882] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-11-03T17:50:41.507922] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-11-03T17:50:41.534896] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-11-03T17:50:42.334951] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-11-03T17:50:42.588289] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-11-03T17:50:43.073315] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-11-03T17:50:43.134878] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-11-03T17:50:43.607262] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:50:43.822814] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T17:50:43.934857] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-11-03T17:50:44.734891] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-11-03T17:50:45.401279] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-11-03T17:50:45.472631] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-11-03T17:50:45.534903] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-11-03T17:50:46.334926] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-11-03T17:50:47.030156] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T17:50:47.134889] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-11-03T17:50:47.672263] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T17:50:47.934853] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-11-03T17:50:48.530872] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T17:50:48.541840] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T17:50:48.734861] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-11-03T17:50:49.534838] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-11. [2025-11-03T17:50:49.962852] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:50:50.334888] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-11-03T17:50:50.533961] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-11 (1.00 seconds). [2025-11-03T17:50:50.534786] [INFO ] [REMOTE ] BXC: Full fetch complete (18295 records). [2025-11-03T17:50:50.534854] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-11-03T17:50:50.902582] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-11-03T17:50:50.902710] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-11-03T17:50:50.903098] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-11-03T17:50:50.903151] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-11-03T17:50:50.903799] [DEBUG] [LOCAL ] BXC: Trimmed 18295 records to 13055 (keeping 200 days of data) [2025-11-03T17:50:50.979116] [DEBUG] [LOCAL ] BXC: Primary data saved (13055 records). [2025-11-03T17:50:50.979251] [INFO ] [MAIN ] BXC: Full history saved. [2025-11-03T17:50:50.979328] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BXC took 33.3s. Estimated remaining: 4h 32m 14s. Rate: 7.3 symbols/min [2025-11-03T17:50:51.152881] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-11-03T17:50:51.156915] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:51.177346] [DEBUG] [LOCAL ] BXMX: Loaded 18988 existing records from primary storage. [2025-11-03T17:50:51.177680] [INFO ] [MAIN ] BXMX: Loaded 18988 existing records. [2025-11-03T17:50:51.366617] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:50:51.366859] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-11-03T17:50:51.366941] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-11-03T17:50:51.367375] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-11-03T17:50:51.367446] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-11-03T17:50:51.726576] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:51.820663] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T17:50:51.934837] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-11. [2025-11-03T17:50:52.418811] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T17:50:52.734895] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-11-03T17:50:53.534861] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-11-03T17:50:53.738319] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T17:50:54.334899] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-11-03T17:50:54.623033] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-11 (2.69 seconds). [2025-11-03T17:50:54.624502] [INFO ] [REMOTE ] BWXT: Full fetch complete (68251 records). [2025-11-03T17:50:54.624600] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-11-03T17:50:55.056163] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-11-03T17:50:55.057544] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-11-03T17:50:55.057461] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T17:50:55.058413] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-11-03T17:50:55.058587] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-11-03T17:50:55.064756] [DEBUG] [LOCAL ] BWXT: Trimmed 68251 records to 47265 (keeping 200 days of data) [2025-11-03T17:50:55.153991] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-11-03T17:50:55.353497] [DEBUG] [LOCAL ] BWXT: Primary data saved (47265 records). [2025-11-03T17:50:55.353775] [INFO ] [MAIN ] BWXT: Full history saved. [2025-11-03T17:50:55.354588] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BWXT took 44.3s. Estimated remaining: 4h 31m 45s. Rate: 7.3 symbols/min [2025-11-03T17:50:55.526041] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:50:55.564232] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-11-03T17:50:55.626323] [DEBUG] [LOCAL ] BXP: Loaded 50494 existing records from primary storage. [2025-11-03T17:50:55.626843] [INFO ] [MAIN ] BXP: Loaded 50494 existing records. [2025-11-03T17:50:55.820410] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:50:55.820736] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-11-03T17:50:55.820795] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-11-03T17:50:55.821915] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-11-03T17:50:55.821976] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-11-03T17:50:55.940108] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-11-03T17:50:56.200086] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:50:56.418909] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T17:50:56.728104] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-11-03T17:50:56.734800] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-11-03T17:50:57.519305] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-11-03T17:50:57.534867] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-11-03T17:50:58.184329] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T17:50:58.334862] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-11-03T17:50:59.134866] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-11-03T17:50:59.798404] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T17:50:59.934929] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-11-03T17:51:00.734880] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-11-03T17:51:01.016463] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-11-03T17:51:01.433974] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T17:51:01.534934] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-11-03T17:51:01.816857] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T17:51:02.334911] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-11-03T17:51:03.001107] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-11-03T17:51:03.134872] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-11. [2025-11-03T17:51:03.730911] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T17:51:03.934826] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-11-03T17:51:04.734864] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-11. [2025-11-03T17:51:05.126379] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-11 (1.99 seconds). [2025-11-03T17:51:05.127851] [INFO ] [REMOTE ] BXMT: Full fetch complete (69845 records). [2025-11-03T17:51:05.127932] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-11-03T17:51:05.540097] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-11-03T17:51:05.544178] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-11-03T17:51:05.545281] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-11-03T17:51:05.546191] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-11-03T17:51:05.546486] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-11-03T17:51:05.548316] [DEBUG] [LOCAL ] BXMT: Trimmed 69845 records to 47088 (keeping 200 days of data) [2025-11-03T17:51:05.697137] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-11-03T17:51:05.889594] [DEBUG] [LOCAL ] BXMT: Primary data saved (47088 records). [2025-11-03T17:51:05.889764] [INFO ] [MAIN ] BXMT: Full history saved. [2025-11-03T17:51:05.889857] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXMT took 36.1s. Estimated remaining: 4h 31m 49s. Rate: 7.3 symbols/min [2025-11-03T17:51:06.060145] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:06.100350] [DEBUG] [LOCAL ] BXSL: Loaded 48935 existing records from primary storage. [2025-11-03T17:51:06.100678] [INFO ] [MAIN ] BXSL: Loaded 48935 existing records. [2025-11-03T17:51:06.274747] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:06.274959] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-11-03T17:51:06.275006] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-11-03T17:51:06.275796] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-11-03T17:51:06.275853] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-11-03T17:51:06.344615] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-11-03T17:51:06.634339] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:06.647392] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:51:07.134880] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-11-03T17:51:07.293686] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-11 (2.56 seconds). [2025-11-03T17:51:07.295170] [INFO ] [REMOTE ] BX: Full fetch complete (77611 records). [2025-11-03T17:51:07.295301] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-11-03T17:51:07.680236] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-11-03T17:51:07.680356] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-11-03T17:51:07.681403] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-11-03T17:51:07.681479] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-11-03T17:51:07.683219] [DEBUG] [LOCAL ] BX: Trimmed 77611 records to 53481 (keeping 200 days of data) [2025-11-03T17:51:07.936430] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-11-03T17:51:08.076793] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-11-03T17:51:08.113555] [DEBUG] [LOCAL ] BX: Primary data saved (53481 records). [2025-11-03T17:51:08.113746] [INFO ] [MAIN ] BX: Full history saved. [2025-11-03T17:51:08.114789] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BX took 56.6s. Estimated remaining: 4h 31m 10s. Rate: 7.3 symbols/min [2025-11-03T17:51:08.317020] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:08.340237] [DEBUG] [LOCAL ] BY: Loaded 21720 existing records from primary storage. [2025-11-03T17:51:08.340554] [INFO ] [MAIN ] BY: Loaded 21720 existing records. [2025-11-03T17:51:08.540464] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:08.545973] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-11-03T17:51:08.560602] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-11-03T17:51:08.563188] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T17:51:08.563365] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-11-03T17:51:08.572600] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-11-03T17:51:08.688367] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-11-03T17:51:08.736469] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-11-03T17:51:08.944150] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:09.534868] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-11-03T17:51:09.583820] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T17:51:10.334899] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-11-03T17:51:10.750454] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:51:11.134876] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-11-03T17:51:11.477375] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T17:51:11.899101] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T17:51:11.934811] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-11. [2025-11-03T17:51:12.734895] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-11-03T17:51:13.028517] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-11 (1.09 seconds). [2025-11-03T17:51:13.029494] [INFO ] [REMOTE ] BXMX: Full fetch complete (28604 records). [2025-11-03T17:51:13.029565] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-11-03T17:51:13.549069] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-11-03T17:51:13.574058] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-11-03T17:51:13.574199] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-11-03T17:51:13.575272] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-11-03T17:51:13.575367] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-11-03T17:51:13.576849] [DEBUG] [LOCAL ] BXMX: Trimmed 28604 records to 18657 (keeping 200 days of data) [2025-11-03T17:51:13.737844] [DEBUG] [LOCAL ] BXMX: Primary data saved (18657 records). [2025-11-03T17:51:13.738032] [INFO ] [MAIN ] BXMX: Full history saved. [2025-11-03T17:51:13.738169] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXMX took 22.8s. Estimated remaining: 4h 30m 48s. Rate: 7.3 symbols/min [2025-11-03T17:51:13.959980] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:14.019966] [DEBUG] [LOCAL ] BYD: Loaded 45604 existing records from primary storage. [2025-11-03T17:51:14.020473] [INFO ] [MAIN ] BYD: Loaded 45604 existing records. [2025-11-03T17:51:14.270090] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:14.270423] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-11-03T17:51:14.270544] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-11-03T17:51:14.271365] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-11-03T17:51:14.271427] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-11-03T17:51:14.340793] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-11-03T17:51:14.560234] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-11-03T17:51:14.622772] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T17:51:14.708467] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:15.134896] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-11-03T17:51:15.635893] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T17:51:15.934917] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-11-03T17:51:16.503548] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T17:51:16.534673] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-11-03T17:51:16.734865] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-11-03T17:51:17.442339] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T17:51:17.534869] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-11-03T17:51:18.334862] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-11-03T17:51:19.066261] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T17:51:19.134851] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-11-03T17:51:19.513596] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:51:19.934841] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-11-03T17:51:20.568090] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-11-03T17:51:20.734841] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-11-03T17:51:20.945707] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T17:51:21.534869] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-11-03T17:51:22.300848] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T17:51:22.334827] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-11-03T17:51:22.858182] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T17:51:23.129506] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-11-03T17:51:23.135138] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-11-03T17:51:23.934839] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-11-03T17:51:24.655404] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T17:51:24.730836] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T17:51:24.736513] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-11-03T17:51:25.534891] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-11. [2025-11-03T17:51:25.982955] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T17:51:26.334900] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-11-03T17:51:27.134834] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-11-03T17:51:27.202908] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T17:51:27.420585] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T17:51:27.422157] [INFO ] [REMOTE ] BXP: Full fetch complete (72318 records). [2025-11-03T17:51:27.422270] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-11-03T17:51:27.828074] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-11-03T17:51:27.828162] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-11-03T17:51:27.829073] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-11-03T17:51:27.829150] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-11-03T17:51:27.830542] [DEBUG] [LOCAL ] BXP: Trimmed 72318 records to 49729 (keeping 200 days of data) [2025-11-03T17:51:27.935712] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-11-03T17:51:28.160272] [DEBUG] [LOCAL ] BXP: Primary data saved (49729 records). [2025-11-03T17:51:28.160421] [INFO ] [MAIN ] BXP: Full history saved. [2025-11-03T17:51:28.161075] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BXP took 32.8s. Estimated remaining: 4h 31m 13s. Rate: 7.3 symbols/min [2025-11-03T17:51:28.333343] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:28.364610] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:51:28.379001] [DEBUG] [LOCAL ] BYM: Loaded 11399 existing records from primary storage. [2025-11-03T17:51:28.379212] [INFO ] [MAIN ] BYM: Loaded 11399 existing records. [2025-11-03T17:51:28.564733] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:28.564969] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-11-03T17:51:28.565016] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-11-03T17:51:28.565312] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-11-03T17:51:28.565368] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-11-03T17:51:28.738817] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-11-03T17:51:28.844142] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T17:51:28.949799] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:29.534855] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-11-03T17:51:30.019030] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T17:51:30.334848] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-11-03T17:51:30.344029] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T17:51:30.918577] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-11-03T17:51:31.134861] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-11-03T17:51:31.726325] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T17:51:31.934854] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-11-03T17:51:32.698263] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T17:51:32.734840] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-11-03T17:51:33.508633] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T17:51:33.534839] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-11. [2025-11-03T17:51:34.334873] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-11-03T17:51:34.521417] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T17:51:34.522607] [INFO ] [REMOTE ] BY: Full fetch complete (29897 records). [2025-11-03T17:51:34.522710] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-11-03T17:51:34.914313] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-11-03T17:51:34.914417] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-11-03T17:51:34.914911] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-11-03T17:51:34.914974] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-11-03T17:51:34.915855] [DEBUG] [LOCAL ] BY: Trimmed 29897 records to 21260 (keeping 200 days of data) [2025-11-03T17:51:35.042621] [DEBUG] [LOCAL ] BY: Primary data saved (21260 records). [2025-11-03T17:51:35.042800] [INFO ] [MAIN ] BY: Full history saved. [2025-11-03T17:51:35.042899] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BY took 26.9s. Estimated remaining: 4h 30m 58s. Rate: 7.3 symbols/min [2025-11-03T17:51:35.140425] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-11-03T17:51:35.226001] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:35.257516] [DEBUG] [LOCAL ] BZH: Loaded 31912 existing records from primary storage. [2025-11-03T17:51:35.257837] [INFO ] [MAIN ] BZH: Loaded 31912 existing records. [2025-11-03T17:51:35.455081] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:35.455402] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-11-03T17:51:35.455453] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-11-03T17:51:35.456008] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-11-03T17:51:35.456067] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-11-03T17:51:35.850799] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:35.862066] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T17:51:35.894835] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-11-03T17:51:35.934822] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-11-03T17:51:36.734864] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-11-03T17:51:36.866100] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T17:51:37.534845] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-11-03T17:51:37.785527] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T17:51:38.121972] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T17:51:38.334864] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-11-03T17:51:39.134917] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-11-03T17:51:39.594839] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T17:51:39.934905] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-11-03T17:51:40.153558] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T17:51:40.734860] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-11-03T17:51:41.234630] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T17:51:41.488013] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T17:51:41.534867] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-11-03T17:51:42.072984] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T17:51:42.334863] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-11-03T17:51:43.134860] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-11-03T17:51:43.735308] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T17:51:43.771919] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T17:51:43.934830] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-11-03T17:51:44.734855] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-11-03T17:51:45.117433] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T17:51:45.535038] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-11-03T17:51:45.953930] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T17:51:46.334846] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-11-03T17:51:47.004197] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T17:51:47.134829] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-11-03T17:51:47.496377] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T17:51:47.934856] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-11-03T17:51:48.694789] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T17:51:48.734828] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-11-03T17:51:49.261265] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T17:51:49.300828] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T17:51:49.534821] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-11-03T17:51:50.334878] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-11-03T17:51:50.715934] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T17:51:50.887562] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-11-03T17:51:51.134882] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-11-03T17:51:51.846708] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T17:51:51.934833] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-11. [2025-11-03T17:51:52.734877] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-11. [2025-11-03T17:51:52.840180] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T17:51:52.840996] [INFO ] [REMOTE ] BYM: Full fetch complete (17303 records). [2025-11-03T17:51:52.841063] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-11-03T17:51:53.242913] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-11-03T17:51:53.243004] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-11-03T17:51:53.243391] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-11-03T17:51:53.243433] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-11-03T17:51:53.244260] [DEBUG] [LOCAL ] BYM: Trimmed 17303 records to 11300 (keeping 200 days of data) [2025-11-03T17:51:53.314042] [DEBUG] [LOCAL ] BYM: Primary data saved (11300 records). [2025-11-03T17:51:53.314200] [INFO ] [MAIN ] BYM: Full history saved. [2025-11-03T17:51:53.314287] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BYM took 25.2s. Estimated remaining: 4h 31m 43s. Rate: 7.3 symbols/min [2025-11-03T17:51:53.490905] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:53.538157] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-11-03T17:51:53.539814] [DEBUG] [LOCAL ] C: Loaded 54521 existing records from primary storage. [2025-11-03T17:51:53.541038] [INFO ] [MAIN ] C: Loaded 54521 existing records. [2025-11-03T17:51:53.724691] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:53.724899] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-11-03T17:51:53.724946] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-11-03T17:51:53.725870] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-11-03T17:51:53.725927] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-11-03T17:51:54.089530] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:54.334896] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-11-03T17:51:54.626806] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T17:51:54.718275] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T17:51:54.719854] [INFO ] [REMOTE ] BXSL: Full fetch complete (70340 records). [2025-11-03T17:51:54.719956] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-11-03T17:51:55.132581] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-11-03T17:51:55.132691] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-11-03T17:51:55.133437] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-11-03T17:51:55.133479] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-11-03T17:51:55.134817] [DEBUG] [LOCAL ] BXSL: Trimmed 70340 records to 48213 (keeping 200 days of data) [2025-11-03T17:51:55.134940] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-11-03T17:51:55.421509] [DEBUG] [LOCAL ] BXSL: Primary data saved (48213 records). [2025-11-03T17:51:55.421633] [INFO ] [MAIN ] BXSL: Full history saved. [2025-11-03T17:51:55.421746] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. BXSL took 49.5s. Estimated remaining: 4h 31m 2s. Rate: 7.3 symbols/min [2025-11-03T17:51:55.600477] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:55.618826] [DEBUG] [LOCAL ] CAAP: Loaded 20166 existing records from primary storage. [2025-11-03T17:51:55.619065] [INFO ] [MAIN ] CAAP: Loaded 20166 existing records. [2025-11-03T17:51:55.802565] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:55.802960] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-11-03T17:51:55.803110] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-11-03T17:51:55.803515] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-11-03T17:51:55.803573] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-11-03T17:51:55.943956] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-11. [2025-11-03T17:51:56.175546] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:56.205328] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-11-03T17:51:56.234931] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T17:51:56.734892] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-11-03T17:51:57.534827] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-11-03T17:51:57.660538] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T17:51:58.029344] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-11 (2.09 seconds). [2025-11-03T17:51:58.030751] [INFO ] [REMOTE ] BYD: Full fetch complete (65670 records). [2025-11-03T17:51:58.030842] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-11-03T17:51:58.339944] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-11-03T17:51:58.425029] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-11-03T17:51:58.425109] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-11-03T17:51:58.425919] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-11-03T17:51:58.425986] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-11-03T17:51:58.427376] [DEBUG] [LOCAL ] BYD: Trimmed 65670 records to 45108 (keeping 200 days of data) [2025-11-03T17:51:58.669316] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-11-03T17:51:58.729691] [DEBUG] [LOCAL ] BYD: Primary data saved (45108 records). [2025-11-03T17:51:58.729818] [INFO ] [MAIN ] BYD: Full history saved. [2025-11-03T17:51:58.730460] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. BYD took 45.0s. Estimated remaining: 4h 30m 29s. Rate: 7.3 symbols/min [2025-11-03T17:51:58.907026] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:51:58.924605] [DEBUG] [LOCAL ] CABO: Loaded 16608 existing records from primary storage. [2025-11-03T17:51:58.924866] [INFO ] [MAIN ] CABO: Loaded 16608 existing records. [2025-11-03T17:51:59.116682] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:51:59.116876] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-11-03T17:51:59.116958] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-11-03T17:51:59.117346] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-11-03T17:51:59.117405] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-11-03T17:51:59.139943] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-11-03T17:51:59.501405] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:51:59.909435] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-11-03T17:51:59.934893] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-11-03T17:52:00.058576] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T17:52:00.734869] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-11-03T17:52:01.361483] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T17:52:01.534859] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-11-03T17:52:01.679940] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-11-03T17:52:02.334840] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-11-03T17:52:02.538182] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-11-03T17:52:03.134828] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-11-03T17:52:03.164843] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T17:52:03.672900] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-11-03T17:52:03.934842] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-11-03T17:52:04.601713] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T17:52:04.734888] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-11-03T17:52:05.534900] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-11-03T17:52:06.334966] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-11-03T17:52:06.473341] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T17:52:06.710023] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-11-03T17:52:07.134829] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-11-03T17:52:07.179073] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T17:52:07.820203] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T17:52:07.934880] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-11. [2025-11-03T17:52:08.734909] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-11-03T17:52:09.443163] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T17:52:09.444314] [INFO ] [REMOTE ] BZH: Full fetch complete (47003 records). [2025-11-03T17:52:09.444412] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-11-03T17:52:09.540115] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-11-03T17:52:09.852965] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-11-03T17:52:09.853043] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-11-03T17:52:09.853614] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-11-03T17:52:09.853680] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-11-03T17:52:09.854636] [DEBUG] [LOCAL ] BZH: Trimmed 47003 records to 31369 (keeping 200 days of data) [2025-11-03T17:52:10.046619] [DEBUG] [LOCAL ] BZH: Primary data saved (31369 records). [2025-11-03T17:52:10.046777] [INFO ] [MAIN ] BZH: Full history saved. [2025-11-03T17:52:10.047705] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. BZH took 35.0s. Estimated remaining: 4h 30m 37s. Rate: 7.3 symbols/min [2025-11-03T17:52:10.213131] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:10.233720] [DEBUG] [LOCAL ] CACI: Loaded 22036 existing records from primary storage. [2025-11-03T17:52:10.233962] [INFO ] [MAIN ] CACI: Loaded 22036 existing records. [2025-11-03T17:52:10.339081] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-11-03T17:52:10.421819] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:10.422452] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-11-03T17:52:10.430224] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-11-03T17:52:10.431205] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-11-03T17:52:10.431756] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-11-03T17:52:10.431545] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T17:52:10.824143] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:52:10.852566] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-11-03T17:52:11.134863] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-11-03T17:52:11.263573] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T17:52:11.934841] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-11-03T17:52:12.111029] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T17:52:12.734892] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-11-03T17:52:13.480138] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T17:52:13.504376] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T17:52:13.534846] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-11-03T17:52:14.212203] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T17:52:14.334898] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-11-03T17:52:15.134873] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-11-03T17:52:15.381514] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T17:52:15.934880] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-11-03T17:52:16.042574] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T17:52:16.734872] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-11-03T17:52:17.378896] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-11-03T17:52:17.534938] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-11-03T17:52:18.039772] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-11-03T17:52:18.338286] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-11-03T17:52:18.340335] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T17:52:19.134904] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-11-03T17:52:19.922348] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-11-03T17:52:19.934798] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-11-03T17:52:19.954757] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T17:52:20.734907] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-11-03T17:52:21.489045] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-11-03T17:52:21.542110] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-11-03T17:52:21.548179] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T17:52:22.168348] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T17:52:22.334870] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-11-03T17:52:23.134844] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-11-03T17:52:23.683460] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T17:52:23.934903] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-11. [2025-11-03T17:52:24.139614] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-11-03T17:52:24.734868] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-11-03T17:52:24.862431] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T17:52:24.863396] [INFO ] [REMOTE ] CABO: Full fetch complete (23115 records). [2025-11-03T17:52:24.863466] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-11-03T17:52:25.256749] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-11-03T17:52:25.256832] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-11-03T17:52:25.257279] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-11-03T17:52:25.257341] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-11-03T17:52:25.258019] [DEBUG] [LOCAL ] CABO: Trimmed 23115 records to 16526 (keeping 200 days of data) [2025-11-03T17:52:25.355868] [DEBUG] [LOCAL ] CABO: Primary data saved (16526 records). [2025-11-03T17:52:25.356001] [INFO ] [MAIN ] CABO: Full history saved. [2025-11-03T17:52:25.356078] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. CABO took 26.6s. Estimated remaining: 4h 31m 6s. Rate: 7.3 symbols/min [2025-11-03T17:52:25.529269] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:25.534931] [INFO ] [REMOTE ] C: Fetching primary data for 2025-11. [2025-11-03T17:52:25.575423] [DEBUG] [LOCAL ] CADE: Loaded 50533 existing records from primary storage. [2025-11-03T17:52:25.575769] [INFO ] [MAIN ] CADE: Loaded 50533 existing records. [2025-11-03T17:52:25.710683] [DEBUG] [REMOTE ] C: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:52:25.738433] [WARN ] [REMOTE ] C: No data returned for month 2025-11 [2025-11-03T17:52:25.766468] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:25.767323] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-11-03T17:52:25.767207] [FATAL] [REMOTE ] C: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:52:25.767441] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-11-03T17:52:25.767544] [FATAL] [MAIN ] C: Failed to fetch primary data. [2025-11-03T17:52:25.767765] [WARN ] [MAIN ] C: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:52:25.767832] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-11-03T17:52:25.767906] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-11-03T17:52:25.767959] [INFO ] [LOCAL ] C: Starting deletion of derivative data. [2025-11-03T17:52:25.768205] [DEBUG] [LOCAL ] C: Deleted derivative data file. [2025-11-03T17:52:25.768626] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. C took 32.5s. Estimated remaining: 4h 30m 17s. Rate: 7.3 symbols/min [2025-11-03T17:52:25.768727] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-11-03T17:52:25.804472] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-11-03T17:52:26.082785] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:26.286082] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-11-03T17:52:26.341218] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-11-03T17:52:26.380442] [DEBUG] [LOCAL ] CAE: Loaded 39199 existing records from primary storage. [2025-11-03T17:52:26.401596] [INFO ] [MAIN ] CAE: Loaded 39199 existing records. [2025-11-03T17:52:26.454955] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:52:26.615159] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:26.615369] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-11-03T17:52:26.615418] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-11-03T17:52:26.616009] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-11-03T17:52:26.616067] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-11-03T17:52:26.986414] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:52:27.134878] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-11-03T17:52:27.563049] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T17:52:27.934860] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-11-03T17:52:28.302010] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T17:52:28.734855] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-11-03T17:52:29.201042] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T17:52:29.534815] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-11-03T17:52:29.696032] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T17:52:30.334858] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-11-03T17:52:30.664090] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T17:52:31.134852] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-11-03T17:52:31.404280] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-11-03T17:52:31.934838] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-11-03T17:52:32.058824] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T17:52:32.734843] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-11-03T17:52:32.794428] [DEBUG] [REMOTE ] CAE: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-11-03T17:52:32.794962] [WARN ] [REMOTE ] CAE: No data returned for month 2025-04 [2025-11-03T17:52:32.795069] [FATAL] [REMOTE ] CAE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:52:32.795204] [FATAL] [MAIN ] CAE: Failed to fetch primary data. [2025-11-03T17:52:32.795301] [WARN ] [MAIN ] CAE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:52:32.795443] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-11-03T17:52:32.795534] [DEBUG] [LOCAL ] CAE: No primary data file found to delete. [2025-11-03T17:52:32.795576] [INFO ] [LOCAL ] CAE: Starting deletion of derivative data. [2025-11-03T17:52:32.796020] [DEBUG] [LOCAL ] CAE: Deleted derivative data file. [2025-11-03T17:52:32.796286] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CAE took 7.0s. Estimated remaining: 4h 30m 3s. Rate: 7.3 symbols/min [2025-11-03T17:52:32.966448] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:32.971863] [DEBUG] [LOCAL ] CAF: Loaded 3392 existing records from primary storage. [2025-11-03T17:52:32.972033] [INFO ] [MAIN ] CAF: Loaded 3392 existing records. [2025-11-03T17:52:33.151225] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:33.151547] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-11-03T17:52:33.151727] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-11-03T17:52:33.151971] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-11-03T17:52:33.152084] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-11-03T17:52:33.313943] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T17:52:33.542740] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:52:33.542853] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-11. [2025-11-03T17:52:34.334850] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-11-03T17:52:34.817864] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T17:52:34.818999] [INFO ] [REMOTE ] CAAP: Full fetch complete (28433 records). [2025-11-03T17:52:34.819086] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-11-03T17:52:35.140093] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-11-03T17:52:35.163382] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T17:52:35.249137] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-11-03T17:52:35.249209] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-11-03T17:52:35.249695] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-11-03T17:52:35.249767] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-11-03T17:52:35.250602] [DEBUG] [LOCAL ] CAAP: Trimmed 28433 records to 19900 (keeping 200 days of data) [2025-11-03T17:52:35.366012] [DEBUG] [LOCAL ] CAAP: Primary data saved (19900 records). [2025-11-03T17:52:35.366209] [INFO ] [MAIN ] CAAP: Full history saved. [2025-11-03T17:52:35.366291] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CAAP took 39.9s. Estimated remaining: 4h 29m 26s. Rate: 7.3 symbols/min [2025-11-03T17:52:35.530979] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:35.579239] [DEBUG] [LOCAL ] CAG: Loaded 54446 existing records from primary storage. [2025-11-03T17:52:35.579578] [INFO ] [MAIN ] CAG: Loaded 54446 existing records. [2025-11-03T17:52:35.754424] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:35.754697] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-11-03T17:52:35.754755] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-11-03T17:52:35.755755] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-11-03T17:52:35.755817] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-11-03T17:52:35.939991] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-11-03T17:52:36.101756] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:52:36.418612] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-11-03T17:52:36.607071] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T17:52:36.734849] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-11-03T17:52:37.534855] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-11-03T17:52:37.980470] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T17:52:38.334830] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-11-03T17:52:38.833090] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T17:52:39.134855] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-11-03T17:52:39.608517] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T17:52:39.934862] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-11-03T17:52:40.224025] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T17:52:40.292154] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-11-03T17:52:40.734887] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-11-03T17:52:41.530804] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T17:52:41.535240] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-11-03T17:52:42.021210] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T17:52:42.334873] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-11-03T17:52:43.134860] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-11-03T17:52:43.646747] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T17:52:43.894922] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T17:52:43.934828] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-11-03T17:52:44.734821] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-11-03T17:52:44.802738] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T17:52:45.534859] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-11-03T17:52:45.878983] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T17:52:46.144709] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T17:52:46.334830] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-11-03T17:52:47.134914] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-11-03T17:52:47.607697] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T17:52:47.836712] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T17:52:47.934855] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-11-03T17:52:48.734922] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-11-03T17:52:49.274234] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T17:52:49.534902] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-11-03T17:52:49.551164] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-11-03T17:52:49.871921] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-11-03T17:52:50.334874] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-11-03T17:52:51.134864] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-11-03T17:52:51.888897] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-11-03T17:52:51.934809] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-11-03T17:52:52.385230] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T17:52:52.734861] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-11-03T17:52:53.066452] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-11-03T17:52:53.262418] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:52:53.534909] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-11. [2025-11-03T17:52:54.334873] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-11-03T17:52:54.658063] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-11-03T17:52:54.744228] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-11 (1.21 seconds). [2025-11-03T17:52:54.745413] [INFO ] [REMOTE ] CACI: Full fetch complete (38216 records). [2025-11-03T17:52:54.745491] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-11-03T17:52:55.109137] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-11-03T17:52:55.109218] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-11-03T17:52:55.109766] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-11-03T17:52:55.109828] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-11-03T17:52:55.110701] [DEBUG] [LOCAL ] CACI: Trimmed 38216 records to 21711 (keeping 200 days of data) [2025-11-03T17:52:55.159383] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-11-03T17:52:55.242832] [DEBUG] [LOCAL ] CACI: Primary data saved (21711 records). [2025-11-03T17:52:55.242956] [INFO ] [MAIN ] CACI: Full history saved. [2025-11-03T17:52:55.243034] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CACI took 45.2s. Estimated remaining: 4h 30m 18s. Rate: 7.3 symbols/min [2025-11-03T17:52:55.417589] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:55.466126] [DEBUG] [LOCAL ] CAH: Loaded 52124 existing records from primary storage. [2025-11-03T17:52:55.466414] [INFO ] [MAIN ] CAH: Loaded 52124 existing records. [2025-11-03T17:52:55.649877] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T17:52:55.649300] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:55.653137] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-11-03T17:52:55.653236] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-11-03T17:52:55.654550] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-11-03T17:52:55.654615] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-11-03T17:52:55.940007] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-11-03T17:52:56.029036] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:52:56.573242] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T17:52:56.734855] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-11-03T17:52:57.534874] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-11-03T17:52:58.038166] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T17:52:58.334864] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-11. [2025-11-03T17:52:58.921616] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T17:52:58.946324] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-11 (0.61 seconds). [2025-11-03T17:52:58.947399] [INFO ] [REMOTE ] CAF: Full fetch complete (5541 records). [2025-11-03T17:52:58.947502] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-11-03T17:52:59.141273] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-11-03T17:52:59.342213] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-11-03T17:52:59.342295] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-11-03T17:52:59.342472] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-11-03T17:52:59.342510] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-11-03T17:52:59.342913] [DEBUG] [LOCAL ] CAF: Trimmed 5541 records to 3303 (keeping 200 days of data) [2025-11-03T17:52:59.362239] [DEBUG] [LOCAL ] CAF: Primary data saved (3303 records). [2025-11-03T17:52:59.362341] [INFO ] [MAIN ] CAF: Full history saved. [2025-11-03T17:52:59.362415] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CAF took 26.6s. Estimated remaining: 4h 29m 49s. Rate: 7.3 symbols/min [2025-11-03T17:52:59.531249] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:52:59.570331] [DEBUG] [LOCAL ] CAL: Loaded 43118 existing records from primary storage. [2025-11-03T17:52:59.570695] [INFO ] [MAIN ] CAL: Loaded 43118 existing records. [2025-11-03T17:52:59.756491] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:52:59.756759] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-11-03T17:52:59.756813] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-11-03T17:52:59.757529] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-11-03T17:52:59.757588] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-11-03T17:52:59.940292] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-11-03T17:53:00.154203] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:00.679881] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T17:53:00.734854] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-11-03T17:53:01.487624] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-11-03T17:53:01.534876] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-11-03T17:53:02.334818] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-11-03T17:53:02.605141] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-11-03T17:53:02.714573] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T17:53:03.134880] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-11-03T17:53:03.779392] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T17:53:03.934861] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-11-03T17:53:04.526883] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:53:04.734925] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-11-03T17:53:05.033397] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T17:53:05.534878] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-11-03T17:53:06.179970] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T17:53:06.334886] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-11-03T17:53:06.634256] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T17:53:07.134886] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-11-03T17:53:07.934879] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-11-03T17:53:08.081120] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T17:53:08.546285] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T17:53:08.734871] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-11-03T17:53:09.254339] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T17:53:09.534904] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-11-03T17:53:10.002335] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T17:53:10.334892] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-11. [2025-11-03T17:53:10.978184] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T17:53:11.134863] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-11-03T17:53:11.934894] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-11. [2025-11-03T17:53:12.305471] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-11 (1.97 seconds). [2025-11-03T17:53:12.307392] [INFO ] [REMOTE ] CADE: Full fetch complete (70984 records). [2025-11-03T17:53:12.307538] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-11-03T17:53:12.711521] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-11-03T17:53:12.711628] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-11-03T17:53:12.712526] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-11-03T17:53:12.712601] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-11-03T17:53:12.729457] [DEBUG] [LOCAL ] CADE: Trimmed 70984 records to 49844 (keeping 200 days of data) [2025-11-03T17:53:12.737093] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-11-03T17:53:12.742889] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T17:53:13.054445] [DEBUG] [LOCAL ] CADE: Primary data saved (49844 records). [2025-11-03T17:53:13.054628] [INFO ] [MAIN ] CADE: Full history saved. [2025-11-03T17:53:13.055497] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CADE took 47.7s. Estimated remaining: 4h 30m 9s. Rate: 7.3 symbols/min [2025-11-03T17:53:13.198153] [DEBUG] [REMOTE ] CAG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:53:13.226181] [WARN ] [REMOTE ] CAG: No data returned for month 2025-11 [2025-11-03T17:53:13.229161] [FATAL] [REMOTE ] CAG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:53:13.229113] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:53:13.229285] [FATAL] [MAIN ] CAG: Failed to fetch primary data. [2025-11-03T17:53:13.229712] [WARN ] [MAIN ] CAG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:53:13.229801] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-11-03T17:53:13.229989] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-11-03T17:53:13.230050] [INFO ] [LOCAL ] CAG: Starting deletion of derivative data. [2025-11-03T17:53:13.230221] [DEBUG] [LOCAL ] CAG: Deleted derivative data file. [2025-11-03T17:53:13.230304] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAG took 37.9s. Estimated remaining: 4h 29m 20s. Rate: 7.3 symbols/min [2025-11-03T17:53:13.419803] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:53:13.432708] [DEBUG] [LOCAL ] CALX: Loaded 37586 existing records from primary storage. [2025-11-03T17:53:13.433155] [INFO ] [MAIN ] CALX: Loaded 37586 existing records. [2025-11-03T17:53:13.535111] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-11-03T17:53:13.606616] [DEBUG] [LOCAL ] CANG: Loaded 27517 existing records from primary storage. [2025-11-03T17:53:13.616554] [INFO ] [MAIN ] CANG: Loaded 27517 existing records. [2025-11-03T17:53:13.637746] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:53:13.686816] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-11-03T17:53:13.717125] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-11-03T17:53:13.749123] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-11-03T17:53:13.751532] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-11-03T17:53:13.942326] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:53:13.982472] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-11-03T17:53:13.987846] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-11-03T17:53:14.033423] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-11-03T17:53:14.033783] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-11-03T17:53:14.385894] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:14.429834] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-11-03T17:53:14.609766] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-11-03T17:53:14.679508] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:14.920072] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T17:53:15.134852] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-11-03T17:53:15.547409] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:53:15.934878] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-11-03T17:53:16.659488] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-11-03T17:53:16.734816] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-11-03T17:53:17.073376] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T17:53:17.534827] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-11-03T17:53:18.134699] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T17:53:18.334897] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-11-03T17:53:18.604776] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T17:53:19.134883] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-11-03T17:53:19.302618] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-11-03T17:53:19.934869] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-11-03T17:53:20.281765] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T17:53:20.735036] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-11-03T17:53:20.734967] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T17:53:21.534890] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-11-03T17:53:22.226387] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T17:53:22.334813] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-11-03T17:53:23.134844] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-11-03T17:53:23.364673] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-11-03T17:53:23.489040] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T17:53:23.829762] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T17:53:23.934859] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-11. [2025-11-03T17:53:24.734889] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-11-03T17:53:25.170336] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-11 (1.24 seconds). [2025-11-03T17:53:25.171871] [INFO ] [REMOTE ] CAH: Full fetch complete (74905 records). [2025-11-03T17:53:25.171968] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-11-03T17:53:25.545084] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-11-03T17:53:25.569442] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-11-03T17:53:25.574738] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-11-03T17:53:25.580400] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-11-03T17:53:25.591622] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-11-03T17:53:25.596816] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-11-03T17:53:25.603341] [DEBUG] [LOCAL ] CAH: Trimmed 74905 records to 51368 (keeping 200 days of data) [2025-11-03T17:53:25.928133] [DEBUG] [LOCAL ] CAH: Primary data saved (51368 records). [2025-11-03T17:53:25.928271] [INFO ] [MAIN ] CAH: Full history saved. [2025-11-03T17:53:25.928350] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAH took 30.7s. Estimated remaining: 4h 29m 35s. Rate: 7.3 symbols/min [2025-11-03T17:53:26.107576] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:53:26.107795] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-11-03T17:53:26.107840] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-11-03T17:53:26.107954] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-11-03T17:53:26.107995] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-11-03T17:53:26.108038] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-11-03T17:53:26.108070] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-11-03T17:53:26.344195] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-11-03T17:53:26.471326] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:26.701330] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T17:53:27.134892] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-11-03T17:53:27.260735] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T17:53:27.934911] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-11-03T17:53:28.229124] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T17:53:28.561047] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-11-03T17:53:28.734896] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-11-03T17:53:29.149587] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T17:53:29.534863] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-11-03T17:53:30.079396] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-11-03T17:53:30.334889] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-11-03T17:53:31.134872] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-11-03T17:53:31.775635] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T17:53:31.934833] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-11. [2025-11-03T17:53:32.084130] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T17:53:32.734830] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-11-03T17:53:33.534857] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-11-03T17:53:33.603084] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T17:53:33.604572] [INFO ] [REMOTE ] CAL: Full fetch complete (62121 records). [2025-11-03T17:53:33.604675] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-11-03T17:53:34.005174] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-11-03T17:53:34.005270] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-11-03T17:53:34.006101] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-11-03T17:53:34.006181] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-11-03T17:53:34.025854] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T17:53:34.033455] [DEBUG] [LOCAL ] CAL: Trimmed 62121 records to 42490 (keeping 200 days of data) [2025-11-03T17:53:34.283052] [DEBUG] [LOCAL ] CAL: Primary data saved (42490 records). [2025-11-03T17:53:34.283175] [INFO ] [MAIN ] CAL: Full history saved. [2025-11-03T17:53:34.283870] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CAL took 34.9s. Estimated remaining: 4h 29m 27s. Rate: 7.3 symbols/min [2025-11-03T17:53:34.349851] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-11-03T17:53:34.460832] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:53:34.509596] [DEBUG] [LOCAL ] CARR: Loaded 54381 existing records from primary storage. [2025-11-03T17:53:34.510127] [INFO ] [MAIN ] CARR: Loaded 54381 existing records. [2025-11-03T17:53:34.690901] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:53:34.691207] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-11-03T17:53:34.691293] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-11-03T17:53:34.698795] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-11-03T17:53:34.711084] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-11-03T17:53:34.757429] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T17:53:34.872915] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-11-03T17:53:35.092051] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:35.134852] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-11-03T17:53:35.934824] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-11-03T17:53:36.031957] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T17:53:36.411392] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T17:53:36.734873] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-11-03T17:53:37.534835] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-11-03T17:53:37.692277] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T17:53:38.334853] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-11-03T17:53:38.836871] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-11-03T17:53:39.121808] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-11-03T17:53:39.134806] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-11-03T17:53:39.934857] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-11-03T17:53:40.352799] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T17:53:40.734858] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-11-03T17:53:40.877961] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T17:53:41.110839] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-11-03T17:53:41.534845] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-11-03T17:53:42.334826] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-11-03T17:53:42.543020] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T17:53:42.807384] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-11-03T17:53:43.134898] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-11-03T17:53:43.934883] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-11. [2025-11-03T17:53:44.474892] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T17:53:44.734835] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-11-03T17:53:45.283391] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T17:53:45.284984] [INFO ] [REMOTE ] CANG: Full fetch complete (39201 records). [2025-11-03T17:53:45.285094] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-11-03T17:53:45.540025] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-11-03T17:53:45.735153] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-11-03T17:53:45.735234] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-11-03T17:53:45.735846] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-11-03T17:53:45.735912] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-11-03T17:53:45.736786] [DEBUG] [LOCAL ] CANG: Trimmed 39201 records to 27445 (keeping 200 days of data) [2025-11-03T17:53:45.880460] [DEBUG] [LOCAL ] CANG: Primary data saved (27445 records). [2025-11-03T17:53:45.880590] [INFO ] [MAIN ] CANG: Full history saved. [2025-11-03T17:53:45.880689] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CANG took 32.7s. Estimated remaining: 4h 29m 36s. Rate: 7.3 symbols/min [2025-11-03T17:53:46.049860] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:53:46.072907] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-11-03T17:53:46.089826] [DEBUG] [LOCAL ] CARS: Loaded 40020 existing records from primary storage. [2025-11-03T17:53:46.090105] [INFO ] [MAIN ] CARS: Loaded 40020 existing records. [2025-11-03T17:53:46.297555] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:53:46.297942] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-11-03T17:53:46.298045] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-11-03T17:53:46.299143] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-11-03T17:53:46.299211] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-11-03T17:53:46.336753] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-11-03T17:53:46.700430] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-11-03T17:53:46.746799] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:47.134865] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-11-03T17:53:47.796881] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T17:53:47.934861] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-11-03T17:53:48.624625] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T17:53:48.734803] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-11-03T17:53:48.947848] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T17:53:49.534868] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-11-03T17:53:50.220836] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T17:53:50.334883] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-11-03T17:53:50.624483] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T17:53:51.134897] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-11-03T17:53:51.939986] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-11-03T17:53:51.954470] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-11-03T17:53:52.170937] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T17:53:52.734853] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-11-03T17:53:53.008867] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T17:53:53.534816] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-11. [2025-11-03T17:53:53.721976] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T17:53:54.334854] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-11-03T17:53:55.005558] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-11 (1.47 seconds). [2025-11-03T17:53:55.006959] [INFO ] [REMOTE ] CALX: Full fetch complete (54541 records). [2025-11-03T17:53:55.007057] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-11-03T17:53:55.135855] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-11-03T17:53:55.465472] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-11-03T17:53:55.465570] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-11-03T17:53:55.466306] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-11-03T17:53:55.466427] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-11-03T17:53:55.467753] [DEBUG] [LOCAL ] CALX: Trimmed 54541 records to 37093 (keeping 200 days of data) [2025-11-03T17:53:55.700372] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-11-03T17:53:55.702399] [DEBUG] [LOCAL ] CALX: Primary data saved (37093 records). [2025-11-03T17:53:55.703577] [INFO ] [MAIN ] CALX: Full history saved. [2025-11-03T17:53:55.704491] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CALX took 42.6s. Estimated remaining: 4h 29m 36s. Rate: 7.3 symbols/min [2025-11-03T17:53:55.841824] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-11-03T17:53:55.918500] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:53:55.945790] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-11-03T17:53:55.967772] [DEBUG] [LOCAL ] CAT: Loaded 53679 existing records from primary storage. [2025-11-03T17:53:55.968078] [INFO ] [MAIN ] CAT: Loaded 53679 existing records. [2025-11-03T17:53:56.139601] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:53:56.139841] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-11-03T17:53:56.139893] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-11-03T17:53:56.140825] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-11-03T17:53:56.140883] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-11-03T17:53:56.559765] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:53:56.734840] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-11-03T17:53:57.138530] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T17:53:57.534838] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-11-03T17:53:58.152060] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T17:53:58.334885] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-11-03T17:53:58.705679] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T17:53:59.134854] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-11-03T17:53:59.877674] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T17:53:59.934814] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-11-03T17:54:00.734851] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-11-03T17:54:01.050435] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-11-03T17:54:01.534890] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-11. [2025-11-03T17:54:01.580248] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-11-03T17:54:01.888262] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T17:54:02.287820] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-11 (0.75 seconds). [2025-11-03T17:54:02.289384] [INFO ] [REMOTE ] CAPL: Full fetch complete (8787 records). [2025-11-03T17:54:02.289491] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-11-03T17:54:02.340122] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-11. [2025-11-03T17:54:02.839444] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-11-03T17:54:02.839537] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-11-03T17:54:02.839915] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-11-03T17:54:02.839981] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-11-03T17:54:02.840696] [DEBUG] [LOCAL ] CAPL: Trimmed 8787 records to 5344 (keeping 200 days of data) [2025-11-03T17:54:02.894326] [DEBUG] [LOCAL ] CAPL: Primary data saved (5344 records). [2025-11-03T17:54:02.894515] [INFO ] [MAIN ] CAPL: Full history saved. [2025-11-03T17:54:02.894627] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CAPL took 37.0s. Estimated remaining: 4h 29m 23s. Rate: 7.3 symbols/min [2025-11-03T17:54:03.140011] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-11-03T17:54:03.146087] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:03.158408] [DEBUG] [LOCAL ] CATO: Loaded 6705 existing records from primary storage. [2025-11-03T17:54:03.158743] [INFO ] [MAIN ] CATO: Loaded 6705 existing records. [2025-11-03T17:54:03.441538] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:54:03.441816] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-11-03T17:54:03.441867] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-11-03T17:54:03.442075] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-11-03T17:54:03.442117] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-11-03T17:54:03.801085] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:03.934874] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-11-03T17:54:04.386312] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T17:54:04.626839] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T17:54:04.734790] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-11-03T17:54:04.798048] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-11 (2.46 seconds). [2025-11-03T17:54:04.800123] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-11-03T17:54:04.800336] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-11-03T17:54:05.220017] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-11-03T17:54:05.220388] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-11-03T17:54:05.221393] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-11-03T17:54:05.220313] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T17:54:05.221571] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-11-03T17:54:05.225728] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 53604 (keeping 200 days of data) [2025-11-03T17:54:05.536823] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-11-03T17:54:05.547381] [DEBUG] [LOCAL ] CARR: Primary data saved (53604 records). [2025-11-03T17:54:05.547592] [INFO ] [MAIN ] CARR: Full history saved. [2025-11-03T17:54:05.548408] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CARR took 31.3s. Estimated remaining: 4h 28m 47s. Rate: 7.3 symbols/min [2025-11-03T17:54:05.721278] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:05.771125] [DEBUG] [LOCAL ] CAVA: Loaded 54312 existing records from primary storage. [2025-11-03T17:54:05.771420] [INFO ] [MAIN ] CAVA: Loaded 54312 existing records. [2025-11-03T17:54:05.956504] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:54:05.956726] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-11-03T17:54:05.956781] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-11-03T17:54:05.957618] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-11-03T17:54:05.957713] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-11-03T17:54:06.305878] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:06.334922] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-11-03T17:54:06.595686] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T17:54:06.914978] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T17:54:07.134865] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-11-03T17:54:07.934881] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-11-03T17:54:08.404538] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-11-03T17:54:08.744575] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-11-03T17:54:08.768952] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-11-03T17:54:09.534858] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-11-03T17:54:09.901391] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T17:54:09.994136] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-11-03T17:54:10.334920] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-11-03T17:54:11.134868] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-11-03T17:54:11.583182] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-11-03T17:54:11.934845] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-11-03T17:54:12.094261] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-11-03T17:54:12.466843] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-11-03T17:54:12.734907] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-11-03T17:54:13.534853] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-11-03T17:54:14.314439] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T17:54:14.334830] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-11-03T17:54:15.134858] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-11-03T17:54:15.185663] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-11-03T17:54:15.844886] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T17:54:15.934873] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-11-03T17:54:15.977457] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-11-03T17:54:16.551164] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T17:54:16.734869] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-11-03T17:54:17.534884] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-11-03T17:54:17.798144] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T17:54:18.334870] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-11-03T17:54:19.134860] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-11-03T17:54:19.456780] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-11-03T17:54:19.792416] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-11-03T17:54:19.934839] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-11. [2025-11-03T17:54:20.739964] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-11-03T17:54:20.756412] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-11-03T17:54:21.214298] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-11-03T17:54:21.534886] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-11-03T17:54:21.751888] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-11 (1.82 seconds). [2025-11-03T17:54:21.753920] [INFO ] [REMOTE ] CARS: Full fetch complete (56913 records). [2025-11-03T17:54:21.754182] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-11-03T17:54:22.151001] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-11-03T17:54:22.151083] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-11-03T17:54:22.151776] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-11-03T17:54:22.151842] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-11-03T17:54:22.153031] [DEBUG] [LOCAL ] CARS: Trimmed 56913 records to 39327 (keeping 200 days of data) [2025-11-03T17:54:22.347115] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-11. [2025-11-03T17:54:22.380889] [DEBUG] [LOCAL ] CARS: Primary data saved (39327 records). [2025-11-03T17:54:22.381033] [INFO ] [MAIN ] CARS: Full history saved. [2025-11-03T17:54:22.381113] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CARS took 36.5s. Estimated remaining: 4h 29m 22s. Rate: 7.3 symbols/min [2025-11-03T17:54:23.094712] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-11 (0.75 seconds). [2025-11-03T17:54:23.095392] [INFO ] [REMOTE ] CATO: Full fetch complete (10581 records). [2025-11-03T17:54:23.095459] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-11-03T17:54:23.148143] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-11-03T17:54:23.513853] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-11-03T17:54:23.514050] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-11-03T17:54:23.514412] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-11-03T17:54:23.514487] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-11-03T17:54:23.515206] [DEBUG] [LOCAL ] CATO: Trimmed 10581 records to 6554 (keeping 200 days of data) [2025-11-03T17:54:23.552484] [DEBUG] [LOCAL ] CATO: Primary data saved (6554 records). [2025-11-03T17:54:23.552640] [INFO ] [MAIN ] CATO: Full history saved. [2025-11-03T17:54:23.552844] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CATO took 20.7s. Estimated remaining: 4h 28m 39s. Rate: 7.3 symbols/min [2025-11-03T17:54:23.585211] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-11-03T17:54:23.934868] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-11-03T17:54:24.944274] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-11-03T17:54:24.956314] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-11-03T17:54:25.832929] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-11-03T17:54:25.844020] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-11-03T17:54:26.860285] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-11-03T17:54:26.873205] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-11-03T17:54:27.378726] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-11-03T17:54:27.389827] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-11-03T17:54:28.456534] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T17:54:28.468312] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-11-03T17:54:29.252610] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-11-03T17:54:29.264608] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-11-03T17:54:30.275439] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-11-03T17:54:30.293623] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-11. [2025-11-03T17:54:30.951431] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-11-03T17:54:30.962823] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-11-03T17:54:31.706010] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T17:54:31.707540] [INFO ] [REMOTE ] CAT: Full fetch complete (76872 records). [2025-11-03T17:54:31.707638] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-11-03T17:54:32.115398] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-11-03T17:54:32.115482] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-11-03T17:54:32.116310] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-11-03T17:54:32.116375] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-11-03T17:54:32.117832] [DEBUG] [LOCAL ] CAT: Trimmed 76872 records to 52904 (keeping 200 days of data) [2025-11-03T17:54:32.448719] [DEBUG] [LOCAL ] CAT: Primary data saved (52904 records). [2025-11-03T17:54:32.448919] [INFO ] [MAIN ] CAT: Full history saved. [2025-11-03T17:54:32.449821] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CAT took 36.7s. Estimated remaining: 4h 28m 34s. Rate: 7.3 symbols/min [2025-11-03T17:54:32.482756] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-11-03T17:54:32.494407] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-11-03T17:54:34.268051] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-11-03T17:54:34.280355] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-11. [2025-11-03T17:54:36.782312] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-11 (2.50 seconds). [2025-11-03T17:54:36.784265] [INFO ] [REMOTE ] CAVA: Full fetch complete (77520 records). [2025-11-03T17:54:36.784455] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-11-03T17:54:37.215808] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-11-03T17:54:37.215912] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-11-03T17:54:37.216865] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-11-03T17:54:37.216986] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-11-03T17:54:37.218704] [DEBUG] [LOCAL ] CAVA: Trimmed 77520 records to 53544 (keeping 200 days of data) [2025-11-03T17:54:37.548592] [DEBUG] [LOCAL ] CAVA: Primary data saved (53544 records). [2025-11-03T17:54:37.548765] [INFO ] [MAIN ] CAVA: Full history saved. [2025-11-03T17:54:37.548859] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CAVA took 32.0s. Estimated remaining: 4h 28m 11s. Rate: 7.3 symbols/min [2025-11-03T17:54:38.046453] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:38.052435] [DEBUG] [LOCAL ] CBNA: No existing data file found in primary storage. [2025-11-03T17:54:38.104592] [WARN ] [MAIN ] CBNA: No existing data found, performing full refresh instead. [2025-11-03T17:54:38.204342] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:38.203369] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-11-03T17:54:38.251668] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:38.253275] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:38.253424] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-11-03T17:54:38.254592] [DEBUG] [LOCAL ] CBNA: No primary data file found to delete. [2025-11-03T17:54:38.255506] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-11-03T17:54:38.380519] [DEBUG] [LOCAL ] CBAN: Loaded 10075 existing records from primary storage. [2025-11-03T17:54:38.381629] [INFO ] [MAIN ] CBAN: Loaded 10075 existing records. [2025-11-03T17:54:38.381159] [DEBUG] [LOCAL ] CBL: Loaded 15678 existing records from primary storage. [2025-11-03T17:54:38.387134] [INFO ] [MAIN ] CBL: Loaded 15678 existing records. [2025-11-03T17:54:38.757887] [DEBUG] [LOCAL ] CB: Loaded 50639 existing records from primary storage. [2025-11-03T17:54:38.811393] [INFO ] [MAIN ] CB: Loaded 50639 existing records. [2025-11-03T17:54:39.064437] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:39.129939] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-11-03T17:54:39.139681] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:54:39.135629] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:54:39.159515] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-11-03T17:54:39.159748] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-11-03T17:54:39.159805] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-11-03T17:54:39.181011] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-11-03T17:54:39.208970] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-11-03T17:54:39.234671] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-11-03T17:54:39.234900] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-11-03T17:54:39.234985] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-11-03T17:54:39.244481] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:54:39.287288] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-11-03T17:54:39.296840] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-11-03T17:54:39.358521] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-11-03T17:54:39.363808] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-11-03T17:54:39.801964] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-11-03T17:54:39.837810] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-11-03T17:54:40.203760] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:40.239072] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-11-03T17:54:40.333850] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:40.355735] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:40.356432] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-11-03T17:54:40.357100] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-11-03T17:54:40.390912] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-11-03T17:54:40.392355] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-11-03T17:54:40.677278] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-11-03T17:54:40.678472] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-11-03T17:54:40.971085] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-11-03T17:54:40.972785] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-11-03T17:54:41.068497] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T17:54:41.071593] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-11-03T17:54:41.132758] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-11-03T17:54:41.137165] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-11-03T17:54:41.351230] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-11-03T17:54:41.353631] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-11-03T17:54:41.612249] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-11-03T17:54:41.615543] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-11-03T17:54:41.726328] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-11-03T17:54:41.809110] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T17:54:41.891771] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-11-03T17:54:42.287771] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T17:54:42.334818] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-11-03T17:54:42.657692] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-11-03T17:54:43.134914] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-11-03T17:54:43.868253] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T17:54:43.934897] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-11-03T17:54:44.734860] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-11-03T17:54:44.816762] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-11-03T17:54:45.534898] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-11-03T17:54:45.924936] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T17:54:45.955447] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T17:54:46.334850] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-11-03T17:54:47.005195] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T17:54:47.134889] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-11-03T17:54:47.787547] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T17:54:47.934847] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-11-03T17:54:48.270967] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-11-03T17:54:48.734904] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-11-03T17:54:49.378049] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-11-03T17:54:49.534916] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-11-03T17:54:49.962304] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-11-03T17:54:50.334945] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-11-03T17:54:50.873907] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T17:54:51.134840] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-11-03T17:54:51.934882] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-11-03T17:54:51.953299] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T17:54:52.541615] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-11-03T17:54:52.734890] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-11-03T17:54:53.409836] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T17:54:53.534889] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-11-03T17:54:54.262049] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T17:54:54.334944] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-11-03T17:54:54.994000] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T17:54:55.134878] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-11. [2025-11-03T17:54:55.639969] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T17:54:55.640583] [INFO ] [REMOTE ] CBNA: Full fetch complete (4087 records). [2025-11-03T17:54:55.640672] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-11-03T17:54:55.940825] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-11-03T17:54:56.009638] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-11-03T17:54:56.009750] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-11-03T17:54:56.009875] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-11-03T17:54:56.009915] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-11-03T17:54:56.010253] [DEBUG] [LOCAL ] CBNA: Trimmed 4087 records to 2696 (keeping 200 days of data) [2025-11-03T17:54:56.026079] [DEBUG] [LOCAL ] CBNA: Primary data saved (2696 records). [2025-11-03T17:54:56.026175] [INFO ] [MAIN ] CBNA: Full history saved. [2025-11-03T17:54:56.026240] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBNA took 18.5s. Estimated remaining: 4h 28m 53s. Rate: 7.3 symbols/min [2025-11-03T17:54:56.203460] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:56.203666] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-11-03T17:54:56.203721] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-11-03T17:54:56.203861] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-11-03T17:54:56.203902] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-11-03T17:54:56.203986] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-11-03T17:54:56.204035] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-11-03T17:54:56.559781] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:56.734902] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-11-03T17:54:57.480511] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T17:54:57.504213] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T17:54:57.534823] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-11. [2025-11-03T17:54:58.334860] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-11-03T17:54:58.403424] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T17:54:58.404284] [INFO ] [REMOTE ] CBL: Full fetch complete (24166 records). [2025-11-03T17:54:58.404357] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-11-03T17:54:58.788337] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-11-03T17:54:58.788470] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-11-03T17:54:58.788918] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-11-03T17:54:58.788982] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-11-03T17:54:58.789802] [DEBUG] [LOCAL ] CBL: Trimmed 24166 records to 15410 (keeping 200 days of data) [2025-11-03T17:54:58.881847] [DEBUG] [LOCAL ] CBL: Primary data saved (15410 records). [2025-11-03T17:54:58.881992] [INFO ] [MAIN ] CBL: Full history saved. [2025-11-03T17:54:58.882072] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBL took 21.3s. Estimated remaining: 4h 28m 19s. Rate: 7.3 symbols/min [2025-11-03T17:54:59.047128] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:54:59.047292] [DEBUG] [LOCAL ] CBRE: No existing data file found in primary storage. [2025-11-03T17:54:59.047328] [WARN ] [MAIN ] CBRE: No existing data found, performing full refresh instead. [2025-11-03T17:54:59.047438] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-11-03T17:54:59.047478] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-11-03T17:54:59.047519] [DEBUG] [LOCAL ] CBRE: No primary data file found to delete. [2025-11-03T17:54:59.047551] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-11-03T17:54:59.143607] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-11-03T17:54:59.412163] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:54:59.742881] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T17:54:59.894232] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T17:54:59.934821] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-11-03T17:55:00.734862] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-11-03T17:55:01.364924] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T17:55:01.534902] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-11-03T17:55:02.155387] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:55:02.155734] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-11-03T17:55:02.155822] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:55:02.155872] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-11-03T17:55:02.155931] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:55:02.156020] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-11-03T17:55:02.156082] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-11-03T17:55:02.156120] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-11-03T17:55:02.156159] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-11-03T17:55:02.156205] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBO took 6.1s. Estimated remaining: 4h 27m 46s. Rate: 7.3 symbols/min [2025-11-03T17:55:02.348727] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-11-03T17:55:02.386896] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-11-03T17:55:02.384076] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:02.436096] [DEBUG] [LOCAL ] CBT: Loaded 30966 existing records from primary storage. [2025-11-03T17:55:02.436396] [INFO ] [MAIN ] CBT: Loaded 30966 existing records. [2025-11-03T17:55:02.628569] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:02.628817] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-11-03T17:55:02.628871] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-11-03T17:55:02.629444] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-11-03T17:55:02.629505] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-11-03T17:55:02.995979] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:03.134844] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-11-03T17:55:03.379702] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T17:55:03.934872] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-11-03T17:55:04.555960] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T17:55:04.734908] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-11-03T17:55:04.984373] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-11-03T17:55:05.534872] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-11-03T17:55:06.334864] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-11-03T17:55:06.778596] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T17:55:07.088366] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-11-03T17:55:07.134815] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-11-03T17:55:07.386261] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T17:55:07.934866] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-11-03T17:55:08.621625] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T17:55:08.734854] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-11. [2025-11-03T17:55:08.916726] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T17:55:09.534861] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-11-03T17:55:09.610272] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T17:55:09.611128] [INFO ] [REMOTE ] CBAN: Full fetch complete (16326 records). [2025-11-03T17:55:09.611198] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-11-03T17:55:10.021608] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-11-03T17:55:10.021754] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-11-03T17:55:10.022103] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-11-03T17:55:10.022144] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-11-03T17:55:10.022765] [DEBUG] [LOCAL ] CBAN: Trimmed 16326 records to 9885 (keeping 200 days of data) [2025-11-03T17:55:10.079950] [DEBUG] [LOCAL ] CBAN: Primary data saved (9885 records). [2025-11-03T17:55:10.080068] [INFO ] [MAIN ] CBAN: Full history saved. [2025-11-03T17:55:10.080147] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBAN took 32.5s. Estimated remaining: 4h 27m 37s. Rate: 7.3 symbols/min [2025-11-03T17:55:10.245447] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:10.264265] [DEBUG] [LOCAL ] CBU: Loaded 22520 existing records from primary storage. [2025-11-03T17:55:10.264479] [INFO ] [MAIN ] CBU: Loaded 22520 existing records. [2025-11-03T17:55:10.340046] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-11-03T17:55:10.440277] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:10.440509] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-11-03T17:55:10.440555] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-11-03T17:55:10.441084] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-11-03T17:55:10.441143] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-11-03T17:55:10.799591] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:10.818170] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T17:55:11.134848] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-11-03T17:55:11.934892] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-11-03T17:55:11.980230] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-11-03T17:55:12.157942] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T17:55:12.734852] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-11-03T17:55:12.834016] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T17:55:13.534878] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-11-03T17:55:14.107535] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T17:55:14.334878] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-11-03T17:55:14.849989] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T17:55:15.134834] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-11-03T17:55:15.939608] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-11-03T17:55:15.945066] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-11-03T17:55:16.147940] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T17:55:16.734915] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-11-03T17:55:17.287683] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T17:55:17.534882] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-11. [2025-11-03T17:55:17.704127] [DEBUG] [REMOTE ] CB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:55:17.705049] [WARN ] [REMOTE ] CB: No data returned for month 2025-11 [2025-11-03T17:55:17.705703] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T17:55:17.705818] [FATAL] [REMOTE ] CB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:55:17.706051] [FATAL] [MAIN ] CB: Failed to fetch primary data. [2025-11-03T17:55:17.712276] [WARN ] [MAIN ] CB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:55:17.712474] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-11-03T17:55:17.712587] [DEBUG] [LOCAL ] CB: No primary data file found to delete. [2025-11-03T17:55:17.712969] [INFO ] [LOCAL ] CB: Starting deletion of derivative data. [2025-11-03T17:55:17.713150] [DEBUG] [LOCAL ] CB: Deleted derivative data file. [2025-11-03T17:55:17.713241] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CB took 40.2s. Estimated remaining: 4h 27m 26s. Rate: 7.3 symbols/min [2025-11-03T17:55:17.877569] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:17.877771] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-11-03T17:55:17.877815] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-11-03T17:55:17.877929] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-11-03T17:55:17.877970] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-11-03T17:55:17.878009] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-11-03T17:55:17.878041] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-11-03T17:55:18.302611] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:18.334834] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-11-03T17:55:19.134851] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-11-03T17:55:19.607348] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T17:55:19.934823] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-11-03T17:55:20.107708] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:55:20.120502] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-11-03T17:55:20.120371] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T17:55:20.120794] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:55:20.127281] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-11-03T17:55:20.127353] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:55:20.127754] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-11-03T17:55:20.127866] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-11-03T17:55:20.127948] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-11-03T17:55:20.128038] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-11-03T17:55:20.128105] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBX took 2.4s. Estimated remaining: 4h 26m 50s. Rate: 7.3 symbols/min [2025-11-03T17:55:20.343436] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:20.377664] [DEBUG] [LOCAL ] CBZ: Loaded 34990 existing records from primary storage. [2025-11-03T17:55:20.378027] [INFO ] [MAIN ] CBZ: Loaded 34990 existing records. [2025-11-03T17:55:20.563830] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:20.564065] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-11-03T17:55:20.564111] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-11-03T17:55:20.564698] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-11-03T17:55:20.564755] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-11-03T17:55:20.735830] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-11-03T17:55:20.918028] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:21.534853] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-11-03T17:55:21.970430] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:55:22.334892] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-11-03T17:55:22.429746] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T17:55:23.134842] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-11-03T17:55:23.293347] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T17:55:23.934848] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-11-03T17:55:24.449118] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T17:55:24.734834] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-11-03T17:55:24.787547] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T17:55:25.534880] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-11-03T17:55:25.553251] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T17:55:26.312856] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-11-03T17:55:26.334820] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-11-03T17:55:27.134882] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-11-03T17:55:27.612292] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T17:55:27.930081] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T17:55:27.935664] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-11-03T17:55:28.734926] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-11-03T17:55:29.043616] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T17:55:29.534867] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-11-03T17:55:29.619810] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-11-03T17:55:30.334901] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-11-03T17:55:30.854338] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T17:55:31.134845] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-11-03T17:55:31.439030] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T17:55:31.934829] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-11-03T17:55:32.592195] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-11-03T17:55:32.676131] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T17:55:32.734824] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-11-03T17:55:33.534840] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-11-03T17:55:33.734182] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T17:55:34.334873] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-11-03T17:55:34.453740] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T17:55:35.134881] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-11-03T17:55:35.224183] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T17:55:35.934879] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-11. [2025-11-03T17:55:36.244896] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:55:36.705191] [DEBUG] [REMOTE ] CBT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:55:36.705520] [WARN ] [REMOTE ] CBT: No data returned for month 2025-11 [2025-11-03T17:55:36.705609] [FATAL] [REMOTE ] CBT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:55:36.705726] [FATAL] [MAIN ] CBT: Failed to fetch primary data. [2025-11-03T17:55:36.705806] [WARN ] [MAIN ] CBT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:55:36.705877] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-11-03T17:55:36.705939] [DEBUG] [LOCAL ] CBT: No primary data file found to delete. [2025-11-03T17:55:36.705981] [INFO ] [LOCAL ] CBT: Starting deletion of derivative data. [2025-11-03T17:55:36.706114] [DEBUG] [LOCAL ] CBT: Deleted derivative data file. [2025-11-03T17:55:36.706177] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBT took 34.5s. Estimated remaining: 4h 27m 22s. Rate: 7.3 symbols/min [2025-11-03T17:55:36.738139] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-11. [2025-11-03T17:55:36.879470] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:36.930961] [DEBUG] [LOCAL ] CC: Loaded 53720 existing records from primary storage. [2025-11-03T17:55:36.931309] [INFO ] [MAIN ] CC: Loaded 53720 existing records. [2025-11-03T17:55:37.109723] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:37.109936] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-11-03T17:55:37.110011] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-11-03T17:55:37.111046] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-11-03T17:55:37.111102] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-11-03T17:55:37.460712] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:37.534855] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-11-03T17:55:38.334874] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-11-03T17:55:38.690024] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-11 (1.95 seconds). [2025-11-03T17:55:38.691524] [INFO ] [REMOTE ] CBRE: Full fetch complete (73677 records). [2025-11-03T17:55:38.691640] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-11-03T17:55:39.107925] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-11-03T17:55:39.108051] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-11-03T17:55:39.108888] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-11-03T17:55:39.109044] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-11-03T17:55:39.135844] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-11-03T17:55:39.120029] [DEBUG] [LOCAL ] CBRE: Trimmed 73677 records to 50209 (keeping 200 days of data) [2025-11-03T17:55:39.139687] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-11-03T17:55:39.379327] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:55:39.478012] [DEBUG] [LOCAL ] CBRE: Primary data saved (50209 records). [2025-11-03T17:55:39.478135] [INFO ] [MAIN ] CBRE: Full history saved. [2025-11-03T17:55:39.478205] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CBRE took 40.6s. Estimated remaining: 4h 26m 48s. Rate: 7.3 symbols/min [2025-11-03T17:55:39.643126] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:39.689583] [DEBUG] [LOCAL ] CCI: Loaded 53876 existing records from primary storage. [2025-11-03T17:55:39.689907] [INFO ] [MAIN ] CCI: Loaded 53876 existing records. [2025-11-03T17:55:39.863766] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:39.863963] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-11-03T17:55:39.864012] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-11-03T17:55:39.864869] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-11-03T17:55:39.864925] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-11-03T17:55:39.940043] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-11-03T17:55:40.224987] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:40.244712] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T17:55:40.734847] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-11-03T17:55:41.239173] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:55:41.534853] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-11-03T17:55:42.336759] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-11-03T17:55:42.352882] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-11-03T17:55:42.918933] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T17:55:43.134922] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-11-03T17:55:43.599271] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T17:55:43.934903] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-11-03T17:55:44.550407] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T17:55:44.734881] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-11-03T17:55:45.299693] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T17:55:45.534895] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-11-03T17:55:46.339224] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-11-03T17:55:46.348581] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-11-03T17:55:46.784285] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-11-03T17:55:47.134900] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-11-03T17:55:47.714638] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T17:55:47.934885] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-11-03T17:55:48.744626] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-11. [2025-11-03T17:55:48.747432] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T17:55:49.315760] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T17:55:49.534855] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-11-03T17:55:50.148634] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T17:55:50.150711] [INFO ] [REMOTE ] CBZ: Full fetch complete (47284 records). [2025-11-03T17:55:50.150858] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-11-03T17:55:50.349558] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-11-03T17:55:50.567700] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-11-03T17:55:50.567810] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-11-03T17:55:50.568498] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-11-03T17:55:50.568569] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-11-03T17:55:50.584851] [DEBUG] [LOCAL ] CBZ: Trimmed 47284 records to 34394 (keeping 200 days of data) [2025-11-03T17:55:50.585422] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T17:55:50.788268] [DEBUG] [LOCAL ] CBZ: Primary data saved (34394 records). [2025-11-03T17:55:50.788423] [INFO ] [MAIN ] CBZ: Full history saved. [2025-11-03T17:55:50.788506] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CBZ took 30.7s. Estimated remaining: 4h 26m 55s. Rate: 7.3 symbols/min [2025-11-03T17:55:50.960693] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:50.975062] [DEBUG] [LOCAL ] CCIF: Loaded 15303 existing records from primary storage. [2025-11-03T17:55:50.975293] [INFO ] [MAIN ] CCIF: Loaded 15303 existing records. [2025-11-03T17:55:51.140045] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-11-03T17:55:51.153195] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:51.154266] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-11-03T17:55:51.154317] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-11-03T17:55:51.154727] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-11-03T17:55:51.154786] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-11-03T17:55:51.521332] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:51.937421] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-11-03T17:55:51.941033] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T17:55:51.981102] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T17:55:52.734866] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-11-03T17:55:52.762604] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T17:55:53.523547] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:55:53.534825] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-11. [2025-11-03T17:55:54.334890] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-11-03T17:55:54.718823] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-11 (1.18 seconds). [2025-11-03T17:55:54.719864] [INFO ] [REMOTE ] CBU: Full fetch complete (32655 records). [2025-11-03T17:55:54.719944] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-11-03T17:55:55.080870] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T17:55:55.112875] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-11-03T17:55:55.112985] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-11-03T17:55:55.113508] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-11-03T17:55:55.113552] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-11-03T17:55:55.114409] [DEBUG] [LOCAL ] CBU: Trimmed 32655 records to 22239 (keeping 200 days of data) [2025-11-03T17:55:55.165778] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-11-03T17:55:55.250222] [DEBUG] [LOCAL ] CBU: Primary data saved (22239 records). [2025-11-03T17:55:55.250353] [INFO ] [MAIN ] CBU: Full history saved. [2025-11-03T17:55:55.250429] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CBU took 45.2s. Estimated remaining: 4h 26m 29s. Rate: 7.3 symbols/min [2025-11-03T17:55:55.418127] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:55:55.465854] [DEBUG] [LOCAL ] CCJ: Loaded 54471 existing records from primary storage. [2025-11-03T17:55:55.466180] [INFO ] [MAIN ] CCJ: Loaded 54471 existing records. [2025-11-03T17:55:55.642728] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:55:55.642967] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-11-03T17:55:55.643066] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-11-03T17:55:55.643853] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-11-03T17:55:55.643911] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-11-03T17:55:55.940897] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-11-03T17:55:55.965814] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-11-03T17:55:56.052104] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:55:56.734883] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-11-03T17:55:57.372184] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T17:55:57.534853] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-11-03T17:55:58.334830] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-11-03T17:55:58.445400] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-11-03T17:55:59.012468] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T17:55:59.106409] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T17:55:59.134817] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-11-03T17:55:59.934857] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-11-03T17:56:00.734853] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-11-03T17:56:01.107708] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-11-03T17:56:01.534917] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-11-03T17:56:01.895970] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-11-03T17:56:02.334861] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-11-03T17:56:02.585473] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-11-03T17:56:03.140134] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-11-03T17:56:03.152268] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-11-03T17:56:03.625386] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T17:56:03.849423] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T17:56:03.934859] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-11-03T17:56:04.734861] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-11-03T17:56:05.385216] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T17:56:05.534890] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-11-03T17:56:05.966351] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T17:56:06.170222] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T17:56:06.334857] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-11-03T17:56:07.140410] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-11-03T17:56:07.142211] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-11-03T17:56:07.934902] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-11-03T17:56:08.601115] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-11-03T17:56:08.655305] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-11-03T17:56:08.734848] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-11-03T17:56:09.534859] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-11. [2025-11-03T17:56:10.225377] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T17:56:10.334929] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-11-03T17:56:11.134899] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-11-03T17:56:11.664287] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-11 (2.13 seconds). [2025-11-03T17:56:11.666856] [INFO ] [REMOTE ] CC: Full fetch complete (76263 records). [2025-11-03T17:56:11.667071] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-11-03T17:56:11.898854] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T17:56:11.941056] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-11. [2025-11-03T17:56:12.131023] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-11-03T17:56:12.131133] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-11-03T17:56:12.132011] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-11-03T17:56:12.132194] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-11-03T17:56:12.133880] [DEBUG] [LOCAL ] CC: Trimmed 76263 records to 52977 (keeping 200 days of data) [2025-11-03T17:56:12.391161] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-11-03T17:56:12.500959] [DEBUG] [LOCAL ] CC: Primary data saved (52977 records). [2025-11-03T17:56:12.501102] [INFO ] [MAIN ] CC: Full history saved. [2025-11-03T17:56:12.501939] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CC took 35.8s. Estimated remaining: 4h 27m 4s. Rate: 7.3 symbols/min [2025-11-03T17:56:12.680532] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:12.722557] [DEBUG] [LOCAL ] CCK: Loaded 47149 existing records from primary storage. [2025-11-03T17:56:12.722887] [INFO ] [MAIN ] CCK: Loaded 47149 existing records. [2025-11-03T17:56:12.744267] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-11-03T17:56:12.905662] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:56:12.905875] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-11-03T17:56:12.905922] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-11-03T17:56:12.906704] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-11-03T17:56:12.906761] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-11-03T17:56:13.021971] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-11 (1.08 seconds). [2025-11-03T17:56:13.028461] [INFO ] [REMOTE ] CCIF: Full fetch complete (21801 records). [2025-11-03T17:56:13.038793] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-11-03T17:56:13.545099] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:13.545161] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-11-03T17:56:13.657582] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-11-03T17:56:13.657678] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-11-03T17:56:13.658024] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-11-03T17:56:13.658063] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-11-03T17:56:13.658633] [DEBUG] [LOCAL ] CCIF: Trimmed 21801 records to 14981 (keeping 200 days of data) [2025-11-03T17:56:13.741607] [DEBUG] [LOCAL ] CCIF: Primary data saved (14981 records). [2025-11-03T17:56:13.741758] [INFO ] [MAIN ] CCIF: Full history saved. [2025-11-03T17:56:13.741838] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCIF took 23.0s. Estimated remaining: 4h 26m 23s. Rate: 7.3 symbols/min [2025-11-03T17:56:13.908895] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:13.956757] [DEBUG] [LOCAL ] CCL: Loaded 54580 existing records from primary storage. [2025-11-03T17:56:13.957109] [INFO ] [MAIN ] CCL: Loaded 54580 existing records. [2025-11-03T17:56:14.135737] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:56:14.135930] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-11-03T17:56:14.135980] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-11-03T17:56:14.136835] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-11-03T17:56:14.136892] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-11-03T17:56:14.347193] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-11-03T17:56:14.500177] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:14.533317] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-11-03T17:56:15.121468] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-11-03T17:56:15.134817] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-11-03T17:56:15.900726] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T17:56:15.934848] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-11-03T17:56:16.734876] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-11-03T17:56:17.100471] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-11-03T17:56:17.140854] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T17:56:17.534920] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-11-03T17:56:18.334874] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-11-03T17:56:18.601184] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-11-03T17:56:19.134873] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-11-03T17:56:19.223010] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T17:56:19.558390] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T17:56:19.934862] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-11-03T17:56:20.734874] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-11. [2025-11-03T17:56:21.050312] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-11-03T17:56:21.347526] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T17:56:21.534843] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-11-03T17:56:22.049190] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T17:56:22.050708] [INFO ] [REMOTE ] CCI: Full fetch complete (77094 records). [2025-11-03T17:56:22.050807] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-11-03T17:56:22.342893] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-11-03T17:56:22.442044] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-11-03T17:56:22.442127] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-11-03T17:56:22.442939] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-11-03T17:56:22.443002] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-11-03T17:56:22.444372] [DEBUG] [LOCAL ] CCI: Trimmed 77094 records to 53094 (keeping 200 days of data) [2025-11-03T17:56:22.785794] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T17:56:22.807129] [DEBUG] [LOCAL ] CCI: Primary data saved (53094 records). [2025-11-03T17:56:22.807241] [INFO ] [MAIN ] CCI: Full history saved. [2025-11-03T17:56:22.807947] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCI took 43.3s. Estimated remaining: 4h 26m 19s. Rate: 7.3 symbols/min [2025-11-03T17:56:22.975015] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:23.019235] [DEBUG] [LOCAL ] CCO: Loaded 49436 existing records from primary storage. [2025-11-03T17:56:23.019528] [INFO ] [MAIN ] CCO: Loaded 49436 existing records. [2025-11-03T17:56:23.139909] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-11-03T17:56:23.204230] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:56:23.204465] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-11-03T17:56:23.204548] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-11-03T17:56:23.205421] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-11-03T17:56:23.205481] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-11-03T17:56:23.586844] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:23.934884] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-11-03T17:56:24.508498] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-11-03T17:56:24.734839] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-11-03T17:56:25.036237] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-11-03T17:56:25.130673] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T17:56:25.534869] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-11-03T17:56:26.334853] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-11-03T17:56:26.576323] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:56:26.753547] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-11-03T17:56:27.134858] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-11-03T17:56:27.518452] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T17:56:27.934901] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-11-03T17:56:28.734862] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-11-03T17:56:29.080493] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T17:56:29.306114] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-11-03T17:56:29.534870] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-11-03T17:56:30.334941] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-11-03T17:56:30.399961] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-11-03T17:56:31.095682] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-11-03T17:56:31.134868] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-11-03T17:56:31.527226] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T17:56:31.934882] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-11-03T17:56:32.734962] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-11-03T17:56:33.004291] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-11-03T17:56:33.346454] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T17:56:33.534851] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-11-03T17:56:33.936849] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T17:56:34.334876] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-11-03T17:56:34.968305] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T17:56:35.134897] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-11. [2025-11-03T17:56:35.820696] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T17:56:35.934856] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-11-03T17:56:36.734833] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-11-03T17:56:37.217905] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-11 (2.08 seconds). [2025-11-03T17:56:37.219587] [INFO ] [REMOTE ] CCK: Full fetch complete (68151 records). [2025-11-03T17:56:37.219940] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-11-03T17:56:37.349377] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T17:56:37.540012] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-11-03T17:56:37.654879] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-11-03T17:56:37.654967] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-11-03T17:56:37.655759] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-11-03T17:56:37.655824] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-11-03T17:56:37.657190] [DEBUG] [LOCAL ] CCK: Trimmed 68151 records to 46541 (keeping 200 days of data) [2025-11-03T17:56:37.940705] [DEBUG] [LOCAL ] CCK: Primary data saved (46541 records). [2025-11-03T17:56:37.940856] [INFO ] [MAIN ] CCK: Full history saved. [2025-11-03T17:56:37.941964] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCK took 25.4s. Estimated remaining: 4h 26m 43s. Rate: 7.3 symbols/min [2025-11-03T17:56:38.112789] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:38.142046] [DEBUG] [LOCAL ] CCS: Loaded 30157 existing records from primary storage. [2025-11-03T17:56:38.142302] [INFO ] [MAIN ] CCS: Loaded 30157 existing records. [2025-11-03T17:56:38.318434] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:56:38.318686] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-11-03T17:56:38.318744] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-11-03T17:56:38.319306] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-11-03T17:56:38.319370] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-11-03T17:56:38.350368] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-11-03T17:56:38.704247] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:38.755789] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-11-03T17:56:39.135336] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-11-03T17:56:39.250330] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-11-03T17:56:39.582605] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T17:56:39.934852] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-11-03T17:56:40.191522] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T17:56:40.734876] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-11-03T17:56:41.534900] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-11-03T17:56:41.633288] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-11-03T17:56:41.901488] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T17:56:42.334950] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-11-03T17:56:42.646030] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T17:56:43.134856] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-11-03T17:56:43.934836] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-11. [2025-11-03T17:56:44.074782] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T17:56:44.134467] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-11-03T17:56:44.734911] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-11-03T17:56:45.484829] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-11 (1.55 seconds). [2025-11-03T17:56:45.486336] [INFO ] [REMOTE ] CCJ: Full fetch complete (77846 records). [2025-11-03T17:56:45.486422] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-11-03T17:56:45.541543] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-11-03T17:56:45.901584] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T17:56:45.930548] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-11-03T17:56:45.930633] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-11-03T17:56:45.931784] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-11-03T17:56:45.931848] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-11-03T17:56:45.933145] [DEBUG] [LOCAL ] CCJ: Trimmed 77846 records to 53694 (keeping 200 days of data) [2025-11-03T17:56:46.262918] [DEBUG] [LOCAL ] CCJ: Primary data saved (53694 records). [2025-11-03T17:56:46.263041] [INFO ] [MAIN ] CCJ: Full history saved. [2025-11-03T17:56:46.263114] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCJ took 51.0s. Estimated remaining: 4h 26m 36s. Rate: 7.3 symbols/min [2025-11-03T17:56:46.339923] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-11-03T17:56:46.432278] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:46.450504] [DEBUG] [LOCAL ] CCU: Loaded 21108 existing records from primary storage. [2025-11-03T17:56:46.450742] [INFO ] [MAIN ] CCU: Loaded 21108 existing records. [2025-11-03T17:56:46.623063] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:56:46.623285] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-11-03T17:56:46.623332] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-11-03T17:56:46.623797] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-11-03T17:56:46.623855] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-11-03T17:56:46.978442] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:47.004151] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T17:56:47.134850] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-11. [2025-11-03T17:56:47.456405] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T17:56:47.934856] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-11-03T17:56:48.646725] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-11-03T17:56:48.734851] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-11-03T17:56:48.912020] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-11 (1.78 seconds). [2025-11-03T17:56:48.913628] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-11-03T17:56:48.913819] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-11-03T17:56:49.301087] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-11-03T17:56:49.301166] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-11-03T17:56:49.301995] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-11-03T17:56:49.302058] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-11-03T17:56:49.303405] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-11-03T17:56:49.534850] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-11-03T17:56:49.618849] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-11-03T17:56:49.619054] [INFO ] [MAIN ] CCL: Full history saved. [2025-11-03T17:56:49.619149] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCL took 35.9s. Estimated remaining: 4h 26m 5s. Rate: 7.3 symbols/min [2025-11-03T17:56:49.810206] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:49.811019] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-11-03T17:56:49.811850] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T17:56:49.814243] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-11-03T17:56:49.819330] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-11-03T17:56:49.819380] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-11-03T17:56:49.819424] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-11-03T17:56:49.819455] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-11-03T17:56:50.167529] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:50.334857] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-11-03T17:56:50.698928] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T17:56:51.134903] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-11-03T17:56:51.195716] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-11-03T17:56:51.934832] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-11-03T17:56:52.407302] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T17:56:52.734886] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-11-03T17:56:52.882851] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T17:56:53.059552] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-11-03T17:56:53.534893] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-11-03T17:56:54.334857] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-11-03T17:56:54.548945] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-11-03T17:56:54.576954] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T17:56:55.134897] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-11-03T17:56:55.805573] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-11-03T17:56:55.934896] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-11. [2025-11-03T17:56:56.734881] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-11-03T17:56:56.907137] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-11-03T17:56:57.534913] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-11-03T17:56:57.764544] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-11-03T17:56:57.902275] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-11 (1.97 seconds). [2025-11-03T17:56:57.903819] [INFO ] [REMOTE ] CCO: Full fetch complete (67737 records). [2025-11-03T17:56:57.903919] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-11-03T17:56:58.310505] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-11-03T17:56:58.310612] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-11-03T17:56:58.311434] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-11-03T17:56:58.311487] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-11-03T17:56:58.312762] [DEBUG] [LOCAL ] CCO: Trimmed 67737 records to 48738 (keeping 200 days of data) [2025-11-03T17:56:58.357489] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-11-03T17:56:58.573521] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-11-03T17:56:58.591759] [DEBUG] [LOCAL ] CCO: Primary data saved (48738 records). [2025-11-03T17:56:58.591922] [INFO ] [MAIN ] CCO: Full history saved. [2025-11-03T17:56:58.592675] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCO took 35.8s. Estimated remaining: 4h 26m 0s. Rate: 7.3 symbols/min [2025-11-03T17:56:58.774457] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:56:58.825571] [DEBUG] [LOCAL ] CDE: Loaded 54424 existing records from primary storage. [2025-11-03T17:56:58.825992] [INFO ] [MAIN ] CDE: Loaded 54424 existing records. [2025-11-03T17:56:59.006695] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:56:59.006902] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-11-03T17:56:59.006975] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-11-03T17:56:59.007776] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-11-03T17:56:59.007834] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-11-03T17:56:59.146566] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-11-03T17:56:59.359814] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:56:59.934846] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-11-03T17:57:00.030401] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T17:57:00.734860] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-11-03T17:57:01.415758] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-11-03T17:57:01.534891] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-11-03T17:57:01.679612] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T17:57:01.710609] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:57:01.711088] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-11-03T17:57:01.711188] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:57:01.711282] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-11-03T17:57:01.711345] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:57:01.711418] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-11-03T17:57:01.711491] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-11-03T17:57:01.711530] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-11-03T17:57:01.711571] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-11-03T17:57:01.711625] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCZ took 12.1s. Estimated remaining: 4h 25m 29s. Rate: 7.3 symbols/min [2025-11-03T17:57:01.953279] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:01.966476] [DEBUG] [LOCAL ] CDLR: Loaded 10375 existing records from primary storage. [2025-11-03T17:57:01.966876] [INFO ] [MAIN ] CDLR: Loaded 10375 existing records. [2025-11-03T17:57:02.169931] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:02.170244] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-11-03T17:57:02.170303] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-11-03T17:57:02.170622] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-11-03T17:57:02.170729] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-11-03T17:57:02.340502] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-11-03T17:57:02.586086] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:03.134868] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-11-03T17:57:03.162955] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T17:57:03.898468] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-11-03T17:57:03.934853] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-11-03T17:57:04.734865] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-11-03T17:57:05.004053] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T17:57:05.534845] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-11-03T17:57:05.563126] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T17:57:06.078155] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-11-03T17:57:06.334885] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-11-03T17:57:07.040361] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T17:57:07.134817] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-11-03T17:57:07.819845] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T17:57:07.934844] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-11. [2025-11-03T17:57:08.734900] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-11-03T17:57:08.893803] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T17:57:08.894773] [INFO ] [REMOTE ] CCU: Full fetch complete (32106 records). [2025-11-03T17:57:08.894848] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-11-03T17:57:09.270215] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-11-03T17:57:09.270297] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-11-03T17:57:09.270783] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-11-03T17:57:09.270844] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-11-03T17:57:09.271678] [DEBUG] [LOCAL ] CCU: Trimmed 32106 records to 20715 (keeping 200 days of data) [2025-11-03T17:57:09.401464] [DEBUG] [LOCAL ] CCU: Primary data saved (20715 records). [2025-11-03T17:57:09.401672] [INFO ] [MAIN ] CCU: Full history saved. [2025-11-03T17:57:09.401765] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCU took 23.1s. Estimated remaining: 4h 25m 18s. Rate: 7.3 symbols/min [2025-11-03T17:57:09.543384] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-11-03T17:57:09.575855] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:09.611664] [DEBUG] [LOCAL ] CDP: Loaded 42808 existing records from primary storage. [2025-11-03T17:57:09.611949] [INFO ] [MAIN ] CDP: Loaded 42808 existing records. [2025-11-03T17:57:09.792553] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:09.792903] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-11-03T17:57:09.793015] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-11-03T17:57:09.798942] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-11-03T17:57:09.808600] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-11-03T17:57:09.892867] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T17:57:10.196921] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:10.334823] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-11-03T17:57:10.955993] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-11-03T17:57:11.134869] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-11-03T17:57:11.453770] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T17:57:11.934930] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-11-03T17:57:12.666137] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-11-03T17:57:12.734859] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-11-03T17:57:13.139390] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-11-03T17:57:13.534880] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-11. [2025-11-03T17:57:14.334890] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-11-03T17:57:14.396330] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-11-03T17:57:14.744181] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T17:57:15.078727] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-11 (1.54 seconds). [2025-11-03T17:57:15.079762] [INFO ] [REMOTE ] CCS: Full fetch complete (44659 records). [2025-11-03T17:57:15.079842] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-11-03T17:57:15.141517] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-11-03T17:57:15.469187] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-11-03T17:57:15.469264] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-11-03T17:57:15.469828] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-11-03T17:57:15.469888] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-11-03T17:57:15.470791] [DEBUG] [LOCAL ] CCS: Trimmed 44659 records to 29710 (keeping 200 days of data) [2025-11-03T17:57:15.646663] [DEBUG] [LOCAL ] CCS: Primary data saved (29710 records). [2025-11-03T17:57:15.646819] [INFO ] [MAIN ] CCS: Full history saved. [2025-11-03T17:57:15.646902] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CCS took 37.7s. Estimated remaining: 4h 25m 1s. Rate: 7.3 symbols/min [2025-11-03T17:57:15.816042] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:15.836840] [DEBUG] [LOCAL ] CDRE: Loaded 24656 existing records from primary storage. [2025-11-03T17:57:15.837144] [INFO ] [MAIN ] CDRE: Loaded 24656 existing records. [2025-11-03T17:57:15.938307] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-11-03T17:57:16.018771] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:16.018950] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-11-03T17:57:16.019024] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-11-03T17:57:16.019489] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-11-03T17:57:16.019561] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-11-03T17:57:16.381715] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:16.410014] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T17:57:16.695966] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T17:57:16.734807] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-11-03T17:57:17.187555] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-11-03T17:57:17.534867] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-11-03T17:57:18.334851] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-11-03T17:57:18.350521] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T17:57:19.134847] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-11-03T17:57:19.670637] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T17:57:19.686338] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-11-03T17:57:19.934850] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-11-03T17:57:20.537342] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-11-03T17:57:20.734852] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-11-03T17:57:21.534847] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-11-03T17:57:21.964191] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T17:57:22.334853] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-11-03T17:57:22.965246] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T17:57:23.058709] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T17:57:23.134881] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-11-03T17:57:23.934858] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-11-03T17:57:24.164721] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T17:57:24.734855] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-11-03T17:57:25.368138] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T17:57:25.426881] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T17:57:25.534830] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-11-03T17:57:26.334858] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-11-03T17:57:27.072195] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-11-03T17:57:27.134849] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-11-03T17:57:27.441688] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T17:57:27.934844] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-11-03T17:57:28.661510] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T17:57:28.734870] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-11-03T17:57:28.986528] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T17:57:29.370202] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T17:57:29.534873] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-11-03T17:57:30.334866] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-11-03T17:57:30.693132] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T17:57:31.134916] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-11-03T17:57:31.686805] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-11-03T17:57:31.934858] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-11-03T17:57:32.243399] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-11-03T17:57:32.490959] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T17:57:32.734842] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-11-03T17:57:33.534851] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-11-03T17:57:34.334828] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-11-03T17:57:34.464514] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T17:57:34.840011] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T17:57:34.876524] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-11-03T17:57:35.134871] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-11-03T17:57:35.934902] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-11. [2025-11-03T17:57:36.413585] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T17:57:36.734872] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-11-03T17:57:36.916341] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T17:57:36.917875] [INFO ] [REMOTE ] CDLR: Full fetch complete (14688 records). [2025-11-03T17:57:36.917945] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-11-03T17:57:37.271102] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-11-03T17:57:37.271179] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-11-03T17:57:37.271508] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-11-03T17:57:37.271546] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-11-03T17:57:37.272036] [DEBUG] [LOCAL ] CDLR: Trimmed 14688 records to 10417 (keeping 200 days of data) [2025-11-03T17:57:37.331882] [DEBUG] [LOCAL ] CDLR: Primary data saved (10417 records). [2025-11-03T17:57:37.332013] [INFO ] [MAIN ] CDLR: Full history saved. [2025-11-03T17:57:37.332094] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CDLR took 35.6s. Estimated remaining: 4h 25m 55s. Rate: 7.3 symbols/min [2025-11-03T17:57:37.502080] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:37.544123] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-11. [2025-11-03T17:57:37.547129] [DEBUG] [LOCAL ] CE: Loaded 51889 existing records from primary storage. [2025-11-03T17:57:37.547728] [INFO ] [MAIN ] CE: Loaded 51889 existing records. [2025-11-03T17:57:37.748293] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:37.743789] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T17:57:37.748507] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-11-03T17:57:37.748607] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-11-03T17:57:37.755135] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-11-03T17:57:37.755199] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-11-03T17:57:38.174676] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:38.334934] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-11-03T17:57:39.065431] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-11 (1.52 seconds). [2025-11-03T17:57:39.066889] [INFO ] [REMOTE ] CDP: Full fetch complete (62307 records). [2025-11-03T17:57:39.067041] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-11-03T17:57:39.135139] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-11-03T17:57:39.252738] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T17:57:39.488790] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-11-03T17:57:39.488865] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-11-03T17:57:39.489576] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-11-03T17:57:39.489663] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-11-03T17:57:39.490843] [DEBUG] [LOCAL ] CDP: Trimmed 62307 records to 42196 (keeping 200 days of data) [2025-11-03T17:57:39.734060] [DEBUG] [LOCAL ] CDP: Primary data saved (42196 records). [2025-11-03T17:57:39.734178] [INFO ] [MAIN ] CDP: Full history saved. [2025-11-03T17:57:39.734260] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDP took 30.3s. Estimated remaining: 4h 25m 20s. Rate: 7.3 symbols/min [2025-11-03T17:57:39.899285] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:39.904869] [DEBUG] [LOCAL ] CEE: Loaded 4846 existing records from primary storage. [2025-11-03T17:57:39.905024] [INFO ] [MAIN ] CEE: Loaded 4846 existing records. [2025-11-03T17:57:39.940066] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-11. [2025-11-03T17:57:40.081745] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:40.081972] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-11-03T17:57:40.082024] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-11-03T17:57:40.082257] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-11-03T17:57:40.082314] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-11-03T17:57:40.441568] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:40.575297] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T17:57:40.734894] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-11-03T17:57:41.505976] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T17:57:41.534815] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-11-03T17:57:42.334918] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-11-03T17:57:42.767460] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T17:57:42.914308] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-11 (2.97 seconds). [2025-11-03T17:57:42.916115] [INFO ] [REMOTE ] CDE: Full fetch complete (77813 records). [2025-11-03T17:57:42.916255] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-11-03T17:57:43.143254] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-11-03T17:57:43.245093] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T17:57:43.344236] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-11-03T17:57:43.344318] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-11-03T17:57:43.345156] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-11-03T17:57:43.345222] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-11-03T17:57:43.346612] [DEBUG] [LOCAL ] CDE: Trimmed 77813 records to 53644 (keeping 200 days of data) [2025-11-03T17:57:43.654977] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-11-03T17:57:43.655219] [INFO ] [MAIN ] CDE: Full history saved. [2025-11-03T17:57:43.655918] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDE took 45.1s. Estimated remaining: 4h 24m 53s. Rate: 7.3 symbols/min [2025-11-03T17:57:43.837140] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T17:57:43.840280] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:43.873492] [DEBUG] [LOCAL ] CEPU: Loaded 28001 existing records from primary storage. [2025-11-03T17:57:43.873851] [INFO ] [MAIN ] CEPU: Loaded 28001 existing records. [2025-11-03T17:57:43.940075] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-11-03T17:57:44.058420] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:44.058690] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-11-03T17:57:44.058751] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-11-03T17:57:44.059285] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-11-03T17:57:44.059341] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-11-03T17:57:44.414472] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:44.661852] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T17:57:44.734882] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-11-03T17:57:45.198089] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T17:57:45.534890] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-11-03T17:57:46.334854] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-11-03T17:57:46.975585] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T17:57:47.134875] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-11-03T17:57:47.250179] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T17:57:47.554017] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T17:57:47.934875] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-11-03T17:57:48.734876] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-11-03T17:57:49.088855] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T17:57:49.460749] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T17:57:49.534817] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-11-03T17:57:50.329368] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:57:50.334866] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-11-03T17:57:50.772509] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-11-03T17:57:51.134854] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-11-03T17:57:51.934837] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-11-03T17:57:51.973904] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T17:57:52.491727] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T17:57:52.734862] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-11-03T17:57:53.534903] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-11. [2025-11-03T17:57:54.107815] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T17:57:54.334874] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-11-03T17:57:54.696814] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T17:57:54.697995] [INFO ] [REMOTE ] CDRE: Full fetch complete (34861 records). [2025-11-03T17:57:54.698077] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-11-03T17:57:55.074530] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-11-03T17:57:55.074619] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-11-03T17:57:55.075136] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-11-03T17:57:55.075197] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-11-03T17:57:55.076202] [DEBUG] [LOCAL ] CDRE: Trimmed 34861 records to 24446 (keeping 200 days of data) [2025-11-03T17:57:55.135480] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-11-03T17:57:55.223889] [DEBUG] [LOCAL ] CDRE: Primary data saved (24446 records). [2025-11-03T17:57:55.224020] [INFO ] [MAIN ] CDRE: Full history saved. [2025-11-03T17:57:55.224098] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CDRE took 39.6s. Estimated remaining: 4h 24m 60s. Rate: 7.3 symbols/min [2025-11-03T17:57:55.396510] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:57:55.442375] [DEBUG] [LOCAL ] CF: Loaded 52762 existing records from primary storage. [2025-11-03T17:57:55.442809] [INFO ] [MAIN ] CF: Loaded 52762 existing records. [2025-11-03T17:57:55.626190] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:57:55.632261] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T17:57:55.631980] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-11-03T17:57:55.634638] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-11-03T17:57:55.645339] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-11-03T17:57:55.659014] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-11-03T17:57:55.741003] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T17:57:55.940125] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-11-03T17:57:56.033834] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:57:56.289054] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-11-03T17:57:56.734918] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-11-03T17:57:57.504880] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T17:57:57.534866] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-11-03T17:57:58.334878] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-11-03T17:57:58.784727] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-11-03T17:57:58.843039] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T17:57:59.134889] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-11-03T17:57:59.934847] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-11-03T17:58:00.043130] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-11-03T17:58:00.734970] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-11. [2025-11-03T17:58:01.269777] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T17:58:01.418283] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T17:58:01.419224] [INFO ] [REMOTE ] CEE: Full fetch complete (9895 records). [2025-11-03T17:58:01.419307] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-11-03T17:58:01.539955] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-11-03T17:58:01.810558] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-11-03T17:58:01.810861] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-11-03T17:58:01.811161] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-11-03T17:58:01.811201] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-11-03T17:58:01.811635] [DEBUG] [LOCAL ] CEE: Trimmed 9895 records to 4840 (keeping 200 days of data) [2025-11-03T17:58:01.839772] [DEBUG] [LOCAL ] CEE: Primary data saved (4840 records). [2025-11-03T17:58:01.839906] [INFO ] [MAIN ] CEE: Full history saved. [2025-11-03T17:58:01.839987] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CEE took 22.1s. Estimated remaining: 4h 24m 45s. Rate: 7.3 symbols/min [2025-11-03T17:58:02.009582] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:02.055725] [DEBUG] [LOCAL ] CFG: Loaded 54402 existing records from primary storage. [2025-11-03T17:58:02.056039] [INFO ] [MAIN ] CFG: Loaded 54402 existing records. [2025-11-03T17:58:02.233163] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:02.233397] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-11-03T17:58:02.233450] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-11-03T17:58:02.234309] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-11-03T17:58:02.234367] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-11-03T17:58:02.340082] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-11-03T17:58:02.605428] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:02.914212] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T17:58:03.134841] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-11-03T17:58:03.322702] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T17:58:03.934884] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-11-03T17:58:04.542962] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T17:58:04.616239] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-11-03T17:58:04.734838] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-11-03T17:58:05.534869] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-11-03T17:58:06.031912] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T17:58:06.334868] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-11-03T17:58:06.465724] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T17:58:07.134862] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-11-03T17:58:07.724756] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:58:07.879091] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T17:58:07.934827] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-11-03T17:58:08.734907] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-11-03T17:58:08.841315] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T17:58:09.534861] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-11-03T17:58:10.057895] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T17:58:10.334892] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-11-03T17:58:10.700869] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T17:58:11.134913] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-11-03T17:58:11.641146] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T17:58:11.934898] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-11-03T17:58:12.547921] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T17:58:12.734896] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-11-03T17:58:13.006745] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T17:58:13.534870] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-11. [2025-11-03T17:58:14.063196] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T17:58:14.334866] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-11-03T17:58:15.134871] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-11. [2025-11-03T17:58:15.208932] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T17:58:15.210122] [INFO ] [REMOTE ] CEPU: Full fetch complete (40047 records). [2025-11-03T17:58:15.210197] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-11-03T17:58:15.594096] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-11-03T17:58:15.594290] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-11-03T17:58:15.594935] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-11-03T17:58:15.595012] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-11-03T17:58:15.596078] [DEBUG] [LOCAL ] CEPU: Trimmed 40047 records to 27644 (keeping 200 days of data) [2025-11-03T17:58:15.751058] [DEBUG] [LOCAL ] CEPU: Primary data saved (27644 records). [2025-11-03T17:58:15.751284] [INFO ] [MAIN ] CEPU: Full history saved. [2025-11-03T17:58:15.751561] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CEPU took 32.1s. Estimated remaining: 4h 25m 2s. Rate: 7.3 symbols/min [2025-11-03T17:58:15.965446] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:15.965533] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-11-03T17:58:15.971033] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-11-03T17:58:15.990242] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-11-03T17:58:15.993613] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-11-03T17:58:15.993896] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-11-03T17:58:15.993964] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-11-03T17:58:15.994230] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-11-03T17:58:16.018571] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-11-03T17:58:16.358282] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:16.734854] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-11-03T17:58:16.944977] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T17:58:16.948765] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T17:58:16.948861] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-11-03T17:58:16.950366] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T17:58:16.950560] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-11-03T17:58:16.950673] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T17:58:16.950775] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-11-03T17:58:16.950961] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-11-03T17:58:16.951041] [INFO ] [REMOTE ] CE: Full fetch complete (74763 records). [2025-11-03T17:58:16.951179] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-11-03T17:58:16.951235] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-11-03T17:58:16.951483] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-11-03T17:58:16.951549] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CFND took 1.2s. Estimated remaining: 4h 24m 22s. Rate: 7.3 symbols/min [2025-11-03T17:58:17.273919] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:17.531918] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-11-03T17:58:17.532019] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-11-03T17:58:17.533044] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-11-03T17:58:17.533137] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-11-03T17:58:17.534840] [DEBUG] [LOCAL ] CE: Trimmed 74763 records to 51118 (keeping 200 days of data) [2025-11-03T17:58:17.534911] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-11-03T17:58:17.608046] [DEBUG] [LOCAL ] CFR: Loaded 32632 existing records from primary storage. [2025-11-03T17:58:17.642142] [INFO ] [MAIN ] CFR: Loaded 32632 existing records. [2025-11-03T17:58:17.813007] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-11-03T17:58:17.997388] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:18.002871] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-11-03T17:58:18.003932] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-11-03T17:58:18.006129] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-11-03T17:58:18.007224] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-11-03T17:58:18.380090] [DEBUG] [LOCAL ] CE: Primary data saved (51118 records). [2025-11-03T17:58:18.361293] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-11-03T17:58:18.397458] [INFO ] [MAIN ] CE: Full history saved. [2025-11-03T17:58:18.397637] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CE took 41.1s. Estimated remaining: 4h 23m 44s. Rate: 7.3 symbols/min [2025-11-03T17:58:18.584582] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:18.651943] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:18.694032] [DEBUG] [LOCAL ] CGAU: Loaded 44637 existing records from primary storage. [2025-11-03T17:58:18.694432] [INFO ] [MAIN ] CGAU: Loaded 44637 existing records. [2025-11-03T17:58:18.905712] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:18.906055] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-11-03T17:58:18.906133] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-11-03T17:58:18.906854] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-11-03T17:58:18.906912] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-11-03T17:58:19.113535] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-11-03T17:58:19.138556] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-11-03T17:58:19.319375] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:19.820572] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T17:58:19.934864] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-11-03T17:58:20.399022] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T17:58:20.734930] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-11-03T17:58:20.982379] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T17:58:21.534858] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-11-03T17:58:22.177698] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T17:58:22.334908] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-11-03T17:58:22.570392] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T17:58:23.134851] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-11-03T17:58:23.695662] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T17:58:23.934884] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-11-03T17:58:24.157683] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T17:58:24.734831] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-11-03T17:58:24.894693] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T17:58:25.534857] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-11-03T17:58:26.334930] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-11-03T17:58:26.417353] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T17:58:26.585916] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T17:58:27.134978] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-11-03T17:58:27.469361] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T17:58:27.934907] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-11-03T17:58:28.555480] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T17:58:28.734822] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-11-03T17:58:29.275179] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T17:58:29.534912] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-11-03T17:58:29.908519] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T17:58:30.334901] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-11-03T17:58:30.615237] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T17:58:31.134931] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-11-03T17:58:31.627710] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T17:58:31.934945] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-11-03T17:58:32.432311] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T17:58:32.734952] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-11-03T17:58:32.924506] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T17:58:33.534843] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-11-03T17:58:33.628917] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T17:58:34.334874] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-11-03T17:58:34.606565] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T17:58:35.134880] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-11-03T17:58:35.309456] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T17:58:35.934873] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-11-03T17:58:36.739994] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-11-03T17:58:36.759833] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T17:58:36.977977] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T17:58:37.534875] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-11-03T17:58:38.010085] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T17:58:38.334906] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-11-03T17:58:38.669917] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T17:58:39.134857] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-11. [2025-11-03T17:58:39.934885] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-11-03T17:58:39.968251] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-11-03T17:58:40.734853] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-11-03T17:58:40.954932] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T17:58:41.025303] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T17:58:41.026830] [INFO ] [REMOTE ] CFG: Full fetch complete (77782 records). [2025-11-03T17:58:41.026992] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-11-03T17:58:41.415623] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-11-03T17:58:41.415737] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-11-03T17:58:41.416823] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-11-03T17:58:41.416886] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-11-03T17:58:41.418413] [DEBUG] [LOCAL ] CFG: Trimmed 77782 records to 53622 (keeping 200 days of data) [2025-11-03T17:58:41.534836] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-11. [2025-11-03T17:58:41.754337] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T17:58:41.763840] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-11-03T17:58:41.771210] [INFO ] [MAIN ] CFG: Full history saved. [2025-11-03T17:58:41.771313] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CFG took 39.9s. Estimated remaining: 4h 24m 44s. Rate: 7.3 symbols/min [2025-11-03T17:58:41.941193] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:41.944090] [DEBUG] [LOCAL ] CGV: Loaded 1367 existing records from primary storage. [2025-11-03T17:58:41.944220] [INFO ] [MAIN ] CGV: Loaded 1367 existing records. [2025-11-03T17:58:42.120120] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:42.120383] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-11-03T17:58:42.120438] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-11-03T17:58:42.120595] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-11-03T17:58:42.120684] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-11-03T17:58:42.340111] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-11-03T17:58:42.472337] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:42.635507] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T17:58:42.637339] [INFO ] [REMOTE ] CF: Full fetch complete (75520 records). [2025-11-03T17:58:42.637522] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-11-03T17:58:43.040832] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-11-03T17:58:43.040926] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-11-03T17:58:43.041767] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-11-03T17:58:43.041832] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-11-03T17:58:43.043274] [DEBUG] [LOCAL ] CF: Trimmed 75520 records to 51971 (keeping 200 days of data) [2025-11-03T17:58:43.135998] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-11-03T17:58:43.354162] [DEBUG] [LOCAL ] CF: Primary data saved (51971 records). [2025-11-03T17:58:43.354310] [INFO ] [MAIN ] CF: Full history saved. [2025-11-03T17:58:43.355032] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CF took 48.1s. Estimated remaining: 4h 24m 6s. Rate: 7.3 symbols/min [2025-11-03T17:58:43.544937] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:43.570306] [DEBUG] [LOCAL ] CHCT: Loaded 24328 existing records from primary storage. [2025-11-03T17:58:43.570594] [INFO ] [MAIN ] CHCT: Loaded 24328 existing records. [2025-11-03T17:58:43.789870] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:43.790140] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-11-03T17:58:43.790255] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-11-03T17:58:43.790872] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-11-03T17:58:43.807773] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-11-03T17:58:43.926731] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-11-03T17:58:43.936699] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-11-03T17:58:44.199031] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:44.226735] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T17:58:44.399893] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-11-03T17:58:44.734898] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-11-03T17:58:45.020342] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T17:58:45.534856] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-11. [2025-11-03T17:58:46.334855] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-11-03T17:58:46.966789] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-11 (1.43 seconds). [2025-11-03T17:58:46.967983] [INFO ] [REMOTE ] CFR: Full fetch complete (48685 records). [2025-11-03T17:58:46.968059] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-11-03T17:58:47.140147] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-11-03T17:58:47.353199] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-11-03T17:58:47.353304] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-11-03T17:58:47.353956] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-11-03T17:58:47.354018] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-11-03T17:58:47.355017] [DEBUG] [LOCAL ] CFR: Trimmed 48685 records to 32116 (keeping 200 days of data) [2025-11-03T17:58:47.552062] [DEBUG] [LOCAL ] CFR: Primary data saved (32116 records). [2025-11-03T17:58:47.552188] [INFO ] [MAIN ] CFR: Full history saved. [2025-11-03T17:58:47.552263] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFR took 30.6s. Estimated remaining: 4h 23m 40s. Rate: 7.3 symbols/min [2025-11-03T17:58:47.724909] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:47.758624] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T17:58:47.809665] [DEBUG] [LOCAL ] CHD: Loaded 53098 existing records from primary storage. [2025-11-03T17:58:47.809978] [INFO ] [MAIN ] CHD: Loaded 53098 existing records. [2025-11-03T17:58:47.946726] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-11. [2025-11-03T17:58:47.987865] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:47.988249] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-11-03T17:58:47.988297] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-11-03T17:58:47.989194] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-11-03T17:58:47.989253] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-11-03T17:58:48.358365] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T17:58:48.364252] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:48.734852] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-11-03T17:58:49.534855] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-11-03T17:58:49.820360] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-11 (1.87 seconds). [2025-11-03T17:58:49.822294] [INFO ] [REMOTE ] CGAU: Full fetch complete (62787 records). [2025-11-03T17:58:49.822374] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-11-03T17:58:49.887121] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T17:58:50.228039] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-11-03T17:58:50.228152] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-11-03T17:58:50.228974] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-11-03T17:58:50.229100] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-11-03T17:58:50.230500] [DEBUG] [LOCAL ] CGAU: Trimmed 62787 records to 44049 (keeping 200 days of data) [2025-11-03T17:58:50.340057] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-11-03T17:58:50.373833] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T17:58:50.517947] [DEBUG] [LOCAL ] CGAU: Primary data saved (44049 records). [2025-11-03T17:58:50.518070] [INFO ] [MAIN ] CGAU: Full history saved. [2025-11-03T17:58:50.518145] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CGAU took 32.1s. Estimated remaining: 4h 23m 9s. Rate: 7.3 symbols/min [2025-11-03T17:58:50.684624] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:58:50.700279] [DEBUG] [LOCAL ] CHE: Loaded 15867 existing records from primary storage. [2025-11-03T17:58:50.700513] [INFO ] [MAIN ] CHE: Loaded 15867 existing records. [2025-11-03T17:58:50.873981] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:58:50.874238] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-11-03T17:58:50.874286] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-11-03T17:58:50.874680] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-11-03T17:58:50.874743] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-11-03T17:58:51.137886] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-11-03T17:58:51.241816] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:58:51.258196] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T17:58:51.529410] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-11-03T17:58:51.934866] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-11-03T17:58:52.190921] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-11-03T17:58:52.734861] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-11-03T17:58:53.497146] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-11-03T17:58:53.534887] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-11-03T17:58:54.334944] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-11-03T17:58:54.798518] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T17:58:54.845296] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T17:58:55.134837] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-11-03T17:58:55.694693] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T17:58:55.934827] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-11-03T17:58:56.600195] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T17:58:56.734859] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-11-03T17:58:57.019774] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-11-03T17:58:57.534894] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-11-03T17:58:58.334887] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-11-03T17:58:58.385296] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T17:58:58.998023] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T17:58:59.134868] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-11-03T17:58:59.807166] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-11-03T17:58:59.934850] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-11-03T17:59:00.734910] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-11-03T17:59:01.034284] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-11-03T17:59:01.035163] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T17:59:01.534880] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-11-03T17:59:02.185632] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T17:59:02.334871] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-11-03T17:59:03.037329] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-11-03T17:59:03.134860] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-11-03T17:59:03.874532] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T17:59:03.934863] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-11-03T17:59:04.734860] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-11-03T17:59:05.041205] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-11-03T17:59:05.339418] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T17:59:05.534850] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-11-03T17:59:05.768975] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.23 seconds). [2025-11-03T17:59:06.334852] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-11-03T17:59:07.134880] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-11. [2025-11-03T17:59:07.589432] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-11 (0.45 seconds). [2025-11-03T17:59:07.590078] [INFO ] [REMOTE ] CGV: Full fetch complete (2184 records). [2025-11-03T17:59:07.590143] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-11-03T17:59:07.942807] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-11-03T17:59:07.956250] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T17:59:07.999992] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-11-03T17:59:08.000903] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-11-03T17:59:08.001108] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-11-03T17:59:08.001451] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-11-03T17:59:08.002821] [DEBUG] [LOCAL ] CGV: Trimmed 2184 records to 1352 (keeping 200 days of data) [2025-11-03T17:59:08.011787] [DEBUG] [LOCAL ] CGV: Primary data saved (1352 records). [2025-11-03T17:59:08.012267] [INFO ] [MAIN ] CGV: Full history saved. [2025-11-03T17:59:08.012370] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CGV took 26.2s. Estimated remaining: 4h 23m 42s. Rate: 7.3 symbols/min [2025-11-03T17:59:08.178268] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:59:08.220975] [DEBUG] [LOCAL ] CHGG: Loaded 48132 existing records from primary storage. [2025-11-03T17:59:08.221284] [INFO ] [MAIN ] CHGG: Loaded 48132 existing records. [2025-11-03T17:59:08.394162] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:59:08.394359] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-11-03T17:59:08.394406] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-11-03T17:59:08.395179] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-11-03T17:59:08.395246] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-11-03T17:59:08.741472] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:59:08.741531] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-11-03T17:59:09.007348] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T17:59:09.495504] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-11-03T17:59:09.534863] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-11-03T17:59:10.334863] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-11-03T17:59:10.826321] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T17:59:11.106440] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T17:59:11.134813] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-11-03T17:59:11.934899] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-11-03T17:59:12.440403] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T17:59:12.697429] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T17:59:12.734889] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-11-03T17:59:13.534850] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-11-03T17:59:14.054355] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T17:59:14.334849] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-11-03T17:59:14.954584] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T17:59:15.134833] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-11-03T17:59:15.313950] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-11-03T17:59:15.934855] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-11-03T17:59:16.349007] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T17:59:16.734854] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-11. [2025-11-03T17:59:17.327558] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T17:59:17.534859] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-11-03T17:59:18.042157] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T17:59:18.043317] [INFO ] [REMOTE ] CHE: Full fetch complete (21250 records). [2025-11-03T17:59:18.043413] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-11-03T17:59:18.336092] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-11-03T17:59:18.449227] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T17:59:18.622233] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-11-03T17:59:18.622341] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-11-03T17:59:18.622957] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-11-03T17:59:18.623035] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-11-03T17:59:18.624085] [DEBUG] [LOCAL ] CHE: Trimmed 21250 records to 15893 (keeping 200 days of data) [2025-11-03T17:59:18.779447] [DEBUG] [LOCAL ] CHE: Primary data saved (15893 records). [2025-11-03T17:59:18.779599] [INFO ] [MAIN ] CHE: Full history saved. [2025-11-03T17:59:18.779751] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHE took 28.3s. Estimated remaining: 4h 23m 46s. Rate: 7.3 symbols/min [2025-11-03T17:59:19.018425] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:59:19.053202] [DEBUG] [LOCAL ] CHH: Loaded 32493 existing records from primary storage. [2025-11-03T17:59:19.053506] [INFO ] [MAIN ] CHH: Loaded 32493 existing records. [2025-11-03T17:59:19.139932] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-11-03T17:59:19.272584] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:59:19.272855] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-11-03T17:59:19.272927] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-11-03T17:59:19.273728] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-11-03T17:59:19.273788] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-11-03T17:59:19.724021] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:59:19.754421] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T17:59:19.934871] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-11-03T17:59:20.110001] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T17:59:20.734870] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-11-03T17:59:21.160957] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T17:59:21.534863] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-11-03T17:59:21.598128] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T17:59:22.334866] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-11-03T17:59:22.764285] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T17:59:23.134858] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-11-03T17:59:23.427460] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T17:59:23.934920] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-11. [2025-11-03T17:59:24.486018] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T17:59:24.734900] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-11. [2025-11-03T17:59:25.063116] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T17:59:25.064160] [INFO ] [REMOTE ] CHCT: Full fetch complete (34844 records). [2025-11-03T17:59:25.064241] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-11-03T17:59:25.426903] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-11-03T17:59:25.427010] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-11-03T17:59:25.427566] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-11-03T17:59:25.427606] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-11-03T17:59:25.428451] [DEBUG] [LOCAL ] CHCT: Trimmed 34844 records to 23907 (keeping 200 days of data) [2025-11-03T17:59:25.537241] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-11-03T17:59:25.568484] [DEBUG] [LOCAL ] CHCT: Primary data saved (23907 records). [2025-11-03T17:59:25.568589] [INFO ] [MAIN ] CHCT: Full history saved. [2025-11-03T17:59:25.568690] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CHCT took 42.2s. Estimated remaining: 4h 23m 31s. Rate: 7.3 symbols/min [2025-11-03T17:59:25.738293] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:59:25.756374] [DEBUG] [LOCAL ] CHMI: Loaded 20941 existing records from primary storage. [2025-11-03T17:59:25.756609] [INFO ] [MAIN ] CHMI: Loaded 20941 existing records. [2025-11-03T17:59:25.929086] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:59:25.929309] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-11-03T17:59:25.929383] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-11-03T17:59:25.929816] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-11-03T17:59:25.929873] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-11-03T17:59:26.275872] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:59:26.334817] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-11-03T17:59:26.546057] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T17:59:26.591468] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-11 (1.86 seconds). [2025-11-03T17:59:26.592875] [INFO ] [REMOTE ] CHD: Full fetch complete (75076 records). [2025-11-03T17:59:26.592962] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-11-03T17:59:26.974295] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-11-03T17:59:26.974379] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-11-03T17:59:26.975207] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-11-03T17:59:26.975272] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-11-03T17:59:26.976741] [DEBUG] [LOCAL ] CHD: Trimmed 75076 records to 52362 (keeping 200 days of data) [2025-11-03T17:59:27.167128] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-11-03T17:59:27.248269] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T17:59:27.350275] [DEBUG] [LOCAL ] CHD: Primary data saved (52362 records). [2025-11-03T17:59:27.350575] [INFO ] [MAIN ] CHD: Full history saved. [2025-11-03T17:59:27.351443] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHD took 39.8s. Estimated remaining: 4h 22m 55s. Rate: 7.3 symbols/min [2025-11-03T17:59:27.538766] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T17:59:27.589276] [DEBUG] [LOCAL ] CHPT: Loaded 46521 existing records from primary storage. [2025-11-03T17:59:27.589791] [INFO ] [MAIN ] CHPT: Loaded 46521 existing records. [2025-11-03T17:59:27.798996] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T17:59:27.799420] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-11-03T17:59:27.799483] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-11-03T17:59:27.800445] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-11-03T17:59:27.800511] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-11-03T17:59:27.940071] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-11-03T17:59:28.235305] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T17:59:28.287101] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T17:59:28.734893] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-11-03T17:59:28.778604] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T17:59:29.534870] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-11-03T17:59:29.985963] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T17:59:30.334867] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-11-03T17:59:31.134847] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-11-03T17:59:31.368622] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-11-03T17:59:31.637932] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T17:59:31.934876] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-11-03T17:59:32.148342] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T17:59:32.734909] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-11-03T17:59:32.831224] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-11-03T17:59:33.535045] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-11-03T17:59:34.332795] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-11-03T17:59:34.342230] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-11-03T17:59:34.511284] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-11-03T17:59:35.134837] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-11-03T17:59:35.934837] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-11-03T17:59:36.028582] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-11-03T17:59:36.550289] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T17:59:36.646569] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T17:59:36.734886] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-11-03T17:59:37.534938] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-11-03T17:59:37.979117] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T17:59:38.334871] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-11-03T17:59:39.048753] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T17:59:39.134837] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-11-03T17:59:39.643921] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T17:59:39.934914] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-10. [2025-11-03T17:59:40.734876] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-11-03T17:59:40.781280] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T17:59:41.363602] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T17:59:41.534861] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-11-03T17:59:41.562532] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-11-03T17:59:42.334840] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-11. [2025-11-03T17:59:42.524159] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T17:59:43.134906] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-11-03T17:59:43.934841] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-11-03T17:59:44.008283] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T17:59:44.354269] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-11 (2.02 seconds). [2025-11-03T17:59:44.355680] [INFO ] [REMOTE ] CHGG: Full fetch complete (69699 records). [2025-11-03T17:59:44.355869] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-11-03T17:59:44.737048] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-11-03T17:59:44.756873] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-11-03T17:59:44.757773] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-11-03T17:59:44.758560] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-11-03T17:59:44.758743] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-11-03T17:59:44.760077] [DEBUG] [LOCAL ] CHGG: Trimmed 69699 records to 47575 (keeping 200 days of data) [2025-11-03T17:59:45.027332] [DEBUG] [LOCAL ] CHGG: Primary data saved (47575 records). [2025-11-03T17:59:45.027754] [INFO ] [MAIN ] CHGG: Full history saved. [2025-11-03T17:59:45.027851] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHGG took 37.0s. Estimated remaining: 4h 23m 28s. Rate: 7.3 symbols/min [2025-11-03T17:59:45.432729] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T17:59:45.534831] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-11-03T17:59:45.579196] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T17:59:46.334894] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-11-03T17:59:47.134925] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-11-03T17:59:47.351624] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T17:59:47.445220] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-11-03T17:59:47.916757] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T17:59:47.934809] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-11-03T17:59:48.678759] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T17:59:48.734851] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-11-03T17:59:49.511190] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T17:59:49.534838] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-11-03T17:59:50.325056] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T17:59:50.334852] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-11-03T17:59:51.134901] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-11-03T17:59:51.935130] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-11. [2025-11-03T17:59:52.108844] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-11-03T17:59:52.183138] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-11-03T17:59:52.734878] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-11-03T17:59:53.129397] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T17:59:53.130325] [INFO ] [REMOTE ] CHMI: Full fetch complete (31312 records). [2025-11-03T17:59:53.130394] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-11-03T17:59:53.508475] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-11-03T17:59:53.508556] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-11-03T17:59:53.509065] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-11-03T17:59:53.509137] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-11-03T17:59:53.510020] [DEBUG] [LOCAL ] CHMI: Trimmed 31312 records to 20472 (keeping 200 days of data) [2025-11-03T17:59:53.556504] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-11. [2025-11-03T17:59:53.630927] [DEBUG] [LOCAL ] CHMI: Primary data saved (20472 records). [2025-11-03T17:59:53.631084] [INFO ] [MAIN ] CHMI: Full history saved. [2025-11-03T17:59:53.631196] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHMI took 28.1s. Estimated remaining: 4h 23m 22s. Rate: 7.3 symbols/min [2025-11-03T17:59:54.019765] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T17:59:54.334858] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-11-03T17:59:55.140944] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-11 (1.58 seconds). [2025-11-03T17:59:55.142167] [INFO ] [REMOTE ] CHH: Full fetch complete (47673 records). [2025-11-03T17:59:55.142239] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-11-03T17:59:55.545670] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-11-03T17:59:55.545806] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-11-03T17:59:55.546413] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-11-03T17:59:55.546491] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-11-03T17:59:55.547758] [DEBUG] [LOCAL ] CHH: Trimmed 47673 records to 32066 (keeping 200 days of data) [2025-11-03T17:59:55.664416] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T17:59:55.677733] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-11-03T17:59:55.783257] [DEBUG] [LOCAL ] CHH: Primary data saved (32066 records). [2025-11-03T17:59:55.783381] [INFO ] [MAIN ] CHH: Full history saved. [2025-11-03T17:59:55.783472] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHH took 37.0s. Estimated remaining: 4h 22m 47s. Rate: 7.3 symbols/min [2025-11-03T17:59:56.953192] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T17:59:56.961920] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-11. [2025-11-03T17:59:59.075151] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-11 (2.11 seconds). [2025-11-03T17:59:59.076697] [INFO ] [REMOTE ] CHPT: Full fetch complete (69657 records). [2025-11-03T17:59:59.076834] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-11-03T17:59:59.487849] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-11-03T17:59:59.487962] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-11-03T17:59:59.489061] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-11-03T17:59:59.489149] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-11-03T17:59:59.490840] [DEBUG] [LOCAL ] CHPT: Trimmed 69657 records to 45583 (keeping 200 days of data) [2025-11-03T17:59:59.757448] [DEBUG] [LOCAL ] CHPT: Primary data saved (45583 records). [2025-11-03T17:59:59.757582] [INFO ] [MAIN ] CHPT: Full history saved. [2025-11-03T17:59:59.758299] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHPT took 32.4s. Estimated remaining: 4h 22m 21s. Rate: 7.3 symbols/min [2025-11-03T18:00:00.433575] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:00.546776] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:00.554232] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:00.599134] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:00.616211] [DEBUG] [LOCAL ] CHT: Loaded 19116 existing records from primary storage. [2025-11-03T18:00:00.622452] [INFO ] [MAIN ] CHT: Loaded 19116 existing records. [2025-11-03T18:00:00.753267] [DEBUG] [LOCAL ] CIA: Loaded 16308 existing records from primary storage. [2025-11-03T18:00:00.784557] [INFO ] [MAIN ] CIA: Loaded 16308 existing records. [2025-11-03T18:00:00.925622] [DEBUG] [LOCAL ] CI: Loaded 50188 existing records from primary storage. [2025-11-03T18:00:00.960378] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:00.997163] [INFO ] [MAIN ] CI: Loaded 50188 existing records. [2025-11-03T18:00:00.997272] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-11-03T18:00:00.997005] [DEBUG] [LOCAL ] CHWY: Loaded 54433 existing records from primary storage. [2025-11-03T18:00:01.033829] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-11-03T18:00:01.043271] [INFO ] [MAIN ] CHWY: Loaded 54433 existing records. [2025-11-03T18:00:01.120749] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-11-03T18:00:01.186461] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-11-03T18:00:01.304690] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:01.336589] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-11-03T18:00:01.347608] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-11-03T18:00:01.400816] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-11-03T18:00:01.490220] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-11-03T18:00:01.635087] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:01.706504] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-11-03T18:00:01.764900] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-11-03T18:00:01.764762] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:01.801632] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-11-03T18:00:01.839272] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-11-03T18:00:01.839121] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-11-03T18:00:01.895759] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-11-03T18:00:01.985740] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-11-03T18:00:02.073811] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-11-03T18:00:02.690848] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:02.758018] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-11-03T18:00:03.074281] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:03.118872] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-11-03T18:00:03.309219] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:03.305489] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:03.309565] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-11-03T18:00:03.310529] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-11-03T18:00:03.801405] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T18:00:03.805271] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-11-03T18:00:04.234009] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T18:00:04.237483] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-11-03T18:00:04.752368] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:00:04.762587] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-11-03T18:00:04.834277] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T18:00:04.838301] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-11-03T18:00:04.886786] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-11-03T18:00:04.890400] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-11-03T18:00:05.110638] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-11-03T18:00:05.121340] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-11-03T18:00:05.535227] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-11-03T18:00:05.541283] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-11-03T18:00:05.671300] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T18:00:05.678461] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-11-03T18:00:06.030728] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T18:00:06.230476] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-11-03T18:00:06.334926] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-11-03T18:00:06.505941] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T18:00:06.809686] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-11-03T18:00:07.134865] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-11-03T18:00:07.789002] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T18:00:07.934850] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-11-03T18:00:08.475404] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T18:00:08.646835] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T18:00:08.734880] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-11-03T18:00:09.534878] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-11-03T18:00:10.334840] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-11-03T18:00:10.406482] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-11-03T18:00:10.955988] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T18:00:11.102865] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T18:00:11.134866] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-11-03T18:00:11.885568] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T18:00:11.934863] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-11-03T18:00:12.616383] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T18:00:12.734859] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-11-03T18:00:13.534827] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-11-03T18:00:13.671286] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T18:00:14.334897] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-11-03T18:00:14.412382] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T18:00:15.134868] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-11-03T18:00:15.826730] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:00:15.934845] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-11-03T18:00:16.603355] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-11-03T18:00:16.732134] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-11-03T18:00:16.742434] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-11-03T18:00:17.534829] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-11-03T18:00:17.932447] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T18:00:18.334863] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-11-03T18:00:19.134861] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-11-03T18:00:19.850028] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T18:00:19.918493] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-11-03T18:00:19.934799] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-11-03T18:00:20.734857] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-11-03T18:00:20.750014] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-11-03T18:00:21.524129] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-11-03T18:00:21.535002] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-11-03T18:00:22.171789] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-11-03T18:00:22.334917] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-11-03T18:00:22.535895] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-11-03T18:00:23.134868] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-11-03T18:00:23.186580] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-11-03T18:00:23.934880] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-11. [2025-11-03T18:00:24.734859] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-11. [2025-11-03T18:00:24.794451] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-11-03T18:00:25.144752] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-11 (1.21 seconds). [2025-11-03T18:00:25.145724] [INFO ] [REMOTE ] CHT: Full fetch complete (27498 records). [2025-11-03T18:00:25.145825] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-11-03T18:00:25.536290] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-11-03T18:00:25.549200] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-11-03T18:00:25.549297] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-11-03T18:00:25.549814] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-11-03T18:00:25.549878] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-11-03T18:00:25.550931] [DEBUG] [LOCAL ] CHT: Trimmed 27498 records to 18698 (keeping 200 days of data) [2025-11-03T18:00:25.658908] [DEBUG] [LOCAL ] CHT: Primary data saved (18698 records). [2025-11-03T18:00:25.659051] [INFO ] [MAIN ] CHT: Full history saved. [2025-11-03T18:00:25.659131] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CHT took 25.9s. Estimated remaining: 4h 23m 30s. Rate: 7.3 symbols/min [2025-11-03T18:00:25.735041] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-11 (1.00 seconds). [2025-11-03T18:00:25.764841] [INFO ] [REMOTE ] CIA: Full fetch complete (22991 records). [2025-11-03T18:00:25.765014] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-11-03T18:00:25.941311] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:26.153282] [DEBUG] [LOCAL ] CIB: Loaded 29840 existing records from primary storage. [2025-11-03T18:00:26.169545] [INFO ] [MAIN ] CIB: Loaded 29840 existing records. [2025-11-03T18:00:26.338119] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-11-03T18:00:26.348582] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-11-03T18:00:26.349505] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-11-03T18:00:26.350094] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-11-03T18:00:26.350569] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-11-03T18:00:26.390796] [DEBUG] [LOCAL ] CIA: Trimmed 22991 records to 16100 (keeping 200 days of data) [2025-11-03T18:00:26.433364] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:26.433793] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-11-03T18:00:26.433859] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-11-03T18:00:26.466795] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-11-03T18:00:26.473890] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-11-03T18:00:26.828529] [DEBUG] [LOCAL ] CIA: Primary data saved (16100 records). [2025-11-03T18:00:26.856930] [INFO ] [MAIN ] CIA: Full history saved. [2025-11-03T18:00:26.876190] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CIA took 27.1s. Estimated remaining: 4h 22m 51s. Rate: 7.3 symbols/min [2025-11-03T18:00:26.899404] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:27.087813] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:27.088142] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-11-03T18:00:27.088197] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-11-03T18:00:27.088303] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-11-03T18:00:27.088345] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-11-03T18:00:27.088386] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-11-03T18:00:27.088417] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-11-03T18:00:27.142413] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-11-03T18:00:27.449729] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:27.481886] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-11-03T18:00:27.912326] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-11-03T18:00:27.934825] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-11-03T18:00:28.222623] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-11-03T18:00:28.734875] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-11-03T18:00:29.152330] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T18:00:29.534885] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-11-03T18:00:29.857705] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T18:00:30.334926] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-11-03T18:00:30.789210] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-11-03T18:00:31.134818] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-11-03T18:00:31.310446] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-11-03T18:00:31.934838] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-11-03T18:00:32.045367] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T18:00:32.734870] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-11-03T18:00:33.466955] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T18:00:33.534855] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-11. [2025-11-03T18:00:33.842453] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-11-03T18:00:34.334876] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-11-03T18:00:35.134897] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-11-03T18:00:35.425188] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T18:00:35.711991] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T18:00:35.876306] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-11 (2.34 seconds). [2025-11-03T18:00:35.877887] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-11-03T18:00:35.878004] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-11-03T18:00:35.943169] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-11. [2025-11-03T18:00:36.275606] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-11-03T18:00:36.275726] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-11-03T18:00:36.276563] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-11-03T18:00:36.276606] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-11-03T18:00:36.278110] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 53654 (keeping 200 days of data) [2025-11-03T18:00:36.589795] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-11-03T18:00:36.589982] [INFO ] [MAIN ] CHWY: Full history saved. [2025-11-03T18:00:36.590100] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 36.8s. Estimated remaining: 4h 22m 50s. Rate: 7.3 symbols/min [2025-11-03T18:00:36.739966] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-11-03T18:00:36.766257] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:36.813716] [DEBUG] [LOCAL ] CIEN: Loaded 52817 existing records from primary storage. [2025-11-03T18:00:36.814018] [INFO ] [MAIN ] CIEN: Loaded 52817 existing records. [2025-11-03T18:00:36.998033] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:36.999205] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-11-03T18:00:36.999257] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-11-03T18:00:37.000070] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-11-03T18:00:37.000130] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-11-03T18:00:37.084826] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-11-03T18:00:37.225127] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T18:00:37.272215] [INFO ] [REMOTE ] CI: Full fetch complete (72070 records). [2025-11-03T18:00:37.296237] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-11-03T18:00:37.494836] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:37.540028] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-11-03T18:00:37.794915] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-11-03T18:00:37.794997] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-11-03T18:00:37.796120] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-11-03T18:00:37.796186] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-11-03T18:00:37.797703] [DEBUG] [LOCAL ] CI: Trimmed 72070 records to 49506 (keeping 200 days of data) [2025-11-03T18:00:37.890187] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T18:00:38.105084] [DEBUG] [LOCAL ] CI: Primary data saved (49506 records). [2025-11-03T18:00:38.105216] [INFO ] [MAIN ] CI: Full history saved. [2025-11-03T18:00:38.105293] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CI took 38.3s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-11-03T18:00:38.270526] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:00:38.276015] [DEBUG] [LOCAL ] CIF: Loaded 3878 existing records from primary storage. [2025-11-03T18:00:38.276199] [INFO ] [MAIN ] CIF: Loaded 3878 existing records. [2025-11-03T18:00:38.340009] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-11-03T18:00:38.455793] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:00:38.456019] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-11-03T18:00:38.456071] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-11-03T18:00:38.456275] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-11-03T18:00:38.456330] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-11-03T18:00:38.806011] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:00:39.134842] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-11-03T18:00:39.279218] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T18:00:39.934865] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-11-03T18:00:40.178517] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-11-03T18:00:40.726438] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-11-03T18:00:40.736552] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-11-03T18:00:41.255545] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T18:00:41.534868] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-11-03T18:00:42.334875] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-11-03T18:00:42.721869] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T18:00:42.766723] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-11-03T18:00:43.134908] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-11-03T18:00:43.560311] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-11-03T18:00:43.934854] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-11-03T18:00:44.734825] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-11-03T18:00:44.980693] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-11-03T18:00:45.018244] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T18:00:45.534905] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-11-03T18:00:46.334863] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-11-03T18:00:46.863337] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T18:00:47.134846] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-11-03T18:00:47.190100] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T18:00:47.379489] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-11-03T18:00:47.934854] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-11-03T18:00:48.734923] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-11-03T18:00:49.164047] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T18:00:49.288682] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T18:00:49.534893] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-11-03T18:00:50.334865] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-11-03T18:00:50.593089] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-11-03T18:00:50.981592] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T18:00:51.134810] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-11-03T18:00:51.934851] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-11-03T18:00:52.350461] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T18:00:52.474562] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T18:00:52.734878] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-11-03T18:00:53.534887] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-11-03T18:00:54.051675] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T18:00:54.203288] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-11-03T18:00:54.334861] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-11-03T18:00:55.134926] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-11-03T18:00:55.378769] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T18:00:55.934874] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-11-03T18:00:56.335974] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T18:00:56.338314] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T18:00:56.734874] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-11-03T18:00:57.071356] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-11-03T18:00:57.534902] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-11-03T18:00:57.852688] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-11-03T18:00:58.334869] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-11-03T18:00:59.134896] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-11. [2025-11-03T18:00:59.238449] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-11-03T18:00:59.605057] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-11 (0.47 seconds). [2025-11-03T18:00:59.605876] [INFO ] [REMOTE ] CICB: Full fetch complete (1898 records). [2025-11-03T18:00:59.605962] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-11-03T18:00:59.799034] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-11-03T18:00:59.799203] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:00:59.799274] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:00:59.799347] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-11-03T18:00:59.799412] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-11-03T18:00:59.799451] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-11-03T18:00:59.799492] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-11-03T18:00:59.799550] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CICB took 32.9s. Estimated remaining: 4h 23m 3s. Rate: 7.3 symbols/min [2025-11-03T18:00:59.939953] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-11-03T18:00:59.991679] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:00.032119] [DEBUG] [LOCAL ] CIG: Loaded 45264 existing records from primary storage. [2025-11-03T18:01:00.032424] [INFO ] [MAIN ] CIG: Loaded 45264 existing records. [2025-11-03T18:01:00.211808] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:01:00.212081] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-11-03T18:01:00.212148] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-11-03T18:01:00.212953] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-11-03T18:01:00.213011] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-11-03T18:01:00.332207] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T18:01:00.573419] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:00.734882] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-11-03T18:01:01.534913] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-11. [2025-11-03T18:01:02.284518] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-11-03T18:01:02.335084] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-11-03T18:01:02.904000] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T18:01:02.941002] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T18:01:02.942477] [INFO ] [REMOTE ] CIB: Full fetch complete (45203 records). [2025-11-03T18:01:02.942594] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-11-03T18:01:03.140519] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-11-03T18:01:03.372290] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-11-03T18:01:03.372415] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-11-03T18:01:03.373298] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-11-03T18:01:03.373369] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-11-03T18:01:03.374725] [DEBUG] [LOCAL ] CIB: Trimmed 45203 records to 29148 (keeping 200 days of data) [2025-11-03T18:01:03.562542] [DEBUG] [LOCAL ] CIB: Primary data saved (29148 records). [2025-11-03T18:01:03.562755] [INFO ] [MAIN ] CIB: Full history saved. [2025-11-03T18:01:03.562893] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CIB took 37.9s. Estimated remaining: 4h 22m 35s. Rate: 7.3 symbols/min [2025-11-03T18:01:03.679275] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T18:01:03.802294] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:03.802539] [DEBUG] [LOCAL ] CII: No existing data file found in primary storage. [2025-11-03T18:01:03.802600] [WARN ] [MAIN ] CII: No existing data found, performing full refresh instead. [2025-11-03T18:01:03.802790] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-11-03T18:01:03.802858] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-11-03T18:01:03.802911] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-11-03T18:01:03.802980] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-11-03T18:01:03.937124] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-11-03T18:01:04.198960] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:04.453141] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-11-03T18:01:04.734887] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-11-03T18:01:05.534888] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-11-03T18:01:06.252140] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-11-03T18:01:06.344835] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-11-03T18:01:06.351456] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T18:01:07.134862] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-11. [2025-11-03T18:01:07.485358] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T18:01:07.830335] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T18:01:07.831084] [INFO ] [REMOTE ] CIF: Full fetch complete (6534 records). [2025-11-03T18:01:07.831152] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-11-03T18:01:07.940021] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-11-03T18:01:08.210257] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-11-03T18:01:08.210333] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-11-03T18:01:08.210503] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-11-03T18:01:08.210543] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-11-03T18:01:08.210980] [DEBUG] [LOCAL ] CIF: Trimmed 6534 records to 3836 (keeping 200 days of data) [2025-11-03T18:01:08.233052] [DEBUG] [LOCAL ] CIF: Primary data saved (3836 records). [2025-11-03T18:01:08.233163] [INFO ] [MAIN ] CIF: Full history saved. [2025-11-03T18:01:08.233242] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CIF took 30.1s. Estimated remaining: 4h 22m 12s. Rate: 7.3 symbols/min [2025-11-03T18:01:08.404512] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:08.438746] [DEBUG] [LOCAL ] CIM: Loaded 37536 existing records from primary storage. [2025-11-03T18:01:08.439045] [INFO ] [MAIN ] CIM: Loaded 37536 existing records. [2025-11-03T18:01:08.620163] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:01:08.620436] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-11-03T18:01:08.620489] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-11-03T18:01:08.621171] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-11-03T18:01:08.621229] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-11-03T18:01:08.739987] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-11. [2025-11-03T18:01:09.004814] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:09.090342] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T18:01:09.534865] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-11-03T18:01:09.929850] [DEBUG] [REMOTE ] CIEN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:01:09.930179] [WARN ] [REMOTE ] CIEN: No data returned for month 2025-11 [2025-11-03T18:01:09.930280] [FATAL] [REMOTE ] CIEN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:01:09.930402] [FATAL] [MAIN ] CIEN: Failed to fetch primary data. [2025-11-03T18:01:09.930494] [WARN ] [MAIN ] CIEN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:01:09.930588] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-11-03T18:01:09.930695] [DEBUG] [LOCAL ] CIEN: No primary data file found to delete. [2025-11-03T18:01:09.930751] [INFO ] [LOCAL ] CIEN: Starting deletion of derivative data. [2025-11-03T18:01:09.930928] [DEBUG] [LOCAL ] CIEN: Deleted derivative data file. [2025-11-03T18:01:09.931797] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CIEN took 33.3s. Estimated remaining: 4h 21m 36s. Rate: 7.3 symbols/min [2025-11-03T18:01:10.106735] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:10.110983] [DEBUG] [LOCAL ] CIMN: Loaded 2697 existing records from primary storage. [2025-11-03T18:01:10.111285] [INFO ] [MAIN ] CIMN: Loaded 2697 existing records. [2025-11-03T18:01:10.296151] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:01:10.296379] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-11-03T18:01:10.296446] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-11-03T18:01:10.296690] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-11-03T18:01:10.296749] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-11-03T18:01:10.340339] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-11-03T18:01:10.685492] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:10.758319] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T18:01:10.917061] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T18:01:11.134859] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-11-03T18:01:11.569533] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-11-03T18:01:11.934839] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-11-03T18:01:12.734870] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-11-03T18:01:12.984958] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T18:01:13.534868] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-11-03T18:01:13.706410] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T18:01:14.334914] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-11-03T18:01:14.510447] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T18:01:15.134870] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-11-03T18:01:15.302912] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-11-03T18:01:15.883603] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T18:01:15.934813] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-11-03T18:01:16.734852] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-11-03T18:01:17.235099] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:01:17.534850] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-11-03T18:01:17.785993] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T18:01:18.334835] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-11-03T18:01:18.889616] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-11-03T18:01:19.134822] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-11-03T18:01:19.223474] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-11-03T18:01:19.934855] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-11-03T18:01:20.235878] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-11-03T18:01:20.440831] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T18:01:20.734884] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-11-03T18:01:21.322936] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T18:01:21.534858] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-11-03T18:01:22.178409] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T18:01:22.334863] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-11-03T18:01:23.134863] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-11-03T18:01:23.374416] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T18:01:23.934924] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-11-03T18:01:24.559617] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T18:01:24.734893] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-11-03T18:01:25.174199] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T18:01:25.331983] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T18:01:25.534863] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-11-03T18:01:25.978046] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T18:01:26.334897] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-11-03T18:01:26.779201] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T18:01:27.134866] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-11-03T18:01:27.934837] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-11-03T18:01:28.020003] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T18:01:28.734872] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-11-03T18:01:29.134279] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T18:01:29.534937] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-11-03T18:01:30.088238] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:01:30.334893] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-11-03T18:01:30.500634] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T18:01:30.663364] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-11-03T18:01:31.134944] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-11-03T18:01:31.445066] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-11-03T18:01:31.934941] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-11-03T18:01:32.734903] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-11-03T18:01:33.155631] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T18:01:33.534891] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-11-03T18:01:33.996942] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T18:01:34.255962] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-11-03T18:01:34.334827] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-11-03T18:01:35.134895] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-11-03T18:01:35.473353] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-11-03T18:01:35.629089] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:01:35.934850] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-11-03T18:01:36.734872] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-11. [2025-11-03T18:01:37.351019] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T18:01:37.409430] [DEBUG] [REMOTE ] CII: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:01:37.409787] [WARN ] [REMOTE ] CII: No data returned for month 2025-11 [2025-11-03T18:01:37.409859] [FATAL] [REMOTE ] CII: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:01:37.409927] [FATAL] [MAIN ] CII: Failed to fetch primary data. [2025-11-03T18:01:37.409989] [WARN ] [MAIN ] CII: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:01:37.410062] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-11-03T18:01:37.410124] [DEBUG] [LOCAL ] CII: No primary data file found to delete. [2025-11-03T18:01:37.410161] [INFO ] [LOCAL ] CII: Starting deletion of derivative data. [2025-11-03T18:01:37.410201] [DEBUG] [LOCAL ] CII: No derivative data file found to delete. [2025-11-03T18:01:37.410247] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CII took 33.8s. Estimated remaining: 4h 22m 50s. Rate: 7.3 symbols/min [2025-11-03T18:01:37.548454] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-11. [2025-11-03T18:01:37.582461] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:37.582696] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-11-03T18:01:37.582751] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-11-03T18:01:37.582871] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-11-03T18:01:37.582938] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-11-03T18:01:37.582998] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-11-03T18:01:37.583043] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-11-03T18:01:37.990120] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:38.334870] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-11-03T18:01:38.818999] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T18:01:39.134828] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-11-03T18:01:39.387299] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-11 (1.84 seconds). [2025-11-03T18:01:39.388614] [INFO ] [REMOTE ] CIM: Full fetch complete (54973 records). [2025-11-03T18:01:39.388742] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-11-03T18:01:39.763763] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-11-03T18:01:39.763846] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-11-03T18:01:39.764500] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-11-03T18:01:39.764541] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-11-03T18:01:39.765625] [DEBUG] [LOCAL ] CIM: Trimmed 54973 records to 36872 (keeping 200 days of data) [2025-11-03T18:01:39.953999] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-11-03T18:01:39.985972] [DEBUG] [LOCAL ] CIM: Primary data saved (36872 records). [2025-11-03T18:01:39.986108] [INFO ] [MAIN ] CIM: Full history saved. [2025-11-03T18:01:39.986189] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIM took 31.8s. Estimated remaining: 4h 22m 18s. Rate: 7.3 symbols/min [2025-11-03T18:01:40.154765] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:40.154945] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-11-03T18:01:40.154982] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-11-03T18:01:40.155091] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-11-03T18:01:40.155131] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-11-03T18:01:40.155171] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-11-03T18:01:40.155203] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-11-03T18:01:40.340242] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T18:01:40.527069] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:40.648139] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:01:40.734831] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-11. [2025-11-03T18:01:41.534879] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-11-03T18:01:41.594604] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-11-03T18:01:41.594881] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-11-03T18:01:41.594978] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:01:41.595049] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-11-03T18:01:41.595115] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:01:41.595183] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-11-03T18:01:41.595245] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-11-03T18:01:41.595281] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-11-03T18:01:41.595320] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-11-03T18:01:41.595364] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIMP took 1.6s. Estimated remaining: 4h 21m 41s. Rate: 7.3 symbols/min [2025-11-03T18:01:41.697316] [DEBUG] [REMOTE ] CIG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:01:41.698147] [WARN ] [REMOTE ] CIG: No data returned for month 2025-11 [2025-11-03T18:01:41.719364] [FATAL] [REMOTE ] CIG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:01:41.739539] [FATAL] [MAIN ] CIG: Failed to fetch primary data. [2025-11-03T18:01:41.751042] [WARN ] [MAIN ] CIG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:01:41.771761] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:41.767544] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-11-03T18:01:41.771928] [DEBUG] [LOCAL ] CIG: No primary data file found to delete. [2025-11-03T18:01:41.772263] [INFO ] [LOCAL ] CIG: Starting deletion of derivative data. [2025-11-03T18:01:41.772555] [DEBUG] [LOCAL ] CIG: Deleted derivative data file. [2025-11-03T18:01:41.773205] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CIG took 42.0s. Estimated remaining: 4h 20m 59s. Rate: 7.3 symbols/min [2025-11-03T18:01:41.932064] [DEBUG] [LOCAL ] CINT: Loaded 20693 existing records from primary storage. [2025-11-03T18:01:41.944957] [INFO ] [MAIN ] CINT: Loaded 20693 existing records. [2025-11-03T18:01:42.005502] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:42.183278] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:01:42.184241] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-11-03T18:01:42.184595] [DEBUG] [LOCAL ] CIO: Loaded 21818 existing records from primary storage. [2025-11-03T18:01:42.184730] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-11-03T18:01:42.184943] [INFO ] [MAIN ] CIO: Loaded 21818 existing records. [2025-11-03T18:01:42.216394] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-11-03T18:01:42.227616] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-11-03T18:01:42.335618] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-11-03T18:01:42.529457] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:01:42.593879] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-11-03T18:01:42.620908] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-11-03T18:01:42.642698] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-11-03T18:01:42.652954] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-11-03T18:01:42.836438] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:42.912929] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T18:01:43.091535] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:43.134821] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-11-03T18:01:43.934883] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-11-03T18:01:43.953511] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T18:01:44.273308] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-11-03T18:01:44.734865] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-11. [2025-11-03T18:01:45.307506] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T18:01:45.308185] [INFO ] [REMOTE ] CIMN: Full fetch complete (3878 records). [2025-11-03T18:01:45.308251] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-11-03T18:01:45.542717] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-11-03T18:01:45.659108] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-11-03T18:01:45.659177] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-11-03T18:01:45.659296] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-11-03T18:01:45.659332] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-11-03T18:01:45.659685] [DEBUG] [LOCAL ] CIMN: Trimmed 3878 records to 2632 (keeping 200 days of data) [2025-11-03T18:01:45.675204] [DEBUG] [LOCAL ] CIMN: Primary data saved (2632 records). [2025-11-03T18:01:45.675263] [INFO ] [MAIN ] CIMN: Full history saved. [2025-11-03T18:01:45.675326] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIMN took 35.7s. Estimated remaining: 4h 20m 33s. Rate: 7.3 symbols/min [2025-11-03T18:01:45.842964] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:01:45.868112] [DEBUG] [LOCAL ] CION: Loaded 27585 existing records from primary storage. [2025-11-03T18:01:45.868351] [INFO ] [MAIN ] CION: Loaded 27585 existing records. [2025-11-03T18:01:46.043096] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:01:46.043290] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-11-03T18:01:46.043335] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-11-03T18:01:46.043868] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-11-03T18:01:46.043924] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-11-03T18:01:46.338212] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-11-03T18:01:46.425916] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:01:46.431533] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:01:46.723514] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-11-03T18:01:47.134915] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-11-03T18:01:47.510927] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T18:01:47.934902] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-11-03T18:01:48.734855] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-11-03T18:01:48.864979] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:01:49.430030] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:01:49.534861] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-11-03T18:01:50.231612] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T18:01:50.334887] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-11-03T18:01:50.735002] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T18:01:51.134842] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-11-03T18:01:51.859411] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T18:01:51.934834] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-11-03T18:01:52.742156] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-11-03T18:01:52.745955] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T18:01:53.534835] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-11-03T18:01:53.637849] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-11-03T18:01:53.786747] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-11-03T18:01:54.334856] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-11-03T18:01:55.095752] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T18:01:55.134895] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-11-03T18:01:55.905025] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T18:01:55.934854] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-11-03T18:01:56.214534] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-11-03T18:01:56.734849] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-11-03T18:01:57.534911] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-11-03T18:01:57.783890] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T18:01:57.885454] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-11-03T18:01:58.334876] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-11-03T18:01:58.765254] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T18:01:59.134881] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-11-03T18:01:59.934909] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-11-03T18:02:00.276864] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T18:02:00.734878] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-11-03T18:02:01.065385] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T18:02:01.534938] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-11-03T18:02:01.637274] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T18:02:02.213631] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T18:02:02.334965] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-11-03T18:02:03.006632] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T18:02:03.134861] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-11-03T18:02:03.844129] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T18:02:03.934835] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-11-03T18:02:04.734850] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-11-03T18:02:04.814274] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T18:02:05.534864] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-11-03T18:02:05.568327] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T18:02:06.334857] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-11-03T18:02:06.465867] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T18:02:07.134880] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-11-03T18:02:07.276804] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T18:02:07.934851] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-11-03T18:02:08.079788] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T18:02:08.734907] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-11-03T18:02:09.018590] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T18:02:09.534846] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-11-03T18:02:09.633130] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-11-03T18:02:10.261497] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T18:02:10.334865] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-11-03T18:02:10.779358] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-11-03T18:02:11.134844] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-11. [2025-11-03T18:02:11.917260] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T18:02:11.918048] [INFO ] [REMOTE ] CIMO: Full fetch complete (4599 records). [2025-11-03T18:02:11.918424] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-11-03T18:02:11.940051] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-11-03T18:02:12.319450] [DEBUG] [VALIDATOR ] CIMO: All expected trading days are present. [2025-11-03T18:02:12.319548] [DEBUG] [VALIDATOR ] CIMO: Primary data validation passed. [2025-11-03T18:02:12.319707] [INFO ] [MAIN ] CIMO: Fetched primary data is valid. [2025-11-03T18:02:12.319768] [DEBUG] [LOCAL ] CIMO: Saving primary data. [2025-11-03T18:02:12.320129] [DEBUG] [LOCAL ] CIMO: Trimmed 4599 records to 3178 (keeping 200 days of data) [2025-11-03T18:02:12.339719] [DEBUG] [LOCAL ] CIMO: Primary data saved (3178 records). [2025-11-03T18:02:12.339844] [INFO ] [MAIN ] CIMO: Full history saved. [2025-11-03T18:02:12.339915] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIMO took 34.9s. Estimated remaining: 4h 21m 43s. Rate: 7.3 symbols/min [2025-11-03T18:02:12.513856] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:12.562363] [DEBUG] [LOCAL ] CIVI: Loaded 53381 existing records from primary storage. [2025-11-03T18:02:12.562733] [INFO ] [MAIN ] CIVI: Loaded 53381 existing records. [2025-11-03T18:02:12.747464] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-11-03T18:02:12.753574] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:12.754591] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-11-03T18:02:12.754705] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-11-03T18:02:12.755530] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-11-03T18:02:12.755591] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-11-03T18:02:13.139180] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:13.156164] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:02:13.534857] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-11-03T18:02:13.947976] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T18:02:14.334870] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-11. [2025-11-03T18:02:14.486379] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T18:02:15.134899] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-11-03T18:02:15.183984] [DEBUG] [REMOTE ] CIO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:02:15.184287] [WARN ] [REMOTE ] CIO: No data returned for month 2025-11 [2025-11-03T18:02:15.184409] [FATAL] [REMOTE ] CIO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:02:15.184484] [FATAL] [MAIN ] CIO: Failed to fetch primary data. [2025-11-03T18:02:15.184520] [WARN ] [MAIN ] CIO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:02:15.184557] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-11-03T18:02:15.184623] [DEBUG] [LOCAL ] CIO: No primary data file found to delete. [2025-11-03T18:02:15.184702] [INFO ] [LOCAL ] CIO: Starting deletion of derivative data. [2025-11-03T18:02:15.185290] [DEBUG] [LOCAL ] CIO: Deleted derivative data file. [2025-11-03T18:02:15.185378] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CIO took 33.4s. Estimated remaining: 4h 21m 12s. Rate: 7.3 symbols/min [2025-11-03T18:02:15.366593] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:15.418497] [DEBUG] [LOCAL ] CL: Loaded 54429 existing records from primary storage. [2025-11-03T18:02:15.418858] [INFO ] [MAIN ] CL: Loaded 54429 existing records. [2025-11-03T18:02:15.607633] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:15.607874] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-11-03T18:02:15.607931] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-11-03T18:02:15.608910] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-11-03T18:02:15.608968] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-11-03T18:02:15.940060] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-11-03T18:02:15.995959] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:16.288981] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T18:02:16.734914] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-11-03T18:02:17.310781] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T18:02:17.534859] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-11. [2025-11-03T18:02:18.151722] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T18:02:18.328632] [DEBUG] [REMOTE ] CINT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:02:18.328898] [WARN ] [REMOTE ] CINT: No data returned for month 2025-11 [2025-11-03T18:02:18.328985] [FATAL] [REMOTE ] CINT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:02:18.329083] [FATAL] [MAIN ] CINT: Failed to fetch primary data. [2025-11-03T18:02:18.329150] [WARN ] [MAIN ] CINT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:02:18.329221] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-11-03T18:02:18.329281] [DEBUG] [LOCAL ] CINT: No primary data file found to delete. [2025-11-03T18:02:18.329317] [INFO ] [LOCAL ] CINT: Starting deletion of derivative data. [2025-11-03T18:02:18.329487] [DEBUG] [LOCAL ] CINT: Deleted derivative data file. [2025-11-03T18:02:18.329569] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CINT took 36.7s. Estimated remaining: 4h 20m 43s. Rate: 7.3 symbols/min [2025-11-03T18:02:18.339934] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-11-03T18:02:18.502051] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:18.532215] [DEBUG] [LOCAL ] CLB: Loaded 33945 existing records from primary storage. [2025-11-03T18:02:18.532484] [INFO ] [MAIN ] CLB: Loaded 33945 existing records. [2025-11-03T18:02:18.714753] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:18.714933] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-11-03T18:02:18.714979] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-11-03T18:02:18.715565] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-11-03T18:02:18.715621] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-11-03T18:02:19.078913] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:19.134809] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-11-03T18:02:19.305604] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T18:02:19.934912] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-11-03T18:02:20.694756] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T18:02:20.734858] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-11-03T18:02:21.105272] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T18:02:21.534857] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-11. [2025-11-03T18:02:22.154950] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T18:02:22.222150] [DEBUG] [REMOTE ] CION: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:02:22.222433] [WARN ] [REMOTE ] CION: No data returned for month 2025-11 [2025-11-03T18:02:22.222522] [FATAL] [REMOTE ] CION: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:02:22.222594] [FATAL] [MAIN ] CION: Failed to fetch primary data. [2025-11-03T18:02:22.222707] [WARN ] [MAIN ] CION: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:02:22.222770] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-11-03T18:02:22.222839] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-11-03T18:02:22.222887] [INFO ] [LOCAL ] CION: Starting deletion of derivative data. [2025-11-03T18:02:22.223058] [DEBUG] [LOCAL ] CION: Deleted derivative data file. [2025-11-03T18:02:22.223146] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CION took 36.5s. Estimated remaining: 4h 20m 16s. Rate: 7.3 symbols/min [2025-11-03T18:02:22.340028] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-11-03T18:02:22.393799] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:22.406420] [DEBUG] [LOCAL ] CLCO: Loaded 12980 existing records from primary storage. [2025-11-03T18:02:22.406693] [INFO ] [MAIN ] CLCO: Loaded 12980 existing records. [2025-11-03T18:02:22.587425] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:22.587624] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-11-03T18:02:22.587703] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-11-03T18:02:22.587996] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-11-03T18:02:22.588061] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-11-03T18:02:22.948125] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:23.134902] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-11-03T18:02:23.797589] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T18:02:23.934845] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-11-03T18:02:24.000386] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T18:02:24.734901] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-11-03T18:02:25.467254] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-11-03T18:02:25.534818] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-11-03T18:02:25.629297] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:02:26.334850] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-11-03T18:02:26.953626] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T18:02:27.134898] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-11-03T18:02:27.641084] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T18:02:27.934850] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-11-03T18:02:28.740051] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-11-03T18:02:28.763499] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-11-03T18:02:29.419573] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:02:29.442286] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:02:29.534852] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-11-03T18:02:30.334860] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-11-03T18:02:31.011352] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T18:02:31.134857] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-11-03T18:02:31.934829] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-11-03T18:02:32.030457] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-11-03T18:02:32.165196] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T18:02:32.734863] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-11-03T18:02:33.401007] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T18:02:33.534844] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-11-03T18:02:33.973125] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T18:02:34.334888] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-11-03T18:02:35.134865] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-11-03T18:02:35.195466] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-11-03T18:02:35.599700] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T18:02:35.934892] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-11-03T18:02:36.734851] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-11-03T18:02:36.890113] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-11-03T18:02:36.891117] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T18:02:37.534972] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-11-03T18:02:37.733534] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T18:02:38.334867] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-11-03T18:02:38.650020] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-11-03T18:02:39.134889] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-11-03T18:02:39.876200] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-11-03T18:02:39.934812] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-11-03T18:02:40.188812] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-11-03T18:02:40.734859] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-11-03T18:02:40.997969] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T18:02:41.324956] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-11-03T18:02:41.534870] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-11. [2025-11-03T18:02:42.334922] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-11-03T18:02:42.982268] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T18:02:43.134855] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-11-03T18:02:43.235431] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-11 (1.70 seconds). [2025-11-03T18:02:43.240144] [INFO ] [REMOTE ] CL: Full fetch complete (77819 records). [2025-11-03T18:02:43.240288] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-11-03T18:02:43.634252] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-11-03T18:02:43.634384] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-11-03T18:02:43.635520] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-11-03T18:02:43.635630] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-11-03T18:02:43.637321] [DEBUG] [LOCAL ] CL: Trimmed 77819 records to 53649 (keeping 200 days of data) [2025-11-03T18:02:43.738540] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-11-03T18:02:43.951482] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-11-03T18:02:43.977072] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-11-03T18:02:43.977225] [INFO ] [MAIN ] CL: Full history saved. [2025-11-03T18:02:43.978019] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CL took 28.8s. Estimated remaining: 4h 21m 5s. Rate: 7.3 symbols/min [2025-11-03T18:02:44.149040] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:44.172184] [DEBUG] [LOCAL ] CLDT: Loaded 24949 existing records from primary storage. [2025-11-03T18:02:44.172449] [INFO ] [MAIN ] CLDT: Loaded 24949 existing records. [2025-11-03T18:02:44.351035] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:44.351250] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-11-03T18:02:44.351296] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-11-03T18:02:44.351771] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-11-03T18:02:44.351829] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-11-03T18:02:44.719169] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:44.734821] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-11-03T18:02:45.212442] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:02:45.534827] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-11-03T18:02:45.674253] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T18:02:46.334853] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-11-03T18:02:46.808122] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T18:02:47.134911] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-11-03T18:02:47.848051] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T18:02:47.931412] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-11-03T18:02:47.941700] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-11-03T18:02:48.627571] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T18:02:48.734842] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-11. [2025-11-03T18:02:49.534868] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-11-03T18:02:50.334907] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-11-03T18:02:50.551696] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T18:02:50.722801] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-11 (1.99 seconds). [2025-11-03T18:02:50.724117] [INFO ] [REMOTE ] CLB: Full fetch complete (48268 records). [2025-11-03T18:02:50.724216] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-11-03T18:02:51.105210] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-11-03T18:02:51.105332] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-11-03T18:02:51.106001] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-11-03T18:02:51.106063] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-11-03T18:02:51.107096] [DEBUG] [LOCAL ] CLB: Trimmed 48268 records to 33483 (keeping 200 days of data) [2025-11-03T18:02:51.159755] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-11-03T18:02:51.310936] [DEBUG] [LOCAL ] CLB: Primary data saved (33483 records). [2025-11-03T18:02:51.311075] [INFO ] [MAIN ] CLB: Full history saved. [2025-11-03T18:02:51.311152] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CLB took 33.0s. Estimated remaining: 4h 20m 53s. Rate: 7.3 symbols/min [2025-11-03T18:02:51.481213] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:51.533998] [DEBUG] [LOCAL ] CLF: Loaded 54521 existing records from primary storage. [2025-11-03T18:02:51.534337] [INFO ] [MAIN ] CLF: Loaded 54521 existing records. [2025-11-03T18:02:51.722813] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:51.723128] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-11-03T18:02:51.723249] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-11-03T18:02:51.724418] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-11-03T18:02:51.724478] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-11-03T18:02:51.940233] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T18:02:51.939748] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-11-03T18:02:52.135326] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:52.137594] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-11-03T18:02:52.734858] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-11-03T18:02:53.002083] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T18:02:53.504962] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T18:02:53.534814] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-11-03T18:02:54.334910] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-11-03T18:02:54.690685] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:02:55.126013] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T18:02:55.134816] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-11-03T18:02:55.934840] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-11-03T18:02:56.044464] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T18:02:56.734892] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-11-03T18:02:57.464753] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T18:02:57.534845] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-11. [2025-11-03T18:02:57.607745] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-11-03T18:02:58.334880] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-11-03T18:02:58.697244] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T18:02:58.698074] [INFO ] [REMOTE ] CLCO: Full fetch complete (22373 records). [2025-11-03T18:02:58.698147] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-11-03T18:02:59.072903] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-11-03T18:02:59.072978] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-11-03T18:02:59.073404] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-11-03T18:02:59.073443] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-11-03T18:02:59.074048] [DEBUG] [LOCAL ] CLCO: Trimmed 22373 records to 12635 (keeping 200 days of data) [2025-11-03T18:02:59.137034] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-11-03T18:02:59.147661] [DEBUG] [LOCAL ] CLCO: Primary data saved (12635 records). [2025-11-03T18:02:59.147773] [INFO ] [MAIN ] CLCO: Full history saved. [2025-11-03T18:02:59.147877] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CLCO took 36.9s. Estimated remaining: 4h 20m 43s. Rate: 7.3 symbols/min [2025-11-03T18:02:59.316677] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:02:59.342575] [DEBUG] [LOCAL ] CLH: Loaded 28077 existing records from primary storage. [2025-11-03T18:02:59.342907] [INFO ] [MAIN ] CLH: Loaded 28077 existing records. [2025-11-03T18:02:59.517559] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:02:59.517783] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-11-03T18:02:59.517833] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-11-03T18:02:59.518351] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-11-03T18:02:59.518410] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-11-03T18:02:59.869114] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:02:59.934810] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-11-03T18:02:59.981991] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-11-03T18:03:00.150123] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-11-03T18:03:00.734828] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-11-03T18:03:01.080775] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T18:03:01.534869] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-11-03T18:03:02.334868] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-11-03T18:03:02.591984] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-11-03T18:03:03.134892] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-11-03T18:03:03.287981] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T18:03:03.318511] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T18:03:03.916444] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T18:03:03.934813] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-11-03T18:03:04.734844] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-11. [2025-11-03T18:03:04.886629] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-11-03T18:03:05.534854] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-11. [2025-11-03T18:03:05.925091] [DEBUG] [REMOTE ] CIVI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:03:05.925418] [WARN ] [REMOTE ] CIVI: No data returned for month 2025-11 [2025-11-03T18:03:05.925511] [FATAL] [REMOTE ] CIVI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:03:05.925616] [FATAL] [MAIN ] CIVI: Failed to fetch primary data. [2025-11-03T18:03:05.925722] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:03:05.925807] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-11-03T18:03:05.925903] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-11-03T18:03:05.925959] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-11-03T18:03:05.926174] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-11-03T18:03:05.926721] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CIVI took 53.6s. Estimated remaining: 4h 20m 29s. Rate: 7.3 symbols/min [2025-11-03T18:03:06.108876] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:03:06.109070] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-11-03T18:03:06.109108] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-11-03T18:03:06.109224] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-11-03T18:03:06.109294] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-11-03T18:03:06.109362] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-11-03T18:03:06.109405] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-11-03T18:03:06.340219] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-11-03T18:03:06.516286] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:03:07.009700] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-11 (1.47 seconds). [2025-11-03T18:03:07.010776] [INFO ] [REMOTE ] CLDT: Full fetch complete (37798 records). [2025-11-03T18:03:07.010850] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-11-03T18:03:07.139943] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-11-03T18:03:07.406315] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-11-03T18:03:07.406469] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-11-03T18:03:07.407064] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-11-03T18:03:07.407233] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-11-03T18:03:07.408254] [DEBUG] [LOCAL ] CLDT: Trimmed 37798 records to 24357 (keeping 200 days of data) [2025-11-03T18:03:07.507912] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T18:03:07.569841] [DEBUG] [LOCAL ] CLDT: Primary data saved (24357 records). [2025-11-03T18:03:07.569964] [INFO ] [MAIN ] CLDT: Full history saved. [2025-11-03T18:03:07.570037] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLDT took 23.6s. Estimated remaining: 4h 19m 54s. Rate: 7.3 symbols/min [2025-11-03T18:03:07.748477] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:03:07.800874] [DEBUG] [LOCAL ] CLS: Loaded 54320 existing records from primary storage. [2025-11-03T18:03:07.801200] [INFO ] [MAIN ] CLS: Loaded 54320 existing records. [2025-11-03T18:03:07.945748] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-11-03T18:03:07.988802] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:03:07.988995] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-11-03T18:03:07.989044] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-11-03T18:03:07.989886] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-11-03T18:03:07.989944] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-11-03T18:03:08.360682] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:03:08.734872] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-11-03T18:03:09.162604] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T18:03:09.211577] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-11-03T18:03:09.390922] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-11-03T18:03:09.534851] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-11-03T18:03:10.334857] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-11-03T18:03:11.134849] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-11-03T18:03:11.531959] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-11-03T18:03:11.934865] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-11-03T18:03:12.028523] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T18:03:12.092981] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T18:03:12.447012] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-11-03T18:03:12.734835] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-11-03T18:03:13.534875] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-11-03T18:03:14.149355] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T18:03:14.334879] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-11-03T18:03:14.515831] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-11-03T18:03:14.935884] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-11-03T18:03:15.134867] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-11-03T18:03:15.934845] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-11-03T18:03:16.734860] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-11-03T18:03:17.109016] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-11-03T18:03:17.534836] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-11-03T18:03:17.606838] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T18:03:17.699135] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-11-03T18:03:18.065360] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T18:03:18.334882] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-11-03T18:03:18.993073] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T18:03:19.134947] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-11-03T18:03:19.934886] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-11-03T18:03:20.589678] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T18:03:20.734905] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-11-03T18:03:21.210223] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-11-03T18:03:21.534838] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-11-03T18:03:21.710986] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-11-03T18:03:22.334896] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-11-03T18:03:22.993103] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T18:03:23.134821] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-11-03T18:03:23.220594] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-11-03T18:03:23.636437] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-11-03T18:03:23.934891] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-11-03T18:03:24.734905] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-11-03T18:03:25.534830] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-11-03T18:03:25.686502] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-11-03T18:03:25.719890] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T18:03:26.334865] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-11-03T18:03:27.134864] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-11-03T18:03:27.290754] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T18:03:27.643880] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-11-03T18:03:27.934833] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-11-03T18:03:28.734851] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-11-03T18:03:29.106836] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-11-03T18:03:29.137555] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T18:03:29.534900] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-11-03T18:03:30.031184] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-11-03T18:03:30.334831] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-11. [2025-11-03T18:03:30.388119] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-11-03T18:03:31.134849] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-11. [2025-11-03T18:03:31.934882] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-11. [2025-11-03T18:03:32.415145] [DEBUG] [REMOTE ] CLPR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:03:32.415446] [WARN ] [REMOTE ] CLPR: No data returned for month 2025-11 [2025-11-03T18:03:32.415550] [FATAL] [REMOTE ] CLPR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:03:32.415683] [FATAL] [MAIN ] CLPR: Failed to fetch primary data. [2025-11-03T18:03:32.415770] [WARN ] [MAIN ] CLPR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:03:32.415863] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-11-03T18:03:32.415947] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-11-03T18:03:32.415984] [INFO ] [LOCAL ] CLPR: Starting deletion of derivative data. [2025-11-03T18:03:32.416023] [DEBUG] [LOCAL ] CLPR: No derivative data file found to delete. [2025-11-03T18:03:32.416070] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLPR took 26.5s. Estimated remaining: 4h 20m 54s. Rate: 7.3 symbols/min [2025-11-03T18:03:32.587636] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:03:32.634996] [DEBUG] [LOCAL ] CLVT: Loaded 52610 existing records from primary storage. [2025-11-03T18:03:32.635327] [INFO ] [MAIN ] CLVT: Loaded 52610 existing records. [2025-11-03T18:03:32.735423] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-11-03T18:03:32.812735] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-11 (1.68 seconds). [2025-11-03T18:03:32.818195] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:03:32.819733] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-11-03T18:03:32.819792] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-11-03T18:03:32.819925] [INFO ] [REMOTE ] CLH: Full fetch complete (42750 records). [2025-11-03T18:03:32.820021] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-11-03T18:03:32.851845] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-11-03T18:03:32.851944] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-11-03T18:03:33.369942] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-11 (3.04 seconds). [2025-11-03T18:03:33.436811] [INFO ] [REMOTE ] CLF: Full fetch complete (77920 records). [2025-11-03T18:03:33.529837] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-11-03T18:03:33.529744] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:03:33.564875] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-11-03T18:03:33.648546] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-11-03T18:03:33.660425] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-11-03T18:03:33.686946] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-11-03T18:03:33.709785] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-11-03T18:03:33.783388] [DEBUG] [LOCAL ] CLH: Trimmed 42750 records to 27475 (keeping 200 days of data) [2025-11-03T18:03:34.183668] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-11-03T18:03:34.183783] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-11-03T18:03:34.184771] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-11-03T18:03:34.183468] [DEBUG] [LOCAL ] CLH: Primary data saved (27475 records). [2025-11-03T18:03:34.184962] [INFO ] [MAIN ] CLH: Full history saved. [2025-11-03T18:03:34.185069] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-11-03T18:03:34.185362] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLH took 35.0s. Estimated remaining: 4h 20m 19s. Rate: 7.3 symbols/min [2025-11-03T18:03:34.289019] [DEBUG] [LOCAL ] CLF: Trimmed 77920 records to 53741 (keeping 200 days of data) [2025-11-03T18:03:34.438732] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:03:34.639178] [DEBUG] [LOCAL ] CLW: Loaded 21538 existing records from primary storage. [2025-11-03T18:03:34.672838] [INFO ] [MAIN ] CLW: Loaded 21538 existing records. [2025-11-03T18:03:34.688560] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-11-03T18:03:34.720386] [INFO ] [MAIN ] CLF: Full history saved. [2025-11-03T18:03:34.771826] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLF took 43.5s. Estimated remaining: 4h 19m 40s. Rate: 7.3 symbols/min [2025-11-03T18:03:35.008621] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:03:35.019812] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-11-03T18:03:35.026676] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-11-03T18:03:35.025300] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-11-03T18:03:35.090795] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-11-03T18:03:35.090232] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:03:35.091529] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-11-03T18:03:35.092340] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-11-03T18:03:35.454500] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-11-03T18:03:35.515999] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-11-03T18:03:35.515215] [DEBUG] [LOCAL ] CLX: Loaded 52623 existing records from primary storage. [2025-11-03T18:03:35.526528] [INFO ] [MAIN ] CLX: Loaded 52623 existing records. [2025-11-03T18:03:35.549307] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:03:35.732507] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:03:35.732773] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-11-03T18:03:35.732827] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-11-03T18:03:35.733791] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-11-03T18:03:35.733853] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-11-03T18:03:35.949390] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-11-03T18:03:36.096888] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:03:36.734882] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-11-03T18:03:36.927626] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-11-03T18:03:36.975244] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-11-03T18:03:37.250127] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T18:03:37.534820] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-11-03T18:03:37.970061] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:03:38.274833] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T18:03:38.334809] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-11-03T18:03:39.134824] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-11-03T18:03:39.173939] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T18:03:39.934825] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-11-03T18:03:40.433366] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:03:40.734828] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-11-03T18:03:40.905917] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T18:03:41.534913] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-11-03T18:03:42.108364] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:03:42.334963] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-11-03T18:03:43.134887] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-11-03T18:03:43.597837] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-11-03T18:03:43.641579] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T18:03:43.933571] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T18:03:43.938484] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-11-03T18:03:44.734859] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-11-03T18:03:45.534850] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-11-03T18:03:45.893917] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-11-03T18:03:46.257431] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T18:03:46.301342] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T18:03:46.334871] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-11-03T18:03:47.084298] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T18:03:47.134870] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-11-03T18:03:47.934848] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-11-03T18:03:48.734863] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-11-03T18:03:49.181131] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-11-03T18:03:49.477952] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T18:03:49.534904] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-11. [2025-11-03T18:03:50.032421] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T18:03:50.334884] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-11-03T18:03:51.134898] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-11-03T18:03:51.403548] [DEBUG] [REMOTE ] CLS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:03:51.403917] [WARN ] [REMOTE ] CLS: No data returned for month 2025-11 [2025-11-03T18:03:51.404003] [FATAL] [REMOTE ] CLS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:03:51.404080] [FATAL] [MAIN ] CLS: Failed to fetch primary data. [2025-11-03T18:03:51.404141] [WARN ] [MAIN ] CLS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:03:51.404212] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-11-03T18:03:51.404274] [DEBUG] [LOCAL ] CLS: No primary data file found to delete. [2025-11-03T18:03:51.404309] [INFO ] [LOCAL ] CLS: Starting deletion of derivative data. [2025-11-03T18:03:51.404448] [DEBUG] [LOCAL ] CLS: Deleted derivative data file. [2025-11-03T18:03:51.405040] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLS took 43.8s. Estimated remaining: 4h 20m 6s. Rate: 7.3 symbols/min [2025-11-03T18:03:51.576616] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:03:51.619725] [DEBUG] [LOCAL ] CM: Loaded 48697 existing records from primary storage. [2025-11-03T18:03:51.620012] [INFO ] [MAIN ] CM: Loaded 48697 existing records. [2025-11-03T18:03:51.809159] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:03:51.809517] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-11-03T18:03:51.809696] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-11-03T18:03:51.811053] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-11-03T18:03:51.811114] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-11-03T18:03:51.937668] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-11-03T18:03:52.212733] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:03:52.215024] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-11-03T18:03:52.550701] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T18:03:52.734864] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-11-03T18:03:52.962482] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T18:03:53.534869] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-11-03T18:03:53.916113] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T18:03:54.334859] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-11-03T18:03:54.866148] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T18:03:55.134862] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-11-03T18:03:55.821489] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:03:55.934916] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-11-03T18:03:56.198955] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T18:03:56.734894] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-11-03T18:03:57.379901] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T18:03:57.534888] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-11-03T18:03:58.297397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T18:03:58.334842] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-11-03T18:03:59.019717] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:03:59.134866] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-11-03T18:03:59.934840] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-11-03T18:04:00.017913] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-11-03T18:04:00.657684] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T18:04:00.734837] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-11-03T18:04:01.046483] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-11-03T18:04:01.534880] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-11-03T18:04:01.661598] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T18:04:02.334958] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-11-03T18:04:03.134907] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-11. [2025-11-03T18:04:03.418731] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-11-03T18:04:03.594324] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:04:03.934853] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-11-03T18:04:04.448236] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T18:04:04.449564] [INFO ] [REMOTE ] CLW: Full fetch complete (33334 records). [2025-11-03T18:04:04.449686] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-11-03T18:04:04.743225] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-11-03T18:04:04.837883] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-11-03T18:04:04.837969] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-11-03T18:04:04.838495] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-11-03T18:04:04.838535] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-11-03T18:04:04.839269] [DEBUG] [LOCAL ] CLW: Trimmed 33334 records to 21349 (keeping 200 days of data) [2025-11-03T18:04:04.958126] [DEBUG] [LOCAL ] CLW: Primary data saved (21349 records). [2025-11-03T18:04:04.958260] [INFO ] [MAIN ] CLW: Full history saved. [2025-11-03T18:04:04.958344] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLW took 30.8s. Estimated remaining: 4h 20m 20s. Rate: 7.3 symbols/min [2025-11-03T18:04:05.123447] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:05.169120] [DEBUG] [LOCAL ] CMA: Loaded 50836 existing records from primary storage. [2025-11-03T18:04:05.169546] [INFO ] [MAIN ] CMA: Loaded 50836 existing records. [2025-11-03T18:04:05.395055] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:05.395446] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-11-03T18:04:05.395528] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-11-03T18:04:05.396510] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-11-03T18:04:05.396577] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-11-03T18:04:05.540767] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-11. [2025-11-03T18:04:05.624669] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T18:04:05.856611] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:06.196921] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T18:04:06.334839] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-11-03T18:04:07.135364] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-11-03T18:04:07.200902] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-11 (1.66 seconds). [2025-11-03T18:04:07.202480] [INFO ] [REMOTE ] CLX: Full fetch complete (74191 records). [2025-11-03T18:04:07.202587] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-11-03T18:04:07.586885] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-11-03T18:04:07.587084] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-11-03T18:04:07.588067] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-11-03T18:04:07.588143] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-11-03T18:04:07.589769] [DEBUG] [LOCAL ] CLX: Trimmed 74191 records to 51962 (keeping 200 days of data) [2025-11-03T18:04:07.742193] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T18:04:07.943947] [DEBUG] [LOCAL ] CLX: Primary data saved (51962 records). [2025-11-03T18:04:07.944057] [INFO ] [MAIN ] CLX: Full history saved. [2025-11-03T18:04:07.934878] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-11. [2025-11-03T18:04:07.944199] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLX took 33.1s. Estimated remaining: 4h 19m 50s. Rate: 7.3 symbols/min [2025-11-03T18:04:08.112611] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:08.140843] [DEBUG] [LOCAL ] CMBT: Loaded 29696 existing records from primary storage. [2025-11-03T18:04:08.141136] [INFO ] [MAIN ] CMBT: Loaded 29696 existing records. [2025-11-03T18:04:08.327155] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:08.327377] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-11-03T18:04:08.327433] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-11-03T18:04:08.328002] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-11-03T18:04:08.328060] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-11-03T18:04:08.682858] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:08.712880] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T18:04:08.734819] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-11-03T18:04:09.239340] [DEBUG] [REMOTE ] CLVT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:04:09.239666] [WARN ] [REMOTE ] CLVT: No data returned for month 2025-11 [2025-11-03T18:04:09.239754] [FATAL] [REMOTE ] CLVT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:04:09.239832] [FATAL] [MAIN ] CLVT: Failed to fetch primary data. [2025-11-03T18:04:09.239877] [WARN ] [MAIN ] CLVT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:04:09.239915] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-11-03T18:04:09.239968] [DEBUG] [LOCAL ] CLVT: No primary data file found to delete. [2025-11-03T18:04:09.240009] [INFO ] [LOCAL ] CLVT: Starting deletion of derivative data. [2025-11-03T18:04:09.240424] [DEBUG] [LOCAL ] CLVT: Deleted derivative data file. [2025-11-03T18:04:09.241579] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLVT took 36.8s. Estimated remaining: 4h 19m 14s. Rate: 7.3 symbols/min [2025-11-03T18:04:09.412508] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:09.454096] [DEBUG] [LOCAL ] CMC: Loaded 46144 existing records from primary storage. [2025-11-03T18:04:09.454411] [INFO ] [MAIN ] CMC: Loaded 46144 existing records. [2025-11-03T18:04:09.542426] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-11-03T18:04:09.634866] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:09.635106] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-11-03T18:04:09.635155] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-11-03T18:04:09.635904] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-11-03T18:04:09.635960] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-11-03T18:04:09.986744] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:10.048377] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T18:04:10.334871] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-11-03T18:04:11.041886] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-11-03T18:04:11.134890] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-11-03T18:04:11.769613] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T18:04:11.934892] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-11-03T18:04:12.211166] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T18:04:12.734896] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-11-03T18:04:13.331377] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T18:04:13.534860] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-11-03T18:04:14.071409] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:04:14.334845] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-11-03T18:04:14.667635] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T18:04:15.134876] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-11-03T18:04:15.625907] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:04:15.934870] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-11-03T18:04:16.378594] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:04:16.734854] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-11-03T18:04:17.189013] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T18:04:17.534901] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-11-03T18:04:17.987763] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T18:04:18.334864] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-11-03T18:04:19.055922] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T18:04:19.134809] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-11-03T18:04:19.654814] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T18:04:19.934847] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-11-03T18:04:20.406202] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T18:04:20.734888] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-11-03T18:04:21.318482] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T18:04:21.534848] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-11. [2025-11-03T18:04:22.082527] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T18:04:22.334843] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-11-03T18:04:22.473316] [DEBUG] [REMOTE ] CM: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:04:22.473719] [WARN ] [REMOTE ] CM: No data returned for month 2025-11 [2025-11-03T18:04:22.473792] [FATAL] [REMOTE ] CM: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:04:22.473864] [FATAL] [MAIN ] CM: Failed to fetch primary data. [2025-11-03T18:04:22.473928] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:04:22.474017] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-11-03T18:04:22.474121] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-11-03T18:04:22.474179] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-11-03T18:04:22.474342] [DEBUG] [LOCAL ] CM: Deleted derivative data file. [2025-11-03T18:04:22.474984] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CM took 31.1s. Estimated remaining: 4h 19m 26s. Rate: 7.3 symbols/min [2025-11-03T18:04:22.684546] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:22.692305] [DEBUG] [LOCAL ] CMCM: Loaded 4837 existing records from primary storage. [2025-11-03T18:04:22.692526] [INFO ] [MAIN ] CMCM: Loaded 4837 existing records. [2025-11-03T18:04:22.902996] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:22.903229] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-11-03T18:04:22.903286] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-11-03T18:04:22.903499] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-11-03T18:04:22.903555] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-11-03T18:04:23.139991] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-11-03T18:04:23.252522] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:23.827043] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T18:04:23.865792] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T18:04:23.934824] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-11-03T18:04:24.734912] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-11-03T18:04:25.109031] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T18:04:25.227741] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-11-03T18:04:25.534857] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-11-03T18:04:26.298521] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T18:04:26.334819] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-11-03T18:04:27.049533] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T18:04:27.134828] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-11-03T18:04:27.934844] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-11-03T18:04:27.987318] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T18:04:28.396378] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T18:04:28.734870] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-11-03T18:04:29.534866] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-11-03T18:04:29.961103] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T18:04:30.090210] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T18:04:30.334852] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-11-03T18:04:31.134860] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-11-03T18:04:31.516291] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T18:04:31.695897] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T18:04:31.934896] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-11-03T18:04:32.734873] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-11-03T18:04:33.074457] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T18:04:33.271727] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T18:04:33.534866] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-11. [2025-11-03T18:04:34.334862] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-11-03T18:04:35.134917] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-11-03T18:04:35.645325] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-11 (2.11 seconds). [2025-11-03T18:04:35.646860] [INFO ] [REMOTE ] CMA: Full fetch complete (73433 records). [2025-11-03T18:04:35.647035] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-11-03T18:04:35.940906] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-11-03T18:04:36.086953] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T18:04:36.146892] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-11-03T18:04:36.145752] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-11-03T18:04:36.155853] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-11-03T18:04:36.157754] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-11-03T18:04:36.157983] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-11-03T18:04:36.160025] [DEBUG] [LOCAL ] CMA: Trimmed 73433 records to 50069 (keeping 200 days of data) [2025-11-03T18:04:36.467291] [DEBUG] [LOCAL ] CMA: Primary data saved (50069 records). [2025-11-03T18:04:36.467424] [INFO ] [MAIN ] CMA: Full history saved. [2025-11-03T18:04:36.468267] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CMA took 31.5s. Estimated remaining: 4h 19m 41s. Rate: 7.3 symbols/min [2025-11-03T18:04:36.572600] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T18:04:36.641699] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:36.641874] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-11-03T18:04:36.641911] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-11-03T18:04:36.642023] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-11-03T18:04:36.642063] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-11-03T18:04:36.642102] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-11-03T18:04:36.642132] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-11-03T18:04:36.743125] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-11-03T18:04:36.994104] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:37.181323] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T18:04:37.534836] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-11-03T18:04:37.686504] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:04:37.686824] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-11-03T18:04:37.686909] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:04:37.687032] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-11-03T18:04:37.687103] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:04:37.687143] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-11-03T18:04:37.687196] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-11-03T18:04:37.687229] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-11-03T18:04:37.687267] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-11-03T18:04:37.687348] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CMDB took 1.2s. Estimated remaining: 4h 19m 5s. Rate: 7.3 symbols/min [2025-11-03T18:04:37.864745] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:37.914569] [DEBUG] [LOCAL ] CMG: Loaded 54503 existing records from primary storage. [2025-11-03T18:04:37.914932] [INFO ] [MAIN ] CMG: Loaded 54503 existing records. [2025-11-03T18:04:38.090102] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:38.090315] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-11-03T18:04:38.090369] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-11-03T18:04:38.091334] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-11-03T18:04:38.091392] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-11-03T18:04:38.339932] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-11-03T18:04:38.442987] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:39.134730] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T18:04:39.134933] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-11-03T18:04:39.566912] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-11-03T18:04:39.934871] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-11-03T18:04:40.707027] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-11-03T18:04:40.734858] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-11-03T18:04:41.534890] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-11-03T18:04:41.776061] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-11-03T18:04:42.334873] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-11-03T18:04:43.134888] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-11-03T18:04:43.193804] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T18:04:43.198137] [DEBUG] [REMOTE ] CMC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-11-03T18:04:43.205290] [WARN ] [REMOTE ] CMC: No data returned for month 2025-09 [2025-11-03T18:04:43.205381] [FATAL] [REMOTE ] CMC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:04:43.205455] [FATAL] [MAIN ] CMC: Failed to fetch primary data. [2025-11-03T18:04:43.205517] [WARN ] [MAIN ] CMC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:04:43.205593] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-11-03T18:04:43.205677] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-11-03T18:04:43.205731] [INFO ] [LOCAL ] CMC: Starting deletion of derivative data. [2025-11-03T18:04:43.205907] [DEBUG] [LOCAL ] CMC: Deleted derivative data file. [2025-11-03T18:04:43.206541] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CMC took 34.0s. Estimated remaining: 4h 18m 46s. Rate: 7.3 symbols/min [2025-11-03T18:04:43.370281] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:43.408198] [DEBUG] [LOCAL ] CMI: Loaded 41900 existing records from primary storage. [2025-11-03T18:04:43.408475] [INFO ] [MAIN ] CMI: Loaded 41900 existing records. [2025-11-03T18:04:43.587229] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:43.587417] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-11-03T18:04:43.587464] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-11-03T18:04:43.588155] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-11-03T18:04:43.588225] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-11-03T18:04:43.936561] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-11-03T18:04:43.941153] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:43.971054] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-11-03T18:04:44.734858] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-11-03T18:04:45.330470] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T18:04:45.463116] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-11-03T18:04:45.534843] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-11-03T18:04:46.334860] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-11-03T18:04:46.950994] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T18:04:47.134157] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-11-03T18:04:47.144368] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-11. [2025-11-03T18:04:47.851029] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-11 (0.71 seconds). [2025-11-03T18:04:47.851963] [INFO ] [REMOTE ] CMCM: Full fetch complete (7051 records). [2025-11-03T18:04:47.852050] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-11-03T18:04:47.940060] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-11-03T18:04:48.287432] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-11-03T18:04:48.287508] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-11-03T18:04:48.287714] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-11-03T18:04:48.287774] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-11-03T18:04:48.288149] [DEBUG] [LOCAL ] CMCM: Trimmed 7051 records to 4815 (keeping 200 days of data) [2025-11-03T18:04:48.313968] [DEBUG] [LOCAL ] CMCM: Primary data saved (4815 records). [2025-11-03T18:04:48.314051] [INFO ] [MAIN ] CMCM: Full history saved. [2025-11-03T18:04:48.314121] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMCM took 25.8s. Estimated remaining: 4h 18m 25s. Rate: 7.3 symbols/min [2025-11-03T18:04:48.480889] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:48.514246] [DEBUG] [LOCAL ] CMP: Loaded 35473 existing records from primary storage. [2025-11-03T18:04:48.514537] [INFO ] [MAIN ] CMP: Loaded 35473 existing records. [2025-11-03T18:04:48.696226] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:48.696446] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-11-03T18:04:48.696506] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-11-03T18:04:48.697146] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-11-03T18:04:48.697205] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-11-03T18:04:48.739946] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-11-03T18:04:49.042538] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:49.534823] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-11-03T18:04:49.928593] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-11-03T18:04:50.316220] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-11-03T18:04:50.334833] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-11. [2025-11-03T18:04:50.582672] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T18:04:51.134891] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-11-03T18:04:51.934888] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-11-03T18:04:52.321733] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-11 (1.99 seconds). [2025-11-03T18:04:52.323964] [INFO ] [REMOTE ] CMBT: Full fetch complete (35937 records). [2025-11-03T18:04:52.324144] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-11-03T18:04:52.487449] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T18:04:52.740087] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-11-03T18:04:52.883839] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-11-03T18:04:52.884173] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-11-03T18:04:52.884840] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-11-03T18:04:52.884922] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-11-03T18:04:52.886366] [DEBUG] [LOCAL ] CMBT: Trimmed 35937 records to 29786 (keeping 200 days of data) [2025-11-03T18:04:52.993318] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T18:04:53.088500] [DEBUG] [LOCAL ] CMBT: Primary data saved (29786 records). [2025-11-03T18:04:53.088633] [INFO ] [MAIN ] CMBT: Full history saved. [2025-11-03T18:04:53.088752] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMBT took 45.1s. Estimated remaining: 4h 18m 4s. Rate: 7.3 symbols/min [2025-11-03T18:04:53.266552] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:04:53.301562] [DEBUG] [LOCAL ] CMPO: Loaded 38168 existing records from primary storage. [2025-11-03T18:04:53.301867] [INFO ] [MAIN ] CMPO: Loaded 38168 existing records. [2025-11-03T18:04:53.495359] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:04:53.495581] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-11-03T18:04:53.495632] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-11-03T18:04:53.496270] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-11-03T18:04:53.496330] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-11-03T18:04:53.542122] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-11-03T18:04:53.873152] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:04:54.334847] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-11-03T18:04:54.396159] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-11-03T18:04:55.018927] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:04:55.134856] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-11-03T18:04:55.661809] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T18:04:55.934857] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-11-03T18:04:56.506349] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T18:04:56.734855] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-11-03T18:04:57.065677] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T18:04:57.534908] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-11-03T18:04:58.208911] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T18:04:58.334853] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-11-03T18:04:58.659210] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:04:59.134869] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-11-03T18:04:59.411683] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T18:04:59.934879] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-11-03T18:05:00.156312] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T18:05:00.734916] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-11-03T18:05:01.534940] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-11-03T18:05:01.688551] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T18:05:01.842356] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T18:05:02.334889] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-11-03T18:05:02.502248] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T18:05:03.134865] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-11-03T18:05:03.344702] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T18:05:03.934861] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-11-03T18:05:04.734854] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-11-03T18:05:05.137543] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T18:05:05.226045] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-11-03T18:05:05.534853] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-11-03T18:05:05.787050] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T18:05:06.334867] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-11-03T18:05:07.134826] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-11-03T18:05:07.380735] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T18:05:07.681053] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-11-03T18:05:07.934853] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-10. [2025-11-03T18:05:08.257135] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-11-03T18:05:08.734878] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-11-03T18:05:09.534865] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-11-03T18:05:10.161897] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-11-03T18:05:10.180184] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T18:05:10.334857] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-11-03T18:05:10.561466] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T18:05:11.134914] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-11. [2025-11-03T18:05:11.357080] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T18:05:11.934867] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-11-03T18:05:12.618806] [DEBUG] [REMOTE ] CMG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:05:12.619139] [WARN ] [REMOTE ] CMG: No data returned for month 2025-11 [2025-11-03T18:05:12.619229] [FATAL] [REMOTE ] CMG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:05:12.619335] [FATAL] [MAIN ] CMG: Failed to fetch primary data. [2025-11-03T18:05:12.619413] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:05:12.619486] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-11-03T18:05:12.619549] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-11-03T18:05:12.619598] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-11-03T18:05:12.619855] [DEBUG] [LOCAL ] CMG: Deleted derivative data file. [2025-11-03T18:05:12.620815] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMG took 34.9s. Estimated remaining: 4h 18m 40s. Rate: 7.3 symbols/min [2025-11-03T18:05:12.739944] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-11-03T18:05:12.809722] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:12.843000] [DEBUG] [LOCAL ] CMRE: Loaded 35544 existing records from primary storage. [2025-11-03T18:05:12.843274] [INFO ] [MAIN ] CMRE: Loaded 35544 existing records. [2025-11-03T18:05:13.016144] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:05:13.016387] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-11-03T18:05:13.016436] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-11-03T18:05:13.017019] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-11-03T18:05:13.017082] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-11-03T18:05:13.381577] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:13.408829] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T18:05:13.534940] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-11-03T18:05:13.846075] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T18:05:14.334878] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-11-03T18:05:14.442817] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T18:05:15.134887] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-11-03T18:05:15.429399] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T18:05:15.934912] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-11-03T18:05:16.135000] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T18:05:16.734819] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-11-03T18:05:17.099415] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T18:05:17.534887] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-11-03T18:05:17.791782] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T18:05:18.334881] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-11-03T18:05:18.692983] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T18:05:19.134967] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-11-03T18:05:19.448354] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T18:05:19.934870] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-11-03T18:05:20.577411] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T18:05:20.734891] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-11. [2025-11-03T18:05:21.228263] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:05:21.534853] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-11-03T18:05:22.334881] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-11-03T18:05:22.705087] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-11 (1.97 seconds). [2025-11-03T18:05:22.706700] [INFO ] [REMOTE ] CMI: Full fetch complete (61239 records). [2025-11-03T18:05:22.706809] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-11-03T18:05:23.107690] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T18:05:23.157503] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-11-03T18:05:23.161857] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-11-03T18:05:23.162339] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-11-03T18:05:23.163188] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-11-03T18:05:23.163339] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-11-03T18:05:23.164705] [DEBUG] [LOCAL ] CMI: Trimmed 61239 records to 41394 (keeping 200 days of data) [2025-11-03T18:05:23.428361] [DEBUG] [LOCAL ] CMI: Primary data saved (41394 records). [2025-11-03T18:05:23.428505] [INFO ] [MAIN ] CMI: Full history saved. [2025-11-03T18:05:23.429323] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMI took 40.2s. Estimated remaining: 4h 18m 43s. Rate: 7.3 symbols/min [2025-11-03T18:05:23.450496] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:05:23.934884] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-11. [2025-11-03T18:05:24.233351] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T18:05:24.734929] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-11-03T18:05:25.316741] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-11 (1.38 seconds). [2025-11-03T18:05:25.318448] [INFO ] [REMOTE ] CMP: Full fetch complete (51188 records). [2025-11-03T18:05:25.318581] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-11-03T18:05:25.556942] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-11. [2025-11-03T18:05:25.720918] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-11-03T18:05:25.721000] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-11-03T18:05:25.721684] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-11-03T18:05:25.721747] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-11-03T18:05:25.722853] [DEBUG] [LOCAL ] CMP: Trimmed 51188 records to 34724 (keeping 200 days of data) [2025-11-03T18:05:25.946076] [DEBUG] [LOCAL ] CMP: Primary data saved (34724 records). [2025-11-03T18:05:25.947110] [INFO ] [MAIN ] CMP: Full history saved. [2025-11-03T18:05:25.946918] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:05:25.947337] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMP took 37.6s. Estimated remaining: 4h 18m 12s. Rate: 7.3 symbols/min [2025-11-03T18:05:26.334893] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-11-03T18:05:27.140421] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-11 (1.58 seconds). [2025-11-03T18:05:27.141914] [INFO ] [REMOTE ] CMPO: Full fetch complete (57431 records). [2025-11-03T18:05:27.142020] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-11-03T18:05:27.536194] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-11-03T18:05:27.536301] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-11-03T18:05:27.537300] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-11-03T18:05:27.537385] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-11-03T18:05:27.558144] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T18:05:27.565353] [DEBUG] [LOCAL ] CMPO: Trimmed 57431 records to 37707 (keeping 200 days of data) [2025-11-03T18:05:27.566293] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-11-03T18:05:27.779108] [DEBUG] [LOCAL ] CMPO: Primary data saved (37707 records). [2025-11-03T18:05:27.779246] [INFO ] [MAIN ] CMPO: Full history saved. [2025-11-03T18:05:27.779324] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMPO took 34.7s. Estimated remaining: 4h 17m 38s. Rate: 7.3 symbols/min [2025-11-03T18:05:28.808562] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T18:05:28.820219] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-11-03T18:05:29.885778] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T18:05:29.897804] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-11-03T18:05:30.697957] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-11-03T18:05:30.705503] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-11-03T18:05:31.785781] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-11-03T18:05:31.799368] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-11. [2025-11-03T18:05:33.207358] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T18:05:33.208544] [INFO ] [REMOTE ] CMRE: Full fetch complete (51233 records). [2025-11-03T18:05:33.208621] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-11-03T18:05:33.639544] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-11-03T18:05:33.639631] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-11-03T18:05:33.640300] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-11-03T18:05:33.640350] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-11-03T18:05:33.641449] [DEBUG] [LOCAL ] CMRE: Trimmed 51233 records to 35048 (keeping 200 days of data) [2025-11-03T18:05:33.854368] [DEBUG] [LOCAL ] CMRE: Primary data saved (35048 records). [2025-11-03T18:05:33.854502] [INFO ] [MAIN ] CMRE: Full history saved. [2025-11-03T18:05:33.854576] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMRE took 21.2s. Estimated remaining: 4h 17m 22s. Rate: 7.3 symbols/min [2025-11-03T18:05:34.407519] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:34.637902] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:34.637106] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:34.615260] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:34.641224] [DEBUG] [LOCAL ] CMS: No existing data file found in primary storage. [2025-11-03T18:05:34.641773] [DEBUG] [LOCAL ] CMSD: Loaded 7433 existing records from primary storage. [2025-11-03T18:05:34.641964] [WARN ] [MAIN ] CMS: No existing data found, performing full refresh instead. [2025-11-03T18:05:34.642736] [INFO ] [MAIN ] CMSD: Loaded 7433 existing records. [2025-11-03T18:05:34.642570] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-11-03T18:05:34.674119] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-11-03T18:05:34.684828] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-11-03T18:05:34.721106] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-11-03T18:05:34.715715] [DEBUG] [LOCAL ] CMSA: Loaded 3435 existing records from primary storage. [2025-11-03T18:05:34.749619] [DEBUG] [LOCAL ] CMSC: Loaded 4623 existing records from primary storage. [2025-11-03T18:05:34.787485] [INFO ] [MAIN ] CMSA: Loaded 3435 existing records. [2025-11-03T18:05:34.798046] [INFO ] [MAIN ] CMSC: Loaded 4623 existing records. [2025-11-03T18:05:35.130534] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:05:35.212893] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-11-03T18:05:35.224173] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-11-03T18:05:35.295624] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-11-03T18:05:35.404432] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-11-03T18:05:35.579214] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:05:35.595306] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:05:35.605288] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-11-03T18:05:35.615821] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-11-03T18:05:35.664959] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-11-03T18:05:35.659752] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-11-03T18:05:35.744983] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:35.769219] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-11-03T18:05:35.745035] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-11-03T18:05:35.769399] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-11-03T18:05:35.769143] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-11-03T18:05:35.783602] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-11-03T18:05:36.499059] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:36.522482] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-11-03T18:05:36.706400] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:36.722828] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-11-03T18:05:36.726870] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:36.727807] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-11-03T18:05:37.223502] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-11-03T18:05:37.237301] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-11-03T18:05:37.236308] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-11-03T18:05:37.246257] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-11-03T18:05:37.247847] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T18:05:37.249894] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-11-03T18:05:37.273263] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T18:05:37.275709] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-11-03T18:05:37.583859] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T18:05:37.586569] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-11-03T18:05:37.593038] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T18:05:37.611108] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-11-03T18:05:38.000988] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-11-03T18:05:38.334917] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-11-03T18:05:38.647249] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-11-03T18:05:38.786765] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-11-03T18:05:39.134875] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-11-03T18:05:39.544807] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T18:05:39.934898] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-11-03T18:05:40.734904] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-11-03T18:05:41.226266] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-11-03T18:05:41.348505] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T18:05:41.534852] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-11-03T18:05:42.046462] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T18:05:42.334852] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-11-03T18:05:42.661864] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-11-03T18:05:43.134852] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-11-03T18:05:43.934832] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-11-03T18:05:44.360610] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-11-03T18:05:44.466296] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:05:44.734899] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-11-03T18:05:45.158404] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-11-03T18:05:45.534855] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-11-03T18:05:45.921675] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T18:05:46.334845] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-11-03T18:05:47.134842] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-11-03T18:05:47.594134] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T18:05:47.928413] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T18:05:47.938810] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-11-03T18:05:48.637721] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T18:05:48.734823] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-11-03T18:05:49.079354] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T18:05:49.534862] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-11-03T18:05:50.014431] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T18:05:50.334871] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-11-03T18:05:50.832166] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-11-03T18:05:51.134867] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-11-03T18:05:51.578112] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T18:05:51.934847] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-11-03T18:05:52.299636] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T18:05:52.734843] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-11-03T18:05:53.091399] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-11-03T18:05:53.534840] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-11-03T18:05:53.904406] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-11-03T18:05:54.334855] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-11-03T18:05:54.764599] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T18:05:55.134841] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-11-03T18:05:55.521008] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-11-03T18:05:55.934841] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-11-03T18:05:56.427895] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T18:05:56.734860] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-11. [2025-11-03T18:05:57.282291] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T18:05:57.282970] [INFO ] [REMOTE ] CMSC: Full fetch complete (6771 records). [2025-11-03T18:05:57.283036] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-11-03T18:05:57.540005] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-11. [2025-11-03T18:05:57.649673] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-11-03T18:05:57.649762] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-11-03T18:05:57.649967] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-11-03T18:05:57.650008] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-11-03T18:05:57.650392] [DEBUG] [LOCAL ] CMSC: Trimmed 6771 records to 4460 (keeping 200 days of data) [2025-11-03T18:05:57.676851] [DEBUG] [LOCAL ] CMSC: Primary data saved (4460 records). [2025-11-03T18:05:57.676968] [INFO ] [MAIN ] CMSC: Full history saved. [2025-11-03T18:05:57.677078] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMSC took 23.8s. Estimated remaining: 4h 18m 15s. Rate: 7.3 symbols/min [2025-11-03T18:05:57.845474] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:57.875438] [DEBUG] [LOCAL ] CMTG: Loaded 34545 existing records from primary storage. [2025-11-03T18:05:57.875726] [INFO ] [MAIN ] CMTG: Loaded 34545 existing records. [2025-11-03T18:05:58.056940] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:05:58.057211] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-11-03T18:05:58.057261] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-11-03T18:05:58.057826] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-11-03T18:05:58.057884] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-11-03T18:05:58.339944] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-11-03T18:05:58.467924] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:58.470607] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T18:05:58.471413] [INFO ] [REMOTE ] CMSD: Full fetch complete (11202 records). [2025-11-03T18:05:58.471481] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-11-03T18:05:58.819146] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-11-03T18:05:58.819225] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-11-03T18:05:58.819487] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-11-03T18:05:58.819525] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-11-03T18:05:58.819983] [DEBUG] [LOCAL ] CMSD: Trimmed 11202 records to 7253 (keeping 200 days of data) [2025-11-03T18:05:58.862036] [DEBUG] [LOCAL ] CMSD: Primary data saved (7253 records). [2025-11-03T18:05:58.862142] [INFO ] [MAIN ] CMSD: Full history saved. [2025-11-03T18:05:58.862214] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMSD took 25.0s. Estimated remaining: 4h 17m 39s. Rate: 7.3 symbols/min [2025-11-03T18:05:59.028461] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:05:59.035213] [DEBUG] [LOCAL ] CMU: Loaded 5865 existing records from primary storage. [2025-11-03T18:05:59.035422] [INFO ] [MAIN ] CMU: Loaded 5865 existing records. [2025-11-03T18:05:59.110438] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T18:05:59.140336] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-11-03T18:05:59.226438] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:05:59.226692] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-11-03T18:05:59.226752] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-11-03T18:05:59.226952] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-11-03T18:05:59.226991] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-11-03T18:05:59.573353] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:05:59.934858] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-11-03T18:06:00.066099] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:06:00.314027] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-11-03T18:06:00.734850] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-11-03T18:06:01.092893] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T18:06:01.534861] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-11-03T18:06:02.334853] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-11-03T18:06:03.134904] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-11-03T18:06:03.205044] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-11-03T18:06:03.435012] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T18:06:03.702075] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-11-03T18:06:03.934851] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-11-03T18:06:04.318194] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-11-03T18:06:04.734852] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-11-03T18:06:05.534857] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-11-03T18:06:05.952750] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T18:06:06.062613] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-11-03T18:06:06.334828] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-11. [2025-11-03T18:06:06.981972] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T18:06:06.982716] [INFO ] [REMOTE ] CMSA: Full fetch complete (4708 records). [2025-11-03T18:06:06.982785] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-11-03T18:06:07.145031] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-11-03T18:06:07.352528] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-11-03T18:06:07.352606] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-11-03T18:06:07.352810] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-11-03T18:06:07.352870] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-11-03T18:06:07.353215] [DEBUG] [LOCAL ] CMSA: Trimmed 4708 records to 3356 (keeping 200 days of data) [2025-11-03T18:06:07.372841] [DEBUG] [LOCAL ] CMSA: Primary data saved (3356 records). [2025-11-03T18:06:07.372915] [INFO ] [MAIN ] CMSA: Full history saved. [2025-11-03T18:06:07.372988] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMSA took 33.5s. Estimated remaining: 4h 17m 32s. Rate: 7.3 symbols/min [2025-11-03T18:06:07.537909] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:06:07.566719] [DEBUG] [LOCAL ] CNA: Loaded 32853 existing records from primary storage. [2025-11-03T18:06:07.566984] [INFO ] [MAIN ] CNA: Loaded 32853 existing records. [2025-11-03T18:06:07.738745] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:06:07.738953] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-11-03T18:06:07.739020] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-11-03T18:06:07.739687] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-11-03T18:06:07.739750] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-11-03T18:06:07.942083] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-11-03T18:06:08.097367] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:06:08.430813] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T18:06:08.734874] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-11-03T18:06:09.278313] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T18:06:09.534896] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-11-03T18:06:09.680416] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:06:10.334897] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-11-03T18:06:10.608340] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T18:06:11.134828] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-11-03T18:06:11.785392] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T18:06:11.934873] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-11-03T18:06:12.051544] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T18:06:12.734857] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-11-03T18:06:12.811951] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T18:06:13.298049] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-11-03T18:06:13.534877] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-11-03T18:06:14.334857] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-11-03T18:06:14.626726] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T18:06:14.779794] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T18:06:15.134860] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-11-03T18:06:15.934888] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-11-03T18:06:16.323909] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T18:06:16.505996] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T18:06:16.734858] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-11-03T18:06:17.326189] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T18:06:17.534915] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-11-03T18:06:18.334871] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-11-03T18:06:18.961580] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T18:06:19.134847] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-11. [2025-11-03T18:06:19.491718] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T18:06:19.934912] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-11-03T18:06:20.284143] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-11 (1.15 seconds). [2025-11-03T18:06:20.285820] [INFO ] [REMOTE ] CMS: Full fetch complete (76272 records). [2025-11-03T18:06:20.285953] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-11-03T18:06:20.396999] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-11-03T18:06:20.688754] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-11-03T18:06:20.688847] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-11-03T18:06:20.689701] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-11-03T18:06:20.689767] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-11-03T18:06:20.691198] [DEBUG] [LOCAL ] CMS: Trimmed 76272 records to 52515 (keeping 200 days of data) [2025-11-03T18:06:20.744498] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-11-03T18:06:21.013079] [DEBUG] [LOCAL ] CMS: Primary data saved (52515 records). [2025-11-03T18:06:21.013216] [INFO ] [MAIN ] CMS: Full history saved. [2025-11-03T18:06:21.013300] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMS took 47.2s. Estimated remaining: 4h 17m 45s. Rate: 7.3 symbols/min [2025-11-03T18:06:21.185822] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:06:21.233063] [DEBUG] [LOCAL ] CNC: Loaded 54560 existing records from primary storage. [2025-11-03T18:06:21.233376] [INFO ] [MAIN ] CNC: Loaded 54560 existing records. [2025-11-03T18:06:21.417166] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:06:21.417401] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-11-03T18:06:21.417450] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-11-03T18:06:21.418313] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-11-03T18:06:21.418371] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-11-03T18:06:21.539983] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-11-03T18:06:21.782029] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:06:21.801055] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T18:06:22.025167] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T18:06:22.334850] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-11-03T18:06:22.690492] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T18:06:23.134827] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-11. [2025-11-03T18:06:23.760454] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-11 (0.63 seconds). [2025-11-03T18:06:23.761136] [INFO ] [REMOTE ] CMU: Full fetch complete (9433 records). [2025-11-03T18:06:23.761207] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-11-03T18:06:23.939979] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-11-03T18:06:24.116892] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-11-03T18:06:24.116968] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-11-03T18:06:24.117224] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-11-03T18:06:24.117284] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-11-03T18:06:24.117717] [DEBUG] [LOCAL ] CMU: Trimmed 9433 records to 5508 (keeping 200 days of data) [2025-11-03T18:06:24.148533] [DEBUG] [LOCAL ] CMU: Primary data saved (5508 records). [2025-11-03T18:06:24.148687] [INFO ] [MAIN ] CMU: Full history saved. [2025-11-03T18:06:24.148781] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMU took 25.3s. Estimated remaining: 4h 17m 17s. Rate: 7.3 symbols/min [2025-11-03T18:06:24.318354] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:06:24.328314] [DEBUG] [LOCAL ] CNF: Loaded 10615 existing records from primary storage. [2025-11-03T18:06:24.328510] [INFO ] [MAIN ] CNF: Loaded 10615 existing records. [2025-11-03T18:06:24.504955] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:06:24.505210] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-11-03T18:06:24.505266] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-11-03T18:06:24.505555] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-11-03T18:06:24.505611] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-11-03T18:06:24.734838] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-11-03T18:06:24.881746] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:06:24.901410] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T18:06:25.534904] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-11-03T18:06:26.106139] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T18:06:26.334852] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-11-03T18:06:26.369404] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T18:06:27.134895] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-11-03T18:06:27.343106] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T18:06:27.618062] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T18:06:27.934876] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-11-03T18:06:28.734884] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-11. [2025-11-03T18:06:29.429870] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T18:06:29.534917] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-11-03T18:06:30.162223] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-11 (1.43 seconds). [2025-11-03T18:06:30.164145] [INFO ] [REMOTE ] CMTG: Full fetch complete (52204 records). [2025-11-03T18:06:30.164318] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-11-03T18:06:30.336259] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-11-03T18:06:30.584578] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-11-03T18:06:30.584757] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-11-03T18:06:30.585475] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-11-03T18:06:30.585618] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-11-03T18:06:30.587132] [DEBUG] [LOCAL ] CMTG: Trimmed 52204 records to 33769 (keeping 200 days of data) [2025-11-03T18:06:30.703214] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T18:06:30.795799] [DEBUG] [LOCAL ] CMTG: Primary data saved (33769 records). [2025-11-03T18:06:30.795926] [INFO ] [MAIN ] CMTG: Full history saved. [2025-11-03T18:06:30.796004] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMTG took 33.1s. Estimated remaining: 4h 17m 3s. Rate: 7.3 symbols/min [2025-11-03T18:06:30.964200] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:06:30.964427] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-11-03T18:06:30.964471] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-11-03T18:06:30.964543] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-11-03T18:06:30.964598] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-11-03T18:06:30.964663] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-11-03T18:06:30.964721] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-11-03T18:06:31.138797] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-11-03T18:06:31.327542] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:06:31.531145] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T18:06:31.826437] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T18:06:31.934857] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-11-03T18:06:32.447607] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T18:06:32.734860] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-11-03T18:06:33.534910] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-11-03T18:06:34.021865] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:06:34.334886] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-11-03T18:06:34.830268] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:06:35.134870] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-11-03T18:06:35.205172] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T18:06:35.539708] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-11-03T18:06:35.934892] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-11-03T18:06:36.734862] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-11-03T18:06:37.028787] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T18:06:37.534859] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-11-03T18:06:38.184228] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-11-03T18:06:38.334840] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-11-03T18:06:38.923236] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T18:06:39.134860] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-11-03T18:06:39.386020] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T18:06:39.934887] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-10. [2025-11-03T18:06:40.416843] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T18:06:40.734923] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-11-03T18:06:40.961955] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:06:41.403636] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-11-03T18:06:41.534883] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-11. [2025-11-03T18:06:42.334896] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-11-03T18:06:42.980021] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-11 (1.45 seconds). [2025-11-03T18:06:42.981613] [INFO ] [REMOTE ] CNA: Full fetch complete (46681 records). [2025-11-03T18:06:42.981740] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-11-03T18:06:43.142825] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-11-03T18:06:43.387400] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-11-03T18:06:43.387505] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-11-03T18:06:43.388297] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-11-03T18:06:43.388366] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-11-03T18:06:43.389720] [DEBUG] [LOCAL ] CNA: Trimmed 46681 records to 32600 (keeping 200 days of data) [2025-11-03T18:06:43.601958] [DEBUG] [LOCAL ] CNA: Primary data saved (32600 records). [2025-11-03T18:06:43.602313] [INFO ] [MAIN ] CNA: Full history saved. [2025-11-03T18:06:43.602555] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CNA took 36.2s. Estimated remaining: 4h 17m 13s. Rate: 7.3 symbols/min [2025-11-03T18:06:43.788236] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:06:43.828587] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-11-03T18:06:43.884144] [DEBUG] [LOCAL ] CNI: Loaded 52304 existing records from primary storage. [2025-11-03T18:06:43.884637] [INFO ] [MAIN ] CNI: Loaded 52304 existing records. [2025-11-03T18:06:43.942541] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-11-03T18:06:44.023008] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T18:06:44.102684] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:06:44.102933] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-11-03T18:06:44.102986] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-11-03T18:06:44.103971] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-11-03T18:06:44.104032] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-11-03T18:06:44.476310] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:06:44.734860] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-11-03T18:06:45.477935] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-11-03T18:06:45.534854] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-11-03T18:06:46.299248] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T18:06:46.334854] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-11-03T18:06:46.962026] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T18:06:47.134837] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-11-03T18:06:47.709425] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T18:06:47.934872] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-11-03T18:06:48.636377] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-11-03T18:06:48.734854] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-11-03T18:06:49.227209] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T18:06:49.534865] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-11-03T18:06:50.057377] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T18:06:50.125630] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T18:06:50.334842] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-11-03T18:06:51.134877] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-11-03T18:06:51.934857] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-11-03T18:06:52.370617] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-11-03T18:06:52.660298] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T18:06:52.734832] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-11-03T18:06:53.159439] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T18:06:53.534860] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-11-03T18:06:54.070376] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:06:54.334908] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-11-03T18:06:55.134899] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-11-03T18:06:55.489226] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-11-03T18:06:55.853290] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T18:06:55.874467] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T18:06:55.934868] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-11-03T18:06:56.734877] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-11-03T18:06:57.541510] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-11-03T18:06:57.561935] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T18:06:58.147238] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T18:06:58.334831] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-11-03T18:06:59.134876] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-11-03T18:06:59.424632] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-11-03T18:06:59.561590] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T18:06:59.796260] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T18:06:59.934864] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-11-03T18:07:00.734874] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-11-03T18:07:01.318800] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-11-03T18:07:01.534885] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-11. [2025-11-03T18:07:01.704461] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-11-03T18:07:02.334862] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-11. [2025-11-03T18:07:02.342006] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T18:07:02.343018] [INFO ] [REMOTE ] CNF: Full fetch complete (12927 records). [2025-11-03T18:07:02.343117] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-11-03T18:07:02.766256] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-11-03T18:07:02.766369] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-11-03T18:07:02.767139] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-11-03T18:07:02.767207] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-11-03T18:07:02.768099] [DEBUG] [LOCAL ] CNF: Trimmed 12927 records to 10562 (keeping 200 days of data) [2025-11-03T18:07:02.838463] [DEBUG] [LOCAL ] CNF: Primary data saved (10562 records). [2025-11-03T18:07:02.838684] [INFO ] [MAIN ] CNF: Full history saved. [2025-11-03T18:07:02.838808] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CNF took 38.7s. Estimated remaining: 4h 17m 47s. Rate: 7.3 symbols/min [2025-11-03T18:07:03.026169] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:03.083241] [DEBUG] [LOCAL ] CNK: Loaded 53619 existing records from primary storage. [2025-11-03T18:07:03.083637] [INFO ] [MAIN ] CNK: Loaded 53619 existing records. [2025-11-03T18:07:03.140126] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-11. [2025-11-03T18:07:03.278888] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:07:03.279305] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-11-03T18:07:03.279368] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-11-03T18:07:03.280877] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-11-03T18:07:03.280958] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-11-03T18:07:03.644899] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:03.780315] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-11 (1.45 seconds). [2025-11-03T18:07:03.782580] [INFO ] [REMOTE ] CNC: Full fetch complete (77872 records). [2025-11-03T18:07:03.783043] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-11-03T18:07:03.943882] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-11-03T18:07:04.204737] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-11-03T18:07:04.204865] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-11-03T18:07:04.206055] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-11-03T18:07:04.206126] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-11-03T18:07:04.208312] [DEBUG] [LOCAL ] CNC: Trimmed 77872 records to 53784 (keeping 200 days of data) [2025-11-03T18:07:04.563065] [DEBUG] [LOCAL ] CNC: Primary data saved (53784 records). [2025-11-03T18:07:04.563267] [INFO ] [MAIN ] CNC: Full history saved. [2025-11-03T18:07:04.564011] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNC took 43.6s. Estimated remaining: 4h 17m 14s. Rate: 7.3 symbols/min [2025-11-03T18:07:04.740182] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-11-03T18:07:04.743826] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:04.805535] [DEBUG] [LOCAL ] CNM: Loaded 51594 existing records from primary storage. [2025-11-03T18:07:04.806084] [INFO ] [MAIN ] CNM: Loaded 51594 existing records. [2025-11-03T18:07:04.990159] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:07:04.990486] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-11-03T18:07:04.990538] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-11-03T18:07:04.991481] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-11-03T18:07:04.991542] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-11-03T18:07:05.368290] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:05.401867] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T18:07:05.403583] [INFO ] [REMOTE ] CNH: Full fetch complete (77705 records). [2025-11-03T18:07:05.403749] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-11-03T18:07:05.545821] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-11-03T18:07:05.811097] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-11-03T18:07:05.845065] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-11-03T18:07:05.845152] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-11-03T18:07:05.846170] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-11-03T18:07:05.846246] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-11-03T18:07:05.847784] [DEBUG] [LOCAL ] CNH: Trimmed 77705 records to 53535 (keeping 200 days of data) [2025-11-03T18:07:06.167807] [DEBUG] [LOCAL ] CNH: Primary data saved (53535 records). [2025-11-03T18:07:06.167942] [INFO ] [MAIN ] CNH: Full history saved. [2025-11-03T18:07:06.168011] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CNH took 35.4s. Estimated remaining: 4h 16m 40s. Rate: 7.3 symbols/min [2025-11-03T18:07:06.341431] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-11-03T18:07:06.344365] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:06.380664] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T18:07:06.415777] [DEBUG] [LOCAL ] CNMD: Loaded 32007 existing records from primary storage. [2025-11-03T18:07:06.416073] [INFO ] [MAIN ] CNMD: Loaded 32007 existing records. [2025-11-03T18:07:06.594791] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:07:06.595007] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-11-03T18:07:06.595056] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-11-03T18:07:06.595736] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-11-03T18:07:06.595797] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-11-03T18:07:06.943970] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:06.980127] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:07:07.134860] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-11-03T18:07:07.622018] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:07:07.934868] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-11-03T18:07:08.261353] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T18:07:08.734901] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-11-03T18:07:09.454357] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T18:07:09.534829] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-11-03T18:07:09.790570] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T18:07:10.334854] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-11-03T18:07:10.862885] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:07:11.134920] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-11-03T18:07:11.457620] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:07:11.934878] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-11-03T18:07:12.587454] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T18:07:12.734971] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-11-03T18:07:12.997318] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T18:07:13.534913] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-11-03T18:07:13.962353] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T18:07:14.334811] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-11-03T18:07:14.472864] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T18:07:15.134847] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-11-03T18:07:15.619137] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:07:15.934854] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-11-03T18:07:16.688846] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-11-03T18:07:16.734842] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-11-03T18:07:17.424244] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-11-03T18:07:17.534845] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-11-03T18:07:18.229390] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T18:07:18.334853] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-11-03T18:07:18.716400] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T18:07:19.134857] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-11-03T18:07:19.651729] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T18:07:19.934861] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-11-03T18:07:20.363223] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T18:07:20.734843] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-11-03T18:07:21.247290] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T18:07:21.534882] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-11-03T18:07:21.867140] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T18:07:22.334881] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-11-03T18:07:22.823332] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:07:23.134909] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-11-03T18:07:23.892059] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T18:07:23.934818] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-11-03T18:07:24.318169] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:07:24.734876] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-11-03T18:07:25.342706] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T18:07:25.534896] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-11. [2025-11-03T18:07:26.203101] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T18:07:26.334866] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-11-03T18:07:27.134866] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-11-03T18:07:27.618114] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-11 (2.08 seconds). [2025-11-03T18:07:27.619693] [INFO ] [REMOTE ] CNK: Full fetch complete (76401 records). [2025-11-03T18:07:27.619816] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-11-03T18:07:27.940605] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-11. [2025-11-03T18:07:27.974831] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-11-03T18:07:28.083063] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-11-03T18:07:28.083144] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-11-03T18:07:28.084008] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-11-03T18:07:28.084073] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-11-03T18:07:28.085563] [DEBUG] [LOCAL ] CNK: Trimmed 76401 records to 52854 (keeping 200 days of data) [2025-11-03T18:07:28.398525] [DEBUG] [LOCAL ] CNK: Primary data saved (52854 records). [2025-11-03T18:07:28.398755] [INFO ] [MAIN ] CNK: Full history saved. [2025-11-03T18:07:28.399452] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNK took 25.6s. Estimated remaining: 4h 17m 25s. Rate: 7.3 symbols/min [2025-11-03T18:07:28.492862] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T18:07:28.645628] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:28.683952] [DEBUG] [LOCAL ] CNNE: Loaded 35722 existing records from primary storage. [2025-11-03T18:07:28.684248] [INFO ] [MAIN ] CNNE: Loaded 35722 existing records. [2025-11-03T18:07:28.741050] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-11-03T18:07:28.885676] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:07:28.885900] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-11-03T18:07:28.885954] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-11-03T18:07:28.886632] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-11-03T18:07:28.886727] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-11-03T18:07:29.232303] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:29.534873] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-11-03T18:07:29.761901] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T18:07:30.310096] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-11 (2.37 seconds). [2025-11-03T18:07:30.311714] [INFO ] [REMOTE ] CNI: Full fetch complete (74822 records). [2025-11-03T18:07:30.311836] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-11-03T18:07:30.345769] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-11-03T18:07:30.707508] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-11-03T18:07:30.707589] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-11-03T18:07:30.708411] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-11-03T18:07:30.708474] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-11-03T18:07:30.709867] [DEBUG] [LOCAL ] CNI: Trimmed 74822 records to 51551 (keeping 200 days of data) [2025-11-03T18:07:31.033821] [DEBUG] [LOCAL ] CNI: Primary data saved (51551 records). [2025-11-03T18:07:31.034090] [INFO ] [MAIN ] CNI: Full history saved. [2025-11-03T18:07:31.034940] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNI took 47.4s. Estimated remaining: 4h 16m 56s. Rate: 7.3 symbols/min [2025-11-03T18:07:31.135508] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-11-03T18:07:31.225590] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-11-03T18:07:31.270356] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:31.270706] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-11-03T18:07:31.270767] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-11-03T18:07:31.270910] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-11-03T18:07:31.270980] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-11-03T18:07:31.271063] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-11-03T18:07:31.271460] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-11-03T18:07:31.582397] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:07:31.687476] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:31.934893] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-11-03T18:07:32.076607] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T18:07:32.734850] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-11-03T18:07:33.165623] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T18:07:33.534845] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-11-03T18:07:33.647344] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T18:07:34.334881] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-11-03T18:07:34.655614] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:07:35.134845] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-11-03T18:07:35.869927] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T18:07:35.934846] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-11. [2025-11-03T18:07:36.233100] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T18:07:36.734862] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-11. [2025-11-03T18:07:37.356555] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-11 (1.42 seconds). [2025-11-03T18:07:37.357866] [INFO ] [REMOTE ] CNMD: Full fetch complete (47484 records). [2025-11-03T18:07:37.357963] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-11-03T18:07:37.536936] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-11-03T18:07:37.757050] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-11-03T18:07:37.757174] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-11-03T18:07:37.758023] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-11-03T18:07:37.758093] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-11-03T18:07:37.759306] [DEBUG] [LOCAL ] CNMD: Trimmed 47484 records to 31493 (keeping 200 days of data) [2025-11-03T18:07:37.961446] [DEBUG] [LOCAL ] CNMD: Primary data saved (31493 records). [2025-11-03T18:07:37.961618] [INFO ] [MAIN ] CNMD: Full history saved. [2025-11-03T18:07:37.961744] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNMD took 31.8s. Estimated remaining: 4h 16m 43s. Rate: 7.3 symbols/min [2025-11-03T18:07:38.134572] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:38.134789] [DEBUG] [LOCAL ] CNP: No existing data file found in primary storage. [2025-11-03T18:07:38.134834] [WARN ] [MAIN ] CNP: No existing data found, performing full refresh instead. [2025-11-03T18:07:38.134945] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-11-03T18:07:38.134987] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-11-03T18:07:38.135029] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-11-03T18:07:38.135062] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-11-03T18:07:38.343378] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-11-03T18:07:38.504570] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:38.787758] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-11 (2.05 seconds). [2025-11-03T18:07:38.790209] [INFO ] [REMOTE ] CNM: Full fetch complete (73649 records). [2025-11-03T18:07:38.790329] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-11-03T18:07:39.030566] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T18:07:39.143380] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-11-03T18:07:39.282221] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-11-03T18:07:39.282299] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-11-03T18:07:39.283154] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-11-03T18:07:39.283218] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-11-03T18:07:39.284547] [DEBUG] [LOCAL ] CNM: Trimmed 73649 records to 50862 (keeping 200 days of data) [2025-11-03T18:07:39.583693] [DEBUG] [LOCAL ] CNM: Primary data saved (50862 records). [2025-11-03T18:07:39.583901] [INFO ] [MAIN ] CNM: Full history saved. [2025-11-03T18:07:39.584678] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNM took 35.0s. Estimated remaining: 4h 16m 9s. Rate: 7.3 symbols/min [2025-11-03T18:07:39.682899] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T18:07:39.788336] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:39.788527] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-11-03T18:07:39.788564] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-11-03T18:07:39.788702] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-11-03T18:07:39.788773] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-11-03T18:07:39.788816] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-11-03T18:07:39.788849] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-11-03T18:07:39.940109] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-11-03T18:07:40.162219] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:07:40.705868] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T18:07:40.734865] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-11-03T18:07:41.350066] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T18:07:41.534876] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-11-03T18:07:42.251712] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T18:07:42.334862] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-11-03T18:07:42.695367] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T18:07:43.134868] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-11-03T18:07:43.488105] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T18:07:43.934848] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-11-03T18:07:44.543607] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T18:07:44.734831] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-11-03T18:07:44.955627] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T18:07:45.534861] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-11-03T18:07:45.824234] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T18:07:46.334899] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-11-03T18:07:47.111777] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-11-03T18:07:47.134818] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-11-03T18:07:47.332415] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-11-03T18:07:47.934843] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-11-03T18:07:48.699043] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T18:07:48.734819] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-11-03T18:07:49.145724] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T18:07:49.534905] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-11-03T18:07:50.150133] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T18:07:50.334856] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-11-03T18:07:50.682211] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:07:51.134849] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-11-03T18:07:51.824249] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T18:07:51.934823] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-11-03T18:07:52.351892] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:07:52.734860] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-11-03T18:07:53.363190] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T18:07:53.534851] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-11-03T18:07:53.801276] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T18:07:54.334890] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-11-03T18:07:54.777903] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T18:07:55.134842] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-11-03T18:07:55.742963] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T18:07:55.934812] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-11-03T18:07:56.134863] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T18:07:56.734839] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-11-03T18:07:57.146569] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T18:07:57.534847] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-11. [2025-11-03T18:07:57.970168] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T18:07:58.334845] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-11-03T18:07:58.988326] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-11 (1.45 seconds). [2025-11-03T18:07:58.989482] [INFO ] [REMOTE ] CNNE: Full fetch complete (50810 records). [2025-11-03T18:07:58.989556] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-11-03T18:07:59.160346] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-11-03T18:07:59.372265] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-11-03T18:07:59.372346] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-11-03T18:07:59.372989] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-11-03T18:07:59.373050] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-11-03T18:07:59.374035] [DEBUG] [LOCAL ] CNNE: Trimmed 50810 records to 35087 (keeping 200 days of data) [2025-11-03T18:07:59.581876] [DEBUG] [LOCAL ] CNNE: Primary data saved (35087 records). [2025-11-03T18:07:59.582011] [INFO ] [MAIN ] CNNE: Full history saved. [2025-11-03T18:07:59.582135] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNNE took 31.2s. Estimated remaining: 4h 16m 46s. Rate: 7.3 symbols/min [2025-11-03T18:07:59.754253] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:07:59.793714] [DEBUG] [LOCAL ] CNR: Loaded 44208 existing records from primary storage. [2025-11-03T18:07:59.793978] [INFO ] [MAIN ] CNR: Loaded 44208 existing records. [2025-11-03T18:07:59.952854] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-11-03T18:07:59.993984] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:07:59.994986] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-11-03T18:07:59.995059] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-11-03T18:07:59.995852] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-11-03T18:08:00.027605] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-11-03T18:08:00.062134] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-11-03T18:08:00.391926] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:00.734880] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-11-03T18:08:00.847737] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T18:08:01.204765] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T18:08:01.534859] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-11. [2025-11-03T18:08:01.788832] [DEBUG] [REMOTE ] CNP: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:08:01.789194] [WARN ] [REMOTE ] CNP: No data returned for month 2025-11 [2025-11-03T18:08:01.789330] [FATAL] [REMOTE ] CNP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:08:01.789444] [FATAL] [MAIN ] CNP: Failed to fetch primary data. [2025-11-03T18:08:01.789522] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:08:01.789605] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-11-03T18:08:01.789714] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-11-03T18:08:01.789775] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-11-03T18:08:01.789827] [DEBUG] [LOCAL ] CNP: No derivative data file found to delete. [2025-11-03T18:08:01.789885] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNP took 23.8s. Estimated remaining: 4h 16m 15s. Rate: 7.3 symbols/min [2025-11-03T18:08:01.977507] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:01.997785] [DEBUG] [LOCAL ] CNS: Loaded 21557 existing records from primary storage. [2025-11-03T18:08:01.998030] [INFO ] [MAIN ] CNS: Loaded 21557 existing records. [2025-11-03T18:08:02.181314] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:08:02.181706] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-11-03T18:08:02.181766] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-11-03T18:08:02.182175] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-11-03T18:08:02.182232] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-11-03T18:08:02.339295] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-11-03T18:08:02.359697] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T18:08:02.600998] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:03.134895] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-11-03T18:08:03.518594] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:08:03.934845] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-11-03T18:08:04.082379] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:08:04.734917] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-11-03T18:08:05.410330] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T18:08:05.534822] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-11. [2025-11-03T18:08:05.600039] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T18:08:06.334852] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-11-03T18:08:07.134849] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-11-03T18:08:07.341574] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T18:08:07.342910] [INFO ] [REMOTE ] CNO: Full fetch complete (60495 records). [2025-11-03T18:08:07.342999] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-11-03T18:08:07.713267] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T18:08:07.808124] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-11-03T18:08:07.808217] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-11-03T18:08:07.808971] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-11-03T18:08:07.809037] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-11-03T18:08:07.810395] [DEBUG] [LOCAL ] CNO: Trimmed 60495 records to 39810 (keeping 200 days of data) [2025-11-03T18:08:07.979335] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-11-03T18:08:08.048379] [DEBUG] [LOCAL ] CNO: Primary data saved (39810 records). [2025-11-03T18:08:08.048520] [INFO ] [MAIN ] CNO: Full history saved. [2025-11-03T18:08:08.048593] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNO took 37.0s. Estimated remaining: 4h 15m 59s. Rate: 7.3 symbols/min [2025-11-03T18:08:08.220632] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:08.220947] [DEBUG] [LOCAL ] CNX: No existing data file found in primary storage. [2025-11-03T18:08:08.220998] [WARN ] [MAIN ] CNX: No existing data found, performing full refresh instead. [2025-11-03T18:08:08.221115] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-11-03T18:08:08.221156] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-11-03T18:08:08.221198] [DEBUG] [LOCAL ] CNX: No primary data file found to delete. [2025-11-03T18:08:08.221230] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-11-03T18:08:08.580134] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:08.628173] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T18:08:08.709144] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T18:08:08.734876] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-11-03T18:08:09.534872] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-11-03T18:08:10.265343] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-11-03T18:08:10.334829] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-11-03T18:08:10.482997] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-11-03T18:08:11.134904] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-11-03T18:08:11.795032] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T18:08:11.934870] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-11-03T18:08:12.330568] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T18:08:12.734930] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-11-03T18:08:12.758297] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T18:08:13.534902] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-11-03T18:08:14.047401] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:08:14.334889] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-11-03T18:08:14.744389] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T18:08:15.018514] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T18:08:15.134857] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-11-03T18:08:15.928132] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T18:08:15.934799] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-11-03T18:08:16.734818] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-11-03T18:08:16.864286] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T18:08:17.534897] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-11-03T18:08:18.334820] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-11-03T18:08:18.591064] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-11-03T18:08:18.661469] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T18:08:18.997155] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T18:08:19.134865] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-11-03T18:08:19.934917] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-11-03T18:08:20.528191] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T18:08:20.684221] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-11-03T18:08:20.734824] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-11-03T18:08:21.534863] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-11-03T18:08:21.788591] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-11-03T18:08:22.334900] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-11. [2025-11-03T18:08:22.886943] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T18:08:23.041377] [DEBUG] [REMOTE ] CNS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:08:23.041948] [WARN ] [REMOTE ] CNS: No data returned for month 2025-11 [2025-11-03T18:08:23.042080] [FATAL] [REMOTE ] CNS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:08:23.042204] [FATAL] [MAIN ] CNS: Failed to fetch primary data. [2025-11-03T18:08:23.042274] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:08:23.042359] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-11-03T18:08:23.042437] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-11-03T18:08:23.042477] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-11-03T18:08:23.042744] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-11-03T18:08:23.042849] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNS took 21.3s. Estimated remaining: 4h 16m 16s. Rate: 7.3 symbols/min [2025-11-03T18:08:23.140026] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-11-03T18:08:23.239419] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:23.280965] [DEBUG] [LOCAL ] CODI: Loaded 42881 existing records from primary storage. [2025-11-03T18:08:23.281390] [INFO ] [MAIN ] CODI: Loaded 42881 existing records. [2025-11-03T18:08:23.477066] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:08:23.477502] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-11-03T18:08:23.477572] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-11-03T18:08:23.478374] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-11-03T18:08:23.478438] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-11-03T18:08:23.882764] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:23.934843] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-11-03T18:08:24.366146] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:08:24.734936] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-11-03T18:08:25.312891] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T18:08:25.534953] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-11. [2025-11-03T18:08:25.715095] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T18:08:26.334948] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-11-03T18:08:27.082949] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T18:08:27.134888] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-11-03T18:08:27.682290] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-11 (2.15 seconds). [2025-11-03T18:08:27.684279] [INFO ] [REMOTE ] CNQ: Full fetch complete (77731 records). [2025-11-03T18:08:27.684397] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-11-03T18:08:27.943009] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-11-03T18:08:28.114760] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-11-03T18:08:28.114896] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-11-03T18:08:28.116339] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-11-03T18:08:28.116415] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-11-03T18:08:28.118883] [DEBUG] [LOCAL ] CNQ: Trimmed 77731 records to 53570 (keeping 200 days of data) [2025-11-03T18:08:28.472565] [DEBUG] [LOCAL ] CNQ: Primary data saved (53570 records). [2025-11-03T18:08:28.472807] [INFO ] [MAIN ] CNQ: Full history saved. [2025-11-03T18:08:28.472923] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNQ took 48.9s. Estimated remaining: 4h 15m 58s. Rate: 7.3 symbols/min [2025-11-03T18:08:28.626922] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T18:08:28.711696] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:28.711965] [DEBUG] [LOCAL ] COF: No existing data file found in primary storage. [2025-11-03T18:08:28.712006] [WARN ] [MAIN ] COF: No existing data found, performing full refresh instead. [2025-11-03T18:08:28.712141] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-11-03T18:08:28.712187] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-11-03T18:08:28.712232] [DEBUG] [LOCAL ] COF: No primary data file found to delete. [2025-11-03T18:08:28.712266] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-11-03T18:08:28.743745] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-11-03T18:08:29.091035] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-11-03T18:08:29.139086] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:29.534894] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-11-03T18:08:30.205853] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T18:08:30.334852] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-11-03T18:08:31.007758] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T18:08:31.134892] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-11-03T18:08:31.564215] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T18:08:31.934863] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-11-03T18:08:32.304555] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T18:08:32.734866] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-11-03T18:08:32.885290] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T18:08:33.534891] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-11-03T18:08:33.849230] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T18:08:34.334888] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-11-03T18:08:34.661064] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T18:08:35.134870] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-11-03T18:08:35.625596] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T18:08:35.934872] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-11-03T18:08:36.432839] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:08:36.734909] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-11-03T18:08:37.364181] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T18:08:37.534848] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-11-03T18:08:37.949169] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T18:08:38.334961] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-11-03T18:08:39.033476] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T18:08:39.134854] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-11-03T18:08:39.905103] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T18:08:39.934829] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-11. [2025-11-03T18:08:40.498702] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T18:08:40.734882] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-11-03T18:08:41.534973] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-11-03T18:08:41.917499] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T18:08:41.918891] [INFO ] [REMOTE ] CNR: Full fetch complete (64631 records). [2025-11-03T18:08:41.918986] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-11-03T18:08:42.330013] [DEBUG] [VALIDATOR ] CNR: All expected trading days are present. [2025-11-03T18:08:42.330124] [DEBUG] [VALIDATOR ] CNR: Primary data validation passed. [2025-11-03T18:08:42.330973] [INFO ] [MAIN ] CNR: Fetched primary data is valid. [2025-11-03T18:08:42.331118] [DEBUG] [LOCAL ] CNR: Saving primary data. [2025-11-03T18:08:42.332524] [DEBUG] [LOCAL ] CNR: Trimmed 64631 records to 43624 (keeping 200 days of data) [2025-11-03T18:08:42.334855] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-11-03T18:08:42.574441] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-11-03T18:08:42.639236] [DEBUG] [LOCAL ] CNR: Primary data saved (43624 records). [2025-11-03T18:08:42.639367] [INFO ] [MAIN ] CNR: Full history saved. [2025-11-03T18:08:42.640199] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNR took 43.1s. Estimated remaining: 4h 16m 12s. Rate: 7.3 symbols/min [2025-11-03T18:08:42.810087] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:42.860629] [DEBUG] [LOCAL ] COHR: Loaded 54148 existing records from primary storage. [2025-11-03T18:08:42.860998] [INFO ] [MAIN ] COHR: Loaded 54148 existing records. [2025-11-03T18:08:43.042943] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:08:43.043307] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-11-03T18:08:43.043409] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-11-03T18:08:43.044318] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-11-03T18:08:43.044376] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-11-03T18:08:43.139983] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-11-03T18:08:43.262163] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-11-03T18:08:43.457367] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:43.844936] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T18:08:43.934881] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-11. [2025-11-03T18:08:44.734866] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-11-03T18:08:44.959858] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-11-03T18:08:45.534854] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-11-03T18:08:45.842617] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-11 (1.91 seconds). [2025-11-03T18:08:45.844394] [INFO ] [REMOTE ] CNX: Full fetch complete (74880 records). [2025-11-03T18:08:45.844531] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-11-03T18:08:46.279784] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-11-03T18:08:46.280040] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-11-03T18:08:46.280915] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-11-03T18:08:46.281125] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-11-03T18:08:46.283345] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T18:08:46.294714] [DEBUG] [LOCAL ] CNX: Trimmed 74880 records to 51287 (keeping 200 days of data) [2025-11-03T18:08:46.341248] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-11-03T18:08:46.588125] [DEBUG] [LOCAL ] CNX: Primary data saved (51287 records). [2025-11-03T18:08:46.588263] [INFO ] [MAIN ] CNX: Full history saved. [2025-11-03T18:08:46.588333] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CNX took 38.5s. Estimated remaining: 4h 15m 47s. Rate: 7.3 symbols/min [2025-11-03T18:08:46.757729] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:46.757917] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-11-03T18:08:46.757955] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-11-03T18:08:46.758065] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-11-03T18:08:46.758105] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-11-03T18:08:46.758145] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-11-03T18:08:46.758179] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-11-03T18:08:47.104443] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:47.134856] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-11-03T18:08:47.344394] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-11-03T18:08:47.551908] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:08:47.934927] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-11-03T18:08:48.495889] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:08:48.734918] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-11-03T18:08:49.427910] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T18:08:49.534817] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-11-03T18:08:49.831377] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T18:08:50.334909] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-11-03T18:08:50.972085] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T18:08:51.134834] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-11-03T18:08:51.492695] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T18:08:51.934880] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-11-03T18:08:52.734923] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-11-03T18:08:53.159093] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-11-03T18:08:53.449033] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T18:08:53.534809] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-11-03T18:08:53.773856] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T18:08:54.334846] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-11. [2025-11-03T18:08:54.921728] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-11-03T18:08:55.134892] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-11-03T18:08:55.934862] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-11-03T18:08:56.734835] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-11-03T18:08:56.874906] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-11-03T18:08:57.074070] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-11 (2.74 seconds). [2025-11-03T18:08:57.076071] [INFO ] [REMOTE ] COF: Full fetch complete (77721 records). [2025-11-03T18:08:57.076201] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-11-03T18:08:57.487533] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-11-03T18:08:57.487720] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-11-03T18:08:57.488718] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-11-03T18:08:57.488899] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-11-03T18:08:57.490340] [DEBUG] [LOCAL ] COF: Trimmed 77721 records to 53629 (keeping 200 days of data) [2025-11-03T18:08:57.544533] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-11. [2025-11-03T18:08:57.739936] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-11-03T18:08:57.860807] [DEBUG] [LOCAL ] COF: Primary data saved (53629 records). [2025-11-03T18:08:57.860933] [INFO ] [MAIN ] COF: Full history saved. [2025-11-03T18:08:57.861002] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. COF took 29.4s. Estimated remaining: 4h 15m 51s. Rate: 7.3 symbols/min [2025-11-03T18:08:58.031962] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:08:58.078268] [DEBUG] [LOCAL ] COMP: Loaded 54168 existing records from primary storage. [2025-11-03T18:08:58.078569] [INFO ] [MAIN ] COMP: Loaded 54168 existing records. [2025-11-03T18:08:58.256172] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:08:58.256501] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-11-03T18:08:58.256561] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-11-03T18:08:58.272123] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-11-03T18:08:58.282176] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-11-03T18:08:58.344323] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-11-03T18:08:58.375040] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-11-03T18:08:58.644175] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:08:59.134903] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-11-03T18:08:59.735362] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-11 (2.19 seconds). [2025-11-03T18:08:59.736897] [INFO ] [REMOTE ] CODI: Full fetch complete (55128 records). [2025-11-03T18:08:59.737297] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-11-03T18:08:59.935161] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-11-03T18:09:00.123701] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-11-03T18:09:00.123884] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-11-03T18:09:00.124599] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-11-03T18:09:00.124700] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-11-03T18:09:00.153034] [DEBUG] [LOCAL ] CODI: Trimmed 55128 records to 42545 (keeping 200 days of data) [2025-11-03T18:09:00.154925] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-11-03T18:09:00.391177] [DEBUG] [LOCAL ] CODI: Primary data saved (42545 records). [2025-11-03T18:09:00.391291] [INFO ] [MAIN ] CODI: Full history saved. [2025-11-03T18:09:00.391365] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. CODI took 37.3s. Estimated remaining: 4h 15m 21s. Rate: 7.3 symbols/min [2025-11-03T18:09:00.573687] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:00.606786] [DEBUG] [LOCAL ] CON: Loaded 39030 existing records from primary storage. [2025-11-03T18:09:00.607104] [INFO ] [MAIN ] CON: Loaded 39030 existing records. [2025-11-03T18:09:00.743622] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-11-03T18:09:00.784789] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:00.785048] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-11-03T18:09:00.785109] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-11-03T18:09:00.785805] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-11-03T18:09:00.785863] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-11-03T18:09:01.143527] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:01.171480] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-11-03T18:09:01.534819] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-11-03T18:09:01.709748] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-11-03T18:09:02.334872] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-11-03T18:09:02.472631] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-11-03T18:09:02.842329] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T18:09:03.134856] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-11-03T18:09:03.444407] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T18:09:03.934903] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-11-03T18:09:04.446893] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T18:09:04.734890] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-11-03T18:09:04.835323] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-11-03T18:09:05.534873] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-11-03T18:09:06.229530] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T18:09:06.334847] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-11-03T18:09:07.057812] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T18:09:07.134820] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-11-03T18:09:07.655667] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:09:07.934865] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-11-03T18:09:08.264837] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T18:09:08.734873] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-11-03T18:09:09.363008] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T18:09:09.534861] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-11-03T18:09:10.206114] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T18:09:10.334843] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-11-03T18:09:10.817703] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T18:09:11.134839] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-11-03T18:09:11.915914] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-11-03T18:09:11.934808] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-11-03T18:09:12.675418] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T18:09:12.734920] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-11-03T18:09:13.534933] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-11-03T18:09:13.759863] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-11-03T18:09:14.129137] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T18:09:14.334868] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-11-03T18:09:14.992490] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T18:09:15.134840] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-11-03T18:09:15.934853] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-11-03T18:09:16.280466] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-11-03T18:09:16.327759] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T18:09:16.734886] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-11. [2025-11-03T18:09:17.079349] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T18:09:17.534911] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-11-03T18:09:18.334909] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-11-03T18:09:18.941309] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T18:09:19.134865] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-11-03T18:09:19.322147] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-11 (2.59 seconds). [2025-11-03T18:09:19.323696] [INFO ] [REMOTE ] COHR: Full fetch complete (77474 records). [2025-11-03T18:09:19.323826] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-11-03T18:09:19.732227] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T18:09:19.762588] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-11-03T18:09:19.762828] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-11-03T18:09:19.763850] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-11-03T18:09:19.764233] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-11-03T18:09:19.765715] [DEBUG] [LOCAL ] COHR: Trimmed 77474 records to 53379 (keeping 200 days of data) [2025-11-03T18:09:19.942454] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-11-03T18:09:20.086782] [DEBUG] [LOCAL ] COHR: Primary data saved (53379 records). [2025-11-03T18:09:20.086929] [INFO ] [MAIN ] COHR: Full history saved. [2025-11-03T18:09:20.088054] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. COHR took 37.4s. Estimated remaining: 4h 15m 55s. Rate: 7.3 symbols/min [2025-11-03T18:09:20.277991] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:20.301374] [DEBUG] [LOCAL ] COOK: Loaded 25025 existing records from primary storage. [2025-11-03T18:09:20.301665] [INFO ] [MAIN ] COOK: Loaded 25025 existing records. [2025-11-03T18:09:20.481161] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:20.481375] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-11-03T18:09:20.481487] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-11-03T18:09:20.482078] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-11-03T18:09:20.482175] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-11-03T18:09:20.736611] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-11-03T18:09:20.903108] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-11-03T18:09:20.907246] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:21.238814] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T18:09:21.534865] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-11-03T18:09:21.834216] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T18:09:22.334894] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-11. [2025-11-03T18:09:22.745842] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T18:09:23.134862] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-11-03T18:09:23.934868] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-11-03T18:09:24.523959] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T18:09:24.707155] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-11 (2.37 seconds). [2025-11-03T18:09:24.708668] [INFO ] [REMOTE ] COLD: Full fetch complete (75151 records). [2025-11-03T18:09:24.708808] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-11-03T18:09:24.740085] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-11. [2025-11-03T18:09:24.840698] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T18:09:25.133481] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-11-03T18:09:25.133565] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-11-03T18:09:25.134445] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-11-03T18:09:25.134529] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-11-03T18:09:25.136158] [DEBUG] [LOCAL ] COLD: Trimmed 75151 records to 52554 (keeping 200 days of data) [2025-11-03T18:09:25.470483] [DEBUG] [LOCAL ] COLD: Primary data saved (52554 records). [2025-11-03T18:09:25.470675] [INFO ] [MAIN ] COLD: Full history saved. [2025-11-03T18:09:25.470781] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. COLD took 38.9s. Estimated remaining: 4h 15m 36s. Rate: 7.3 symbols/min [2025-11-03T18:09:25.540010] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-11-03T18:09:25.646162] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:25.692664] [DEBUG] [LOCAL ] COP: Loaded 54507 existing records from primary storage. [2025-11-03T18:09:25.693003] [INFO ] [MAIN ] COP: Loaded 54507 existing records. [2025-11-03T18:09:25.866943] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:25.867190] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-11-03T18:09:25.867239] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-11-03T18:09:25.868106] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-11-03T18:09:25.868164] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-11-03T18:09:26.230129] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:26.236597] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:09:26.334858] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-11-03T18:09:27.135082] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-11-03T18:09:27.139303] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-11-03T18:09:27.350637] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-11 (2.61 seconds). [2025-11-03T18:09:27.352404] [INFO ] [REMOTE ] COMP: Full fetch complete (77414 records). [2025-11-03T18:09:27.352502] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-11-03T18:09:27.759749] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-11-03T18:09:27.759843] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-11-03T18:09:27.760732] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-11-03T18:09:27.760797] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-11-03T18:09:27.762255] [DEBUG] [LOCAL ] COMP: Trimmed 77414 records to 53390 (keeping 200 days of data) [2025-11-03T18:09:27.953084] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-11-03T18:09:28.061715] [DEBUG] [LOCAL ] COMP: Primary data saved (53390 records). [2025-11-03T18:09:28.061850] [INFO ] [MAIN ] COMP: Full history saved. [2025-11-03T18:09:28.062819] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COMP took 30.2s. Estimated remaining: 4h 15m 7s. Rate: 7.3 symbols/min [2025-11-03T18:09:28.229139] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:28.269700] [DEBUG] [LOCAL ] COR: Loaded 46535 existing records from primary storage. [2025-11-03T18:09:28.269988] [INFO ] [MAIN ] COR: Loaded 46535 existing records. [2025-11-03T18:09:28.447617] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:28.447858] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-11-03T18:09:28.447912] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-11-03T18:09:28.448830] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-11-03T18:09:28.448887] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-11-03T18:09:28.761235] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-11-03T18:09:28.801357] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:28.845384] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-11-03T18:09:29.199578] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T18:09:29.443688] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-11-03T18:09:29.534875] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-11-03T18:09:30.334878] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-11-03T18:09:30.976421] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:09:31.134871] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-11-03T18:09:31.192477] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-11-03T18:09:31.934912] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-11-03T18:09:32.238831] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:09:32.734952] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-11-03T18:09:33.310418] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T18:09:33.534909] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-11-03T18:09:34.036307] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T18:09:34.334917] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-11-03T18:09:35.094767] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T18:09:35.134899] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-11-03T18:09:35.460799] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T18:09:35.934876] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-11-03T18:09:36.312209] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:09:36.734901] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-11-03T18:09:36.994490] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T18:09:37.534924] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-11-03T18:09:38.273834] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T18:09:38.334851] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-11-03T18:09:38.851416] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T18:09:39.037241] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-11-03T18:09:39.134866] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-11-03T18:09:39.934932] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-11. [2025-11-03T18:09:40.055232] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T18:09:40.734924] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-11-03T18:09:41.507469] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-11 (1.57 seconds). [2025-11-03T18:09:41.509213] [INFO ] [REMOTE ] CON: Full fetch complete (56541 records). [2025-11-03T18:09:41.509304] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-11-03T18:09:41.542604] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-11-03T18:09:41.929175] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-11-03T18:09:41.929296] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-11-03T18:09:41.930286] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-11-03T18:09:41.930354] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-11-03T18:09:41.932116] [DEBUG] [LOCAL ] CON: Trimmed 56541 records to 38454 (keeping 200 days of data) [2025-11-03T18:09:42.176303] [DEBUG] [LOCAL ] CON: Primary data saved (38454 records). [2025-11-03T18:09:42.176515] [INFO ] [MAIN ] CON: Full history saved. [2025-11-03T18:09:42.176680] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. CON took 41.8s. Estimated remaining: 4h 15m 21s. Rate: 7.3 symbols/min [2025-11-03T18:09:42.344233] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-11-03T18:09:42.385949] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:42.441005] [DEBUG] [LOCAL ] COTY: Loaded 54015 existing records from primary storage. [2025-11-03T18:09:42.441579] [INFO ] [MAIN ] COTY: Loaded 54015 existing records. [2025-11-03T18:09:42.648782] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:42.667386] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-11-03T18:09:42.677433] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-11-03T18:09:42.683254] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-11-03T18:09:42.683166] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-11-03T18:09:42.683496] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-11-03T18:09:43.117263] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:43.134926] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-11-03T18:09:43.136580] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:09:43.177102] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T18:09:43.934902] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-11-03T18:09:44.537677] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T18:09:44.734890] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-11-03T18:09:45.534826] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-11-03T18:09:45.582120] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-11-03T18:09:45.596217] [DEBUG] [REMOTE ] COR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-11-03T18:09:45.596599] [WARN ] [REMOTE ] COR: No data returned for month 2025-06 [2025-11-03T18:09:45.596729] [FATAL] [REMOTE ] COR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:09:45.596812] [FATAL] [MAIN ] COR: Failed to fetch primary data. [2025-11-03T18:09:45.596877] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:09:45.596955] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-11-03T18:09:45.597034] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-11-03T18:09:45.597137] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-11-03T18:09:45.597431] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-11-03T18:09:45.598277] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. COR took 17.5s. Estimated remaining: 4h 14m 55s. Rate: 7.3 symbols/min [2025-11-03T18:09:45.729050] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T18:09:45.807731] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:45.858538] [DEBUG] [LOCAL ] COUR: Loaded 50214 existing records from primary storage. [2025-11-03T18:09:45.858959] [INFO ] [MAIN ] COUR: Loaded 50214 existing records. [2025-11-03T18:09:46.050630] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:46.050893] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-11-03T18:09:46.050943] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-11-03T18:09:46.052200] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-11-03T18:09:46.052460] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-11-03T18:09:46.340069] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-11. [2025-11-03T18:09:46.441179] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:47.134896] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-11-03T18:09:47.756402] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-11 (1.42 seconds). [2025-11-03T18:09:47.758360] [INFO ] [REMOTE ] COOK: Full fetch complete (33364 records). [2025-11-03T18:09:47.758462] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-11-03T18:09:47.948158] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-11-03T18:09:48.158939] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-11-03T18:09:48.159042] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-11-03T18:09:48.159906] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-11-03T18:09:48.159974] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-11-03T18:09:48.161109] [DEBUG] [LOCAL ] COOK: Trimmed 33364 records to 24873 (keeping 200 days of data) [2025-11-03T18:09:48.311454] [DEBUG] [LOCAL ] COOK: Primary data saved (24873 records). [2025-11-03T18:09:48.311637] [INFO ] [MAIN ] COOK: Full history saved. [2025-11-03T18:09:48.311815] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. COOK took 28.2s. Estimated remaining: 4h 14m 27s. Rate: 7.3 symbols/min [2025-11-03T18:09:48.492205] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:09:48.533626] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T18:09:48.592069] [DEBUG] [LOCAL ] CP: Loaded 53980 existing records from primary storage. [2025-11-03T18:09:48.592502] [INFO ] [MAIN ] CP: Loaded 53980 existing records. [2025-11-03T18:09:48.740038] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-11-03T18:09:48.780510] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:09:48.780854] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-11-03T18:09:48.780910] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-11-03T18:09:48.781977] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-11-03T18:09:48.782039] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-11-03T18:09:49.154998] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:09:49.523419] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-11-03T18:09:49.534874] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-11-03T18:09:50.074626] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T18:09:50.334900] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-11-03T18:09:50.881088] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T18:09:51.134877] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-11-03T18:09:51.926321] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-11-03T18:09:51.938789] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-11-03T18:09:52.380193] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T18:09:52.734889] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-11-03T18:09:53.129602] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T18:09:53.534900] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-11-03T18:09:53.980031] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T18:09:54.334898] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-11-03T18:09:55.117185] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-11-03T18:09:55.134819] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-11-03T18:09:55.785013] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T18:09:55.934885] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-11-03T18:09:56.698023] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T18:09:56.734852] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-11-03T18:09:57.059138] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:09:57.534887] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-11-03T18:09:58.334890] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-11-03T18:09:58.636080] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-11-03T18:09:58.860872] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T18:09:59.134869] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-11-03T18:09:59.671848] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T18:09:59.934843] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-11-03T18:10:00.553786] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T18:10:00.734879] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-11-03T18:10:01.534878] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-11. [2025-11-03T18:10:01.639498] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-11-03T18:10:02.334979] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-11-03T18:10:02.455318] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-11-03T18:10:03.134825] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-11-03T18:10:03.154220] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-11 (1.62 seconds). [2025-11-03T18:10:03.156316] [INFO ] [REMOTE ] COP: Full fetch complete (77906 records). [2025-11-03T18:10:03.156628] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-11-03T18:10:03.644245] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-11-03T18:10:03.644407] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-11-03T18:10:03.645633] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-11-03T18:10:03.645745] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-11-03T18:10:03.675425] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T18:10:03.685516] [DEBUG] [LOCAL ] COP: Trimmed 77906 records to 53727 (keeping 200 days of data) [2025-11-03T18:10:03.937712] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-11-03T18:10:04.061298] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-11-03T18:10:04.061462] [INFO ] [MAIN ] COP: Full history saved. [2025-11-03T18:10:04.062262] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COP took 38.6s. Estimated remaining: 4h 14m 46s. Rate: 7.3 symbols/min [2025-11-03T18:10:04.230552] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:04.258315] [DEBUG] [LOCAL ] CPA: Loaded 27439 existing records from primary storage. [2025-11-03T18:10:04.258590] [INFO ] [MAIN ] CPA: Loaded 27439 existing records. [2025-11-03T18:10:04.436890] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:10:04.437246] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-11-03T18:10:04.437330] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-11-03T18:10:04.437968] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-11-03T18:10:04.438034] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-11-03T18:10:04.568696] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T18:10:04.739999] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-11-03T18:10:04.879786] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:05.448202] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T18:10:05.534944] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-11-03T18:10:06.065708] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T18:10:06.334932] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-11-03T18:10:06.878238] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T18:10:07.134839] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-11-03T18:10:07.807822] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T18:10:07.934866] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-11-03T18:10:08.576383] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T18:10:08.734860] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-11-03T18:10:09.534843] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-11-03T18:10:09.715866] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-11-03T18:10:10.334881] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-11-03T18:10:10.682788] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-11-03T18:10:10.907129] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T18:10:11.134857] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-11-03T18:10:11.888538] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-11-03T18:10:11.934827] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-11-03T18:10:12.300792] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T18:10:12.734889] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-11-03T18:10:13.438994] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T18:10:13.534859] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-11-03T18:10:14.346261] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-11-03T18:10:14.373235] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T18:10:15.101299] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T18:10:15.134833] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-11. [2025-11-03T18:10:15.326036] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T18:10:15.934866] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-11-03T18:10:16.734907] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-11. [2025-11-03T18:10:17.488575] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-11-03T18:10:17.534919] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-11-03T18:10:17.803607] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-11 (2.67 seconds). [2025-11-03T18:10:17.805567] [INFO ] [REMOTE ] COTY: Full fetch complete (77281 records). [2025-11-03T18:10:17.805725] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-11-03T18:10:18.216600] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-11-03T18:10:18.216711] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-11-03T18:10:18.217587] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-11-03T18:10:18.217691] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-11-03T18:10:18.219184] [DEBUG] [LOCAL ] COTY: Trimmed 77281 records to 53237 (keeping 200 days of data) [2025-11-03T18:10:18.371138] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-11-03T18:10:18.512560] [DEBUG] [LOCAL ] COTY: Primary data saved (53237 records). [2025-11-03T18:10:18.512740] [INFO ] [MAIN ] COTY: Full history saved. [2025-11-03T18:10:18.512830] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COTY took 36.3s. Estimated remaining: 4h 15m 0s. Rate: 7.3 symbols/min [2025-11-03T18:10:18.628599] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T18:10:18.651597] [INFO ] [REMOTE ] CP: Full fetch complete (77291 records). [2025-11-03T18:10:18.664570] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-11-03T18:10:18.759798] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:18.775800] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-11-03T18:10:18.786835] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-11-03T18:10:18.808860] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-11-03T18:10:18.809102] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-11-03T18:10:18.809540] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-11-03T18:10:18.815080] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-11-03T18:10:19.452253] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-11-03T18:10:19.452409] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-11-03T18:10:19.453532] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-11-03T18:10:19.454055] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-11-03T18:10:19.580667] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:19.588234] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-11-03T18:10:19.586062] [DEBUG] [LOCAL ] CP: Trimmed 77291 records to 53208 (keeping 200 days of data) [2025-11-03T18:10:19.591063] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-11-03T18:10:19.760214] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T18:10:19.950283] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-11. [2025-11-03T18:10:19.974635] [DEBUG] [LOCAL ] CP: Primary data saved (53208 records). [2025-11-03T18:10:19.974845] [INFO ] [MAIN ] CP: Full history saved. [2025-11-03T18:10:19.975935] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. CP took 31.7s. Estimated remaining: 4h 14m 27s. Rate: 7.3 symbols/min [2025-11-03T18:10:20.136893] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T18:10:20.154112] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:20.185616] [DEBUG] [LOCAL ] CPAY: Loaded 30184 existing records from primary storage. [2025-11-03T18:10:20.186000] [INFO ] [MAIN ] CPAY: Loaded 30184 existing records. [2025-11-03T18:10:20.362098] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:10:20.362374] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-11-03T18:10:20.362423] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-11-03T18:10:20.362997] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-11-03T18:10:20.363056] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-11-03T18:10:20.715416] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:20.734817] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-11-03T18:10:21.534918] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-11-03T18:10:21.769708] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T18:10:21.867015] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T18:10:22.334897] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-11-03T18:10:22.455700] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-11 (2.51 seconds). [2025-11-03T18:10:22.457251] [INFO ] [REMOTE ] COUR: Full fetch complete (71515 records). [2025-11-03T18:10:22.457352] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-11-03T18:10:22.843425] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-11-03T18:10:22.843506] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-11-03T18:10:22.844305] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-11-03T18:10:22.844371] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-11-03T18:10:22.845665] [DEBUG] [LOCAL ] COUR: Trimmed 71515 records to 49571 (keeping 200 days of data) [2025-11-03T18:10:23.124325] [DEBUG] [LOCAL ] COUR: Primary data saved (49571 records). [2025-11-03T18:10:23.124445] [INFO ] [MAIN ] COUR: Full history saved. [2025-11-03T18:10:23.124520] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. COUR took 37.5s. Estimated remaining: 4h 14m 1s. Rate: 7.3 symbols/min [2025-11-03T18:10:23.145695] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-11-03T18:10:23.294875] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:23.308626] [DEBUG] [LOCAL ] CPF: Loaded 15078 existing records from primary storage. [2025-11-03T18:10:23.308920] [INFO ] [MAIN ] CPF: Loaded 15078 existing records. [2025-11-03T18:10:23.487498] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:10:23.487875] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-11-03T18:10:23.488016] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-11-03T18:10:23.504018] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-11-03T18:10:23.504581] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T18:10:23.504660] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-11-03T18:10:23.866062] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:23.934826] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-11-03T18:10:24.210529] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T18:10:24.734862] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-11-03T18:10:24.921591] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T18:10:24.985200] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-11-03T18:10:25.534845] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-11-03T18:10:26.334823] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-11-03T18:10:26.508330] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-11-03T18:10:27.134900] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-11-03T18:10:27.443437] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T18:10:27.934895] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-11-03T18:10:28.060274] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T18:10:28.734909] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-11-03T18:10:29.019103] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-11-03T18:10:29.061205] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T18:10:29.534858] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-11-03T18:10:30.186680] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-11-03T18:10:30.334909] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-11-03T18:10:31.134845] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-11-03T18:10:31.259571] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T18:10:31.870472] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T18:10:31.934819] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-11-03T18:10:32.571132] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-11-03T18:10:32.734897] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-11-03T18:10:33.100716] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T18:10:33.534861] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-11-03T18:10:34.334893] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-11-03T18:10:34.625485] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T18:10:35.134904] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-11-03T18:10:35.260098] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T18:10:35.934825] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-11-03T18:10:36.070182] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T18:10:36.734884] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-11-03T18:10:36.973892] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-11-03T18:10:37.534821] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-11-03T18:10:37.690791] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T18:10:37.784833] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-11-03T18:10:38.334867] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-11-03T18:10:39.134856] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-11-03T18:10:39.285826] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T18:10:39.934817] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-11-03T18:10:40.012105] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-11-03T18:10:40.539971] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T18:10:40.734851] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-11-03T18:10:41.436045] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T18:10:41.534848] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-11-03T18:10:42.246508] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T18:10:42.334842] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-11-03T18:10:43.134823] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-11-03T18:10:43.177750] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-11-03T18:10:43.799598] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-11-03T18:10:43.934839] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-11-03T18:10:44.740610] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-11-03T18:10:44.742327] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-11-03T18:10:45.534912] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-11-03T18:10:45.780582] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-11-03T18:10:45.821406] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-11-03T18:10:46.334896] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-11. [2025-11-03T18:10:47.134872] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-11. [2025-11-03T18:10:47.526855] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T18:10:47.527980] [INFO ] [REMOTE ] CPA: Full fetch complete (40425 records). [2025-11-03T18:10:47.528075] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-11-03T18:10:47.921441] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-11-03T18:10:47.921528] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-11-03T18:10:47.922113] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-11-03T18:10:47.922176] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-11-03T18:10:47.923190] [DEBUG] [LOCAL ] CPA: Trimmed 40425 records to 27006 (keeping 200 days of data) [2025-11-03T18:10:47.976847] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-11-03T18:10:48.088574] [DEBUG] [LOCAL ] CPA: Primary data saved (27006 records). [2025-11-03T18:10:48.088882] [INFO ] [MAIN ] CPA: Full history saved. [2025-11-03T18:10:48.088970] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. CPA took 44.0s. Estimated remaining: 4h 14m 53s. Rate: 7.3 symbols/min [2025-11-03T18:10:48.263263] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:48.277224] [DEBUG] [LOCAL ] CPK: Loaded 13614 existing records from primary storage. [2025-11-03T18:10:48.277497] [INFO ] [MAIN ] CPK: Loaded 13614 existing records. [2025-11-03T18:10:48.464967] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:10:48.465167] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-11-03T18:10:48.465234] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-11-03T18:10:48.465628] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-11-03T18:10:48.465720] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-11-03T18:10:48.752895] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-11 (1.62 seconds). [2025-11-03T18:10:48.759088] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T18:10:48.739452] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-11-03T18:10:48.766494] [INFO ] [REMOTE ] CPAY: Full fetch complete (44808 records). [2025-11-03T18:10:48.781797] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-11-03T18:10:48.978937] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:49.154104] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-11-03T18:10:49.272507] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-11-03T18:10:49.272587] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-11-03T18:10:49.273182] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-11-03T18:10:49.273244] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-11-03T18:10:49.274175] [DEBUG] [LOCAL ] CPAY: Trimmed 44808 records to 29899 (keeping 200 days of data) [2025-11-03T18:10:49.455956] [DEBUG] [LOCAL ] CPAY: Primary data saved (29899 records). [2025-11-03T18:10:49.456080] [INFO ] [MAIN ] CPAY: Full history saved. [2025-11-03T18:10:49.456152] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. CPAY took 29.5s. Estimated remaining: 4h 14m 20s. Rate: 7.3 symbols/min [2025-11-03T18:10:49.540053] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-11-03T18:10:49.637385] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:49.685851] [DEBUG] [LOCAL ] CPNG: Loaded 54459 existing records from primary storage. [2025-11-03T18:10:49.686151] [INFO ] [MAIN ] CPNG: Loaded 54459 existing records. [2025-11-03T18:10:49.862179] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:10:49.862379] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-11-03T18:10:49.862425] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-11-03T18:10:49.863270] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-11-03T18:10:49.863327] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-11-03T18:10:49.968005] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-11-03T18:10:50.223543] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:50.334867] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-11-03T18:10:51.134902] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-11. [2025-11-03T18:10:51.640239] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T18:10:51.640953] [INFO ] [REMOTE ] CPAC: Full fetch complete (1830 records). [2025-11-03T18:10:51.641021] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-11-03T18:10:51.828019] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-11-03T18:10:51.828323] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:10:51.828413] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:10:51.828505] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-11-03T18:10:51.828597] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-11-03T18:10:51.828691] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-11-03T18:10:51.828775] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-11-03T18:10:51.828864] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CPAC took 33.3s. Estimated remaining: 4h 13m 50s. Rate: 7.3 symbols/min [2025-11-03T18:10:51.935495] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-11-03T18:10:52.032461] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:10:52.067038] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-11-03T18:10:52.133923] [DEBUG] [LOCAL ] CPRI: Loaded 53090 existing records from primary storage. [2025-11-03T18:10:52.134286] [INFO ] [MAIN ] CPRI: Loaded 53090 existing records. [2025-11-03T18:10:52.395407] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:10:52.395751] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-11-03T18:10:52.395827] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-11-03T18:10:52.396968] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-11-03T18:10:52.397043] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-11-03T18:10:52.740588] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-11-03T18:10:52.932628] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:10:52.950576] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T18:10:53.441624] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T18:10:53.534861] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-11-03T18:10:54.068597] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-11-03T18:10:54.334846] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-11-03T18:10:54.991415] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T18:10:55.134841] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-11-03T18:10:55.934874] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-11-03T18:10:56.718504] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T18:10:56.734807] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-11-03T18:10:57.488380] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-11-03T18:10:57.534843] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-11-03T18:10:58.213227] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-11-03T18:10:58.252105] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T18:10:58.334856] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-11-03T18:10:58.933810] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T18:10:59.134895] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-11-03T18:10:59.732394] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-11-03T18:10:59.934853] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-11-03T18:11:00.658793] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-11-03T18:11:00.734871] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-11-03T18:11:01.403399] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-11-03T18:11:01.534873] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-11-03T18:11:02.334874] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-11-03T18:11:02.999676] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T18:11:03.134837] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-11-03T18:11:03.576801] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-11-03T18:11:03.934827] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-11-03T18:11:03.974285] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-11-03T18:11:04.734869] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-11-03T18:11:05.537309] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-11. [2025-11-03T18:11:05.543079] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T18:11:06.117674] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:11:06.196083] [DEBUG] [REMOTE ] CPK: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:11:06.196428] [WARN ] [REMOTE ] CPK: No data returned for month 2025-11 [2025-11-03T18:11:06.196516] [FATAL] [REMOTE ] CPK: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:11:06.196606] [FATAL] [MAIN ] CPK: Failed to fetch primary data. [2025-11-03T18:11:06.196707] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:11:06.196782] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-11-03T18:11:06.196845] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-11-03T18:11:06.196881] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-11-03T18:11:06.197044] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-11-03T18:11:06.197162] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPK took 18.1s. Estimated remaining: 4h 14m 4s. Rate: 7.3 symbols/min [2025-11-03T18:11:06.334844] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-11. [2025-11-03T18:11:07.134952] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-11-03T18:11:07.380913] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T18:11:07.381795] [INFO ] [REMOTE ] CPF: Full fetch complete (23059 records). [2025-11-03T18:11:07.381872] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-11-03T18:11:07.745823] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-11-03T18:11:07.745916] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-11-03T18:11:07.746371] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-11-03T18:11:07.746410] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-11-03T18:11:07.747016] [DEBUG] [LOCAL ] CPF: Trimmed 23059 records to 14820 (keeping 200 days of data) [2025-11-03T18:11:07.831828] [DEBUG] [LOCAL ] CPF: Primary data saved (14820 records). [2025-11-03T18:11:07.831951] [INFO ] [MAIN ] CPF: Full history saved. [2025-11-03T18:11:07.832026] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPF took 44.7s. Estimated remaining: 4h 13m 32s. Rate: 7.3 symbols/min [2025-11-03T18:11:07.934923] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-11-03T18:11:08.871853] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-11-03T18:11:08.883296] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-11-03T18:11:09.614585] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-11-03T18:11:09.626154] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-11-03T18:11:10.747809] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-11-03T18:11:10.758976] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-11-03T18:11:11.035618] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T18:11:11.134819] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-11-03T18:11:12.544788] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T18:11:12.555553] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-11-03T18:11:12.647341] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-11-03T18:11:12.734843] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-11-03T18:11:14.045540] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:11:14.057090] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-11-03T18:11:14.682395] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-11-03T18:11:14.693972] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-11-03T18:11:15.497990] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T18:11:15.509406] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-11-03T18:11:16.625630] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-11-03T18:11:16.637637] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-11-03T18:11:16.893435] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T18:11:16.904583] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-11-03T18:11:18.401926] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T18:11:18.414610] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-11. [2025-11-03T18:11:18.669522] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-11-03T18:11:18.681957] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-11. [2025-11-03T18:11:20.621567] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-11 (2.21 seconds). [2025-11-03T18:11:20.623172] [INFO ] [REMOTE ] CPRI: Full fetch complete (76160 records). [2025-11-03T18:11:20.623283] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-11-03T18:11:21.058155] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-11-03T18:11:21.058239] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-11-03T18:11:21.059178] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-11-03T18:11:21.059247] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-11-03T18:11:21.060636] [DEBUG] [LOCAL ] CPRI: Trimmed 76160 records to 52308 (keeping 200 days of data) [2025-11-03T18:11:21.355949] [DEBUG] [LOCAL ] CPRI: Primary data saved (52308 records). [2025-11-03T18:11:21.356078] [INFO ] [MAIN ] CPRI: Full history saved. [2025-11-03T18:11:21.356171] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPRI took 29.5s. Estimated remaining: 4h 13m 43s. Rate: 7.3 symbols/min [2025-11-03T18:11:21.605721] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-11 (2.92 seconds). [2025-11-03T18:11:21.607257] [INFO ] [REMOTE ] CPNG: Full fetch complete (77807 records). [2025-11-03T18:11:21.607347] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-11-03T18:11:21.994015] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-11-03T18:11:21.994091] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-11-03T18:11:21.994935] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-11-03T18:11:21.995028] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-11-03T18:11:21.996424] [DEBUG] [LOCAL ] CPNG: Trimmed 77807 records to 53680 (keeping 200 days of data) [2025-11-03T18:11:22.302046] [DEBUG] [LOCAL ] CPNG: Primary data saved (53680 records). [2025-11-03T18:11:22.302177] [INFO ] [MAIN ] CPNG: Full history saved. [2025-11-03T18:11:22.303315] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPNG took 32.8s. Estimated remaining: 4h 13m 9s. Rate: 7.3 symbols/min [2025-11-03T18:11:22.999435] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:23.023529] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:23.005669] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:23.023789] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-11-03T18:11:23.023916] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-11-03T18:11:23.004558] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:23.024578] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-11-03T18:11:23.024839] [DEBUG] [LOCAL ] CPS: No existing data file found in primary storage. [2025-11-03T18:11:23.025106] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-11-03T18:11:23.026352] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-11-03T18:11:23.025247] [WARN ] [MAIN ] CPS: No existing data found, performing full refresh instead. [2025-11-03T18:11:23.026532] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-11-03T18:11:23.032581] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-11-03T18:11:23.032962] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-11-03T18:11:23.056973] [DEBUG] [LOCAL ] CPS: No primary data file found to delete. [2025-11-03T18:11:23.067728] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-11-03T18:11:23.395190] [DEBUG] [LOCAL ] CR: Loaded 24303 existing records from primary storage. [2025-11-03T18:11:23.494578] [INFO ] [MAIN ] CR: Loaded 24303 existing records. [2025-11-03T18:11:23.590267] [DEBUG] [LOCAL ] CPT: Loaded 44988 existing records from primary storage. [2025-11-03T18:11:23.670897] [INFO ] [MAIN ] CPT: Loaded 44988 existing records. [2025-11-03T18:11:23.963620] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:23.978863] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-11-03T18:11:24.151368] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:24.173044] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-11-03T18:11:24.223712] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:11:24.220805] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:11:24.224359] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-11-03T18:11:24.224256] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-11-03T18:11:24.224427] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-11-03T18:11:24.224548] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-11-03T18:11:24.225183] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-11-03T18:11:24.225242] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-11-03T18:11:24.239314] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-11-03T18:11:24.268286] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-11-03T18:11:24.911092] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:24.912639] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-11-03T18:11:24.931630] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:24.932002] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-11-03T18:11:25.189949] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T18:11:25.194723] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-11-03T18:11:25.286594] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:11:25.293016] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-11-03T18:11:25.855635] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T18:11:25.861504] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-11-03T18:11:26.022117] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T18:11:26.023345] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T18:11:26.029206] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-11-03T18:11:26.034754] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-11-03T18:11:26.175318] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:11:26.334913] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-11-03T18:11:26.771777] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T18:11:26.791811] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T18:11:27.003485] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T18:11:27.134823] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-11-03T18:11:27.591282] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T18:11:27.934826] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-11-03T18:11:28.064554] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T18:11:28.734864] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-11-03T18:11:29.318402] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:11:29.534883] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-11-03T18:11:29.777386] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T18:11:30.289799] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T18:11:30.334825] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-11-03T18:11:31.134869] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-11-03T18:11:31.211186] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T18:11:31.882221] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T18:11:31.934917] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-11-03T18:11:32.734864] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-11-03T18:11:33.352893] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T18:11:33.534939] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-11-03T18:11:33.736333] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T18:11:34.334824] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-11-03T18:11:34.410823] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-11-03T18:11:35.134829] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-11-03T18:11:35.188773] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T18:11:35.934830] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-11-03T18:11:36.091444] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-11-03T18:11:36.734861] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-11-03T18:11:36.886444] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T18:11:37.520169] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T18:11:37.534816] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-11-03T18:11:38.334916] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-11-03T18:11:38.585171] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T18:11:39.134934] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-11-03T18:11:39.755390] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T18:11:39.756254] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T18:11:39.934943] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-11-03T18:11:40.735116] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-11-03T18:11:41.042607] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T18:11:41.540174] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-11-03T18:11:41.549398] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-11-03T18:11:42.266502] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T18:11:42.334859] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-11. [2025-11-03T18:11:43.134859] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-11-03T18:11:43.461390] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T18:11:43.462702] [INFO ] [REMOTE ] CQP: Full fetch complete (29214 records). [2025-11-03T18:11:43.462807] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-11-03T18:11:43.840305] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-11-03T18:11:43.840404] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-11-03T18:11:43.840958] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-11-03T18:11:43.841019] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-11-03T18:11:43.841728] [DEBUG] [LOCAL ] CQP: Trimmed 29214 records to 18840 (keeping 200 days of data) [2025-11-03T18:11:43.939985] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-11-03T18:11:43.954745] [DEBUG] [LOCAL ] CQP: Primary data saved (18840 records). [2025-11-03T18:11:43.955731] [INFO ] [MAIN ] CQP: Full history saved. [2025-11-03T18:11:43.955817] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CQP took 21.6s. Estimated remaining: 4h 13m 48s. Rate: 7.3 symbols/min [2025-11-03T18:11:44.128566] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:44.128779] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-11-03T18:11:44.128824] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-11-03T18:11:44.129119] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-11-03T18:11:44.129162] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-11-03T18:11:44.129224] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-11-03T18:11:44.129260] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-11-03T18:11:44.339159] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T18:11:44.537246] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:44.734913] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-11-03T18:11:44.751586] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T18:11:45.534912] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-11-03T18:11:46.131440] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:11:46.227342] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T18:11:46.334858] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-11-03T18:11:47.134857] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-11-03T18:11:47.566229] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T18:11:47.934896] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-11-03T18:11:48.179233] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T18:11:48.368961] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-11-03T18:11:48.734873] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-11-03T18:11:49.534843] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-11-03T18:11:50.022947] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:11:50.334828] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-11. [2025-11-03T18:11:50.442284] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T18:11:51.134872] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-11-03T18:11:51.843849] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T18:11:51.845714] [INFO ] [REMOTE ] CPS: Full fetch complete (36778 records). [2025-11-03T18:11:51.845848] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-11-03T18:11:51.939130] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-11-03T18:11:52.182409] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T18:11:52.257367] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-11-03T18:11:52.257447] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-11-03T18:11:52.258047] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-11-03T18:11:52.258109] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-11-03T18:11:52.258867] [DEBUG] [LOCAL ] CPS: Trimmed 36778 records to 24216 (keeping 200 days of data) [2025-11-03T18:11:52.391250] [DEBUG] [LOCAL ] CPS: Primary data saved (24216 records). [2025-11-03T18:11:52.391366] [INFO ] [MAIN ] CPS: Full history saved. [2025-11-03T18:11:52.391432] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPS took 30.1s. Estimated remaining: 4h 13m 41s. Rate: 7.3 symbols/min [2025-11-03T18:11:52.561289] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:52.606376] [DEBUG] [LOCAL ] CRBG: Loaded 53321 existing records from primary storage. [2025-11-03T18:11:52.606691] [INFO ] [MAIN ] CRBG: Loaded 53321 existing records. [2025-11-03T18:11:52.744320] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-11-03T18:11:52.783942] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:11:52.784131] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-11-03T18:11:52.784230] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-11-03T18:11:52.785102] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-11-03T18:11:52.785159] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-11-03T18:11:53.131901] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:53.392608] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T18:11:53.534817] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-11-03T18:11:53.650980] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:11:54.116600] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T18:11:54.334900] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-11. [2025-11-03T18:11:55.134848] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-11-03T18:11:55.660306] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-11-03T18:11:55.934937] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-11-03T18:11:56.369534] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-11 (2.03 seconds). [2025-11-03T18:11:56.370962] [INFO ] [REMOTE ] CPT: Full fetch complete (64999 records). [2025-11-03T18:11:56.371057] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-11-03T18:11:56.738556] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-11-03T18:11:56.759508] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-11-03T18:11:56.760753] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-11-03T18:11:56.761538] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-11-03T18:11:56.761823] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-11-03T18:11:56.763115] [DEBUG] [LOCAL ] CPT: Trimmed 64999 records to 44384 (keeping 200 days of data) [2025-11-03T18:11:56.968619] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:11:57.061927] [DEBUG] [LOCAL ] CPT: Primary data saved (44384 records). [2025-11-03T18:11:57.062051] [INFO ] [MAIN ] CPT: Full history saved. [2025-11-03T18:11:57.062127] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CPT took 34.8s. Estimated remaining: 4h 13m 20s. Rate: 7.3 symbols/min [2025-11-03T18:11:57.232965] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:57.269898] [DEBUG] [LOCAL ] CRC: Loaded 44132 existing records from primary storage. [2025-11-03T18:11:57.270226] [INFO ] [MAIN ] CRC: Loaded 44132 existing records. [2025-11-03T18:11:57.455607] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:11:57.455859] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-11-03T18:11:57.455906] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-11-03T18:11:57.457342] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-11-03T18:11:57.457474] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-11-03T18:11:57.539756] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-11. [2025-11-03T18:11:57.685771] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T18:11:57.838694] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:11:58.334889] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-11-03T18:11:58.958322] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-11 (1.42 seconds). [2025-11-03T18:11:58.959355] [INFO ] [REMOTE ] CR: Full fetch complete (35301 records). [2025-11-03T18:11:58.959451] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-11-03T18:11:59.137337] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-11-03T18:11:59.335999] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-11-03T18:11:59.336086] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-11-03T18:11:59.336604] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-11-03T18:11:59.336664] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-11-03T18:11:59.337439] [DEBUG] [LOCAL ] CR: Trimmed 35301 records to 23938 (keeping 200 days of data) [2025-11-03T18:11:59.483862] [DEBUG] [LOCAL ] CR: Primary data saved (23938 records). [2025-11-03T18:11:59.484066] [INFO ] [MAIN ] CR: Full history saved. [2025-11-03T18:11:59.484178] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CR took 37.2s. Estimated remaining: 4h 12m 51s. Rate: 7.3 symbols/min [2025-11-03T18:11:59.654969] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:11:59.655235] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-11-03T18:11:59.655307] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-11-03T18:11:59.668376] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-11-03T18:11:59.676101] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-11-03T18:11:59.676199] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-11-03T18:11:59.676303] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-11-03T18:11:59.742802] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T18:11:59.940059] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-11-03T18:12:00.041023] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:00.395036] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T18:12:00.526517] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T18:12:00.734864] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-11-03T18:12:00.971253] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:12:00.971590] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-11-03T18:12:00.971700] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:12:00.971754] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-11-03T18:12:00.971816] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:12:00.971886] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-11-03T18:12:00.971959] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-11-03T18:12:00.972018] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-11-03T18:12:00.972065] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-11-03T18:12:00.972111] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CRCL took 1.5s. Estimated remaining: 4h 12m 19s. Rate: 7.3 symbols/min [2025-11-03T18:12:01.143763] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:12:01.190058] [DEBUG] [LOCAL ] CRGY: Loaded 53252 existing records from primary storage. [2025-11-03T18:12:01.190381] [INFO ] [MAIN ] CRGY: Loaded 53252 existing records. [2025-11-03T18:12:01.365145] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:12:01.365315] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-11-03T18:12:01.365382] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-11-03T18:12:01.366182] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-11-03T18:12:01.366240] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-11-03T18:12:01.535891] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-11-03T18:12:01.736817] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:02.187137] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T18:12:02.334934] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-11-03T18:12:03.134938] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-11-03T18:12:03.409022] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T18:12:03.651868] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-11-03T18:12:03.934874] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-11-03T18:12:04.418872] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-11-03T18:12:04.734850] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-11-03T18:12:05.534914] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-11-03T18:12:06.132243] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-11-03T18:12:06.171720] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-11-03T18:12:06.334927] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-11-03T18:12:07.134853] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-11. [2025-11-03T18:12:07.713385] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:12:07.917171] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T18:12:07.917936] [INFO ] [REMOTE ] CRBD: Full fetch complete (12596 records). [2025-11-03T18:12:07.918004] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-11-03T18:12:07.940033] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-11-03T18:12:08.274835] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-11-03T18:12:08.274914] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-11-03T18:12:08.275215] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-11-03T18:12:08.275256] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-11-03T18:12:08.275770] [DEBUG] [LOCAL ] CRBD: Trimmed 12596 records to 8530 (keeping 200 days of data) [2025-11-03T18:12:08.326551] [DEBUG] [LOCAL ] CRBD: Primary data saved (8530 records). [2025-11-03T18:12:08.326711] [INFO ] [MAIN ] CRBD: Full history saved. [2025-11-03T18:12:08.326792] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 24.4s. Estimated remaining: 4h 12m 8s. Rate: 7.3 symbols/min [2025-11-03T18:12:08.495987] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:12:08.542485] [DEBUG] [LOCAL ] CRH: Loaded 54158 existing records from primary storage. [2025-11-03T18:12:08.542810] [INFO ] [MAIN ] CRH: Loaded 54158 existing records. [2025-11-03T18:12:08.736076] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-11-03T18:12:08.735976] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:12:08.737256] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-11-03T18:12:08.737329] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-11-03T18:12:08.738291] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-11-03T18:12:08.738352] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-11-03T18:12:09.083212] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:09.502126] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T18:12:09.534816] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-11-03T18:12:10.191322] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T18:12:10.334960] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-11-03T18:12:10.826291] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T18:12:11.134913] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-11-03T18:12:11.745688] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T18:12:11.934901] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-11-03T18:12:12.445013] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:12:12.734878] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-11-03T18:12:13.317181] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:12:13.534904] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-11-03T18:12:13.804334] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T18:12:14.334911] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-11-03T18:12:14.742273] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:12:15.134859] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-11-03T18:12:15.659096] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T18:12:15.934872] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-11-03T18:12:16.699008] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T18:12:16.734834] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-11-03T18:12:16.952851] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T18:12:17.534928] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-11-03T18:12:18.300185] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-11-03T18:12:18.334838] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-11-03T18:12:18.853747] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-11-03T18:12:19.134880] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-11-03T18:12:19.934910] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-11-03T18:12:19.977842] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-11-03T18:12:20.607781] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T18:12:20.734855] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-11-03T18:12:21.312712] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T18:12:21.534962] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-11-03T18:12:22.137781] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T18:12:22.334923] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-11-03T18:12:22.729300] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T18:12:23.134853] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-11-03T18:12:23.819476] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T18:12:23.934827] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-11-03T18:12:24.470411] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T18:12:24.734871] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-11-03T18:12:25.275545] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:12:25.534847] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-11-03T18:12:26.130165] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:12:26.334845] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-11-03T18:12:26.878810] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:12:27.134854] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-11-03T18:12:27.813912] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T18:12:27.934824] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-11-03T18:12:28.315436] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:12:28.734846] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-11-03T18:12:29.378623] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T18:12:29.534844] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-11-03T18:12:30.342326] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-11. [2025-11-03T18:12:30.362850] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T18:12:31.000626] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T18:12:31.134832] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-11-03T18:12:31.934850] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-11-03T18:12:32.190122] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-11 (1.85 seconds). [2025-11-03T18:12:32.191403] [INFO ] [REMOTE ] CRC: Full fetch complete (62601 records). [2025-11-03T18:12:32.191493] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-11-03T18:12:32.570250] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-11-03T18:12:32.570428] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-11-03T18:12:32.571243] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-11-03T18:12:32.571324] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-11-03T18:12:32.572594] [DEBUG] [LOCAL ] CRC: Trimmed 62601 records to 43527 (keeping 200 days of data) [2025-11-03T18:12:32.741590] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-11-03T18:12:32.821954] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T18:12:32.873165] [DEBUG] [LOCAL ] CRC: Primary data saved (43527 records). [2025-11-03T18:12:32.873284] [INFO ] [MAIN ] CRC: Full history saved. [2025-11-03T18:12:32.873899] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CRC took 35.8s. Estimated remaining: 4h 12m 56s. Rate: 7.3 symbols/min [2025-11-03T18:12:33.042601] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:12:33.085074] [DEBUG] [LOCAL ] CRI: Loaded 50109 existing records from primary storage. [2025-11-03T18:12:33.085374] [INFO ] [MAIN ] CRI: Loaded 50109 existing records. [2025-11-03T18:12:33.255548] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:12:33.255798] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-11-03T18:12:33.255847] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-11-03T18:12:33.256728] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-11-03T18:12:33.256788] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-11-03T18:12:33.540009] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-11. [2025-11-03T18:12:33.604800] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:33.687293] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T18:12:34.171183] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T18:12:34.334828] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-11-03T18:12:35.134845] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-11-03T18:12:35.645285] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:12:35.751389] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-11 (2.21 seconds). [2025-11-03T18:12:35.752909] [INFO ] [REMOTE ] CRBG: Full fetch complete (76035 records). [2025-11-03T18:12:35.752999] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-11-03T18:12:35.936294] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-11. [2025-11-03T18:12:36.146672] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-11-03T18:12:36.146758] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-11-03T18:12:36.147588] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-11-03T18:12:36.147671] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-11-03T18:12:36.149024] [DEBUG] [LOCAL ] CRBG: Trimmed 76035 records to 52552 (keeping 200 days of data) [2025-11-03T18:12:36.455412] [DEBUG] [LOCAL ] CRBG: Primary data saved (52552 records). [2025-11-03T18:12:36.455556] [INFO ] [MAIN ] CRBG: Full history saved. [2025-11-03T18:12:36.456190] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRBG took 44.1s. Estimated remaining: 4h 12m 32s. Rate: 7.3 symbols/min [2025-11-03T18:12:36.630477] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:12:36.662183] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-11-03T18:12:36.715423] [DEBUG] [LOCAL ] CRK: Loaded 52911 existing records from primary storage. [2025-11-03T18:12:36.715740] [INFO ] [MAIN ] CRK: Loaded 52911 existing records. [2025-11-03T18:12:36.745842] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-11-03T18:12:36.895238] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:12:36.895429] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-11-03T18:12:36.895476] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-11-03T18:12:36.896278] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-11-03T18:12:36.896335] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-11-03T18:12:37.256825] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:37.534825] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-11-03T18:12:38.028995] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:12:38.334822] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-11-03T18:12:38.359110] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-11 (2.42 seconds). [2025-11-03T18:12:38.360590] [INFO ] [REMOTE ] CRGY: Full fetch complete (76168 records). [2025-11-03T18:12:38.360707] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-11-03T18:12:38.737431] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-11-03T18:12:38.737515] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-11-03T18:12:38.738360] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-11-03T18:12:38.738458] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-11-03T18:12:38.739907] [DEBUG] [LOCAL ] CRGY: Trimmed 76168 records to 52482 (keeping 200 days of data) [2025-11-03T18:12:39.048814] [DEBUG] [LOCAL ] CRGY: Primary data saved (52482 records). [2025-11-03T18:12:39.048985] [INFO ] [MAIN ] CRGY: Full history saved. [2025-11-03T18:12:39.049793] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CRGY took 38.1s. Estimated remaining: 4h 12m 4s. Rate: 7.3 symbols/min [2025-11-03T18:12:39.141425] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-11-03T18:12:39.244516] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:12:39.244713] [DEBUG] [LOCAL ] CRL: No existing data file found in primary storage. [2025-11-03T18:12:39.244882] [WARN ] [MAIN ] CRL: No existing data found, performing full refresh instead. [2025-11-03T18:12:39.245087] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-11-03T18:12:39.245196] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-11-03T18:12:39.245362] [DEBUG] [LOCAL ] CRL: No primary data file found to delete. [2025-11-03T18:12:39.245427] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-11-03T18:12:39.403206] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-11-03T18:12:39.725770] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:39.755259] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T18:12:39.934857] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-11-03T18:12:40.710191] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-11-03T18:12:40.734824] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-11-03T18:12:41.156502] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T18:12:41.534855] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-11-03T18:12:42.190231] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T18:12:42.334865] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-11-03T18:12:42.688491] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T18:12:43.134871] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-11-03T18:12:43.780359] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T18:12:43.934861] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-11-03T18:12:44.477993] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T18:12:44.734914] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-11. [2025-11-03T18:12:45.373709] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T18:12:45.534832] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-11-03T18:12:46.334861] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-11-03T18:12:46.865502] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:12:47.134867] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-11-03T18:12:47.153182] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-11 (2.42 seconds). [2025-11-03T18:12:47.154739] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-11-03T18:12:47.154965] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-11-03T18:12:47.547298] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-11-03T18:12:47.547535] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-11-03T18:12:47.548674] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-11-03T18:12:47.548762] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-11-03T18:12:47.550495] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 53378 (keeping 200 days of data) [2025-11-03T18:12:47.886862] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-11-03T18:12:47.941818] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-11-03T18:12:47.941700] [DEBUG] [LOCAL ] CRH: Primary data saved (53378 records). [2025-11-03T18:12:47.943286] [INFO ] [MAIN ] CRH: Full history saved. [2025-11-03T18:12:47.945198] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRH took 39.6s. Estimated remaining: 4h 11m 58s. Rate: 7.3 symbols/min [2025-11-03T18:12:48.113856] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:12:48.163420] [DEBUG] [LOCAL ] CRM: Loaded 54550 existing records from primary storage. [2025-11-03T18:12:48.163775] [INFO ] [MAIN ] CRM: Loaded 54550 existing records. [2025-11-03T18:12:48.344366] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:12:48.344607] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-11-03T18:12:48.344688] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-11-03T18:12:48.345718] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-11-03T18:12:48.345777] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-11-03T18:12:48.708466] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:12:48.726919] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T18:12:48.737449] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-11-03T18:12:49.118139] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:12:49.534850] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-11-03T18:12:50.058360] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:12:50.334872] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-11-03T18:12:51.134944] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-11-03T18:12:51.634159] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T18:12:51.679592] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-11-03T18:12:51.934873] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-11-03T18:12:52.584201] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T18:12:52.734869] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-11-03T18:12:53.534872] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-11-03T18:12:53.965981] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-11-03T18:12:54.020607] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:12:54.334860] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-11-03T18:12:55.057728] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T18:12:55.134821] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-11-03T18:12:55.934830] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-11-03T18:12:56.313790] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-11-03T18:12:56.524619] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T18:12:56.734913] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-11-03T18:12:57.345158] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T18:12:57.534916] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-11-03T18:12:58.334882] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-11-03T18:12:58.559629] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-11-03T18:12:58.805773] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T18:12:59.134881] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-11-03T18:12:59.679900] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-11-03T18:12:59.934893] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-11-03T18:13:00.500240] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T18:13:00.734921] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-11-03T18:13:01.238479] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T18:13:01.534863] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-11-03T18:13:02.334887] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-11-03T18:13:02.821444] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:13:02.866626] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-11-03T18:13:03.134916] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-11-03T18:13:03.934840] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-11-03T18:13:04.015481] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-11-03T18:13:04.060783] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T18:13:04.734896] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-11. [2025-11-03T18:13:05.534916] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-11-03T18:13:05.963714] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-11-03T18:13:06.334871] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-11-03T18:13:06.696918] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-11 (1.96 seconds). [2025-11-03T18:13:06.699144] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:13:06.711742] [INFO ] [REMOTE ] CRK: Full fetch complete (75733 records). [2025-11-03T18:13:06.712419] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-11-03T18:13:07.141240] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-11-03T18:13:07.142443] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-11-03T18:13:07.143243] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-11-03T18:13:07.144319] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-11-03T18:13:07.144511] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-11-03T18:13:07.146082] [DEBUG] [LOCAL ] CRK: Trimmed 75733 records to 52155 (keeping 200 days of data) [2025-11-03T18:13:07.450058] [DEBUG] [LOCAL ] CRK: Primary data saved (52155 records). [2025-11-03T18:13:07.450195] [INFO ] [MAIN ] CRK: Full history saved. [2025-11-03T18:13:07.451102] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRK took 31.0s. Estimated remaining: 4h 12m 29s. Rate: 7.3 symbols/min [2025-11-03T18:13:07.654478] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:07.696474] [DEBUG] [LOCAL ] CRS: Loaded 43666 existing records from primary storage. [2025-11-03T18:13:07.696791] [INFO ] [MAIN ] CRS: Loaded 43666 existing records. [2025-11-03T18:13:07.882123] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:13:07.882330] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-11-03T18:13:07.882381] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-11-03T18:13:07.883204] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-11-03T18:13:07.883264] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-11-03T18:13:07.942084] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-11-03T18:13:08.247847] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:08.538388] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-11-03T18:13:08.578790] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T18:13:08.734885] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-11-03T18:13:09.289522] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-11-03T18:13:09.534868] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-11-03T18:13:10.334907] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-11. [2025-11-03T18:13:10.854744] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T18:13:11.051745] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-11-03T18:13:11.134900] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-11-03T18:13:11.934890] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-11-03T18:13:12.356885] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-11 (2.02 seconds). [2025-11-03T18:13:12.360606] [INFO ] [REMOTE ] CRI: Full fetch complete (71052 records). [2025-11-03T18:13:12.360490] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T18:13:12.360815] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-11-03T18:13:12.737434] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-11. [2025-11-03T18:13:12.755550] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-11-03T18:13:12.755612] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-11-03T18:13:12.756494] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-11-03T18:13:12.756669] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-11-03T18:13:12.758095] [DEBUG] [LOCAL ] CRI: Trimmed 71052 records to 49372 (keeping 200 days of data) [2025-11-03T18:13:13.055132] [DEBUG] [LOCAL ] CRI: Primary data saved (49372 records). [2025-11-03T18:13:13.055346] [INFO ] [MAIN ] CRI: Full history saved. [2025-11-03T18:13:13.056012] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRI took 40.2s. Estimated remaining: 4h 12m 11s. Rate: 7.3 symbols/min [2025-11-03T18:13:13.239603] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:13.273181] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T18:13:13.273549] [DEBUG] [LOCAL ] CRT: Loaded 4867 existing records from primary storage. [2025-11-03T18:13:13.282493] [INFO ] [MAIN ] CRT: Loaded 4867 existing records. [2025-11-03T18:13:13.504019] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:13:13.504334] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-11-03T18:13:13.504407] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-11-03T18:13:13.504722] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-11-03T18:13:13.504808] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-11-03T18:13:13.543414] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-11-03T18:13:13.893792] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:14.334870] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-11-03T18:13:14.758697] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-11 (2.02 seconds). [2025-11-03T18:13:14.761036] [INFO ] [REMOTE ] CRL: Full fetch complete (63649 records). [2025-11-03T18:13:14.761174] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-11-03T18:13:15.025496] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T18:13:15.145570] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-11-03T18:13:15.203668] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-11-03T18:13:15.203778] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-11-03T18:13:15.204605] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-11-03T18:13:15.204781] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-11-03T18:13:15.229446] [DEBUG] [LOCAL ] CRL: Trimmed 63649 records to 42190 (keeping 200 days of data) [2025-11-03T18:13:15.231335] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-11-03T18:13:15.492514] [DEBUG] [LOCAL ] CRL: Primary data saved (42190 records). [2025-11-03T18:13:15.492695] [INFO ] [MAIN ] CRL: Full history saved. [2025-11-03T18:13:15.492790] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRL took 36.4s. Estimated remaining: 4h 11m 43s. Rate: 7.3 symbols/min [2025-11-03T18:13:15.663562] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:15.663779] [DEBUG] [LOCAL ] CSAN: No existing data file found in primary storage. [2025-11-03T18:13:15.663823] [WARN ] [MAIN ] CSAN: No existing data found, performing full refresh instead. [2025-11-03T18:13:15.663964] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-11-03T18:13:15.664016] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-11-03T18:13:15.664060] [DEBUG] [LOCAL ] CSAN: No primary data file found to delete. [2025-11-03T18:13:15.664101] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-11-03T18:13:15.940077] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-11-03T18:13:16.027778] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:16.734910] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-11-03T18:13:17.212243] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-11-03T18:13:17.352384] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T18:13:17.534864] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-11-03T18:13:17.979423] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:13:18.334890] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-11-03T18:13:18.961524] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T18:13:19.134844] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-11-03T18:13:19.934925] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-11-03T18:13:20.391323] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T18:13:20.530988] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T18:13:20.603781] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-11-03T18:13:20.734846] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-11. [2025-11-03T18:13:21.534906] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-11-03T18:13:22.334872] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-11-03T18:13:22.814045] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-11 (2.08 seconds). [2025-11-03T18:13:22.815574] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-11-03T18:13:22.815714] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-11-03T18:13:23.137214] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-11-03T18:13:23.230770] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-11-03T18:13:23.230889] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-11-03T18:13:23.231927] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-11-03T18:13:23.232090] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-11-03T18:13:23.258947] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-11-03T18:13:23.259113] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 53770 (keeping 200 days of data) [2025-11-03T18:13:23.515186] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:13:23.633110] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-11-03T18:13:23.633257] [INFO ] [MAIN ] CRM: Full history saved. [2025-11-03T18:13:23.633810] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRM took 35.7s. Estimated remaining: 4h 11m 35s. Rate: 7.3 symbols/min [2025-11-03T18:13:23.749445] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T18:13:23.823827] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:23.855157] [DEBUG] [LOCAL ] CSL: Loaded 31367 existing records from primary storage. [2025-11-03T18:13:23.855746] [INFO ] [MAIN ] CSL: Loaded 31367 existing records. [2025-11-03T18:13:23.940142] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-11-03T18:13:24.031244] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:13:24.031521] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-11-03T18:13:24.031579] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-11-03T18:13:24.032566] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-11-03T18:13:24.032626] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-11-03T18:13:24.374895] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:24.734922] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-11-03T18:13:25.125987] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T18:13:25.326060] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T18:13:25.534914] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-11-03T18:13:26.164466] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T18:13:26.334866] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-11-03T18:13:27.134884] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-11-03T18:13:27.589507] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T18:13:27.934932] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-11-03T18:13:28.434775] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T18:13:28.734864] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-11-03T18:13:29.120297] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T18:13:29.534875] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-11-03T18:13:30.072933] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:13:30.334848] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-11-03T18:13:30.609238] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T18:13:30.767023] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-11-03T18:13:31.134873] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-11-03T18:13:31.934869] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-11-03T18:13:32.337844] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T18:13:32.734863] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-11-03T18:13:33.078223] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T18:13:33.534860] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-11-03T18:13:33.726866] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T18:13:33.941555] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-11-03T18:13:34.334861] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-11-03T18:13:34.760263] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-11-03T18:13:35.134864] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-11-03T18:13:35.730297] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T18:13:35.934850] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-11-03T18:13:36.486478] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T18:13:36.734893] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-11-03T18:13:37.534856] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-11. [2025-11-03T18:13:37.872836] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T18:13:38.334840] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-11-03T18:13:39.134910] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-11. [2025-11-03T18:13:39.443071] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-11 (1.91 seconds). [2025-11-03T18:13:39.444345] [INFO ] [REMOTE ] CRS: Full fetch complete (62694 records). [2025-11-03T18:13:39.444427] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-11-03T18:13:39.834192] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-11-03T18:13:39.834285] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-11-03T18:13:39.835047] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-11-03T18:13:39.835128] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-11-03T18:13:39.858937] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T18:13:39.867676] [DEBUG] [LOCAL ] CRS: Trimmed 62694 records to 42922 (keeping 200 days of data) [2025-11-03T18:13:39.958546] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-11-03T18:13:39.958478] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T18:13:39.963792] [INFO ] [REMOTE ] CRT: Full fetch complete (7457 records). [2025-11-03T18:13:39.968807] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-11-03T18:13:40.476114] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-11-03T18:13:40.476928] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-11-03T18:13:40.477917] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-11-03T18:13:40.478204] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-11-03T18:13:40.493014] [DEBUG] [LOCAL ] CRT: Trimmed 7457 records to 4854 (keeping 200 days of data) [2025-11-03T18:13:40.514356] [DEBUG] [LOCAL ] CRS: Primary data saved (42922 records). [2025-11-03T18:13:40.522692] [INFO ] [MAIN ] CRS: Full history saved. [2025-11-03T18:13:40.523791] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRS took 33.1s. Estimated remaining: 4h 11m 56s. Rate: 7.3 symbols/min [2025-11-03T18:13:40.649555] [DEBUG] [LOCAL ] CRT: Primary data saved (4854 records). [2025-11-03T18:13:40.671872] [INFO ] [MAIN ] CRT: Full history saved. [2025-11-03T18:13:40.684314] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRT took 27.6s. Estimated remaining: 4h 11m 20s. Rate: 7.3 symbols/min [2025-11-03T18:13:40.702476] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:40.738756] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-11-03T18:13:40.898378] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:40.870917] [DEBUG] [LOCAL ] CSR: Loaded 13506 existing records from primary storage. [2025-11-03T18:13:40.898791] [DEBUG] [LOCAL ] CSTM: No existing data file found in primary storage. [2025-11-03T18:13:40.898967] [INFO ] [MAIN ] CSR: Loaded 13506 existing records. [2025-11-03T18:13:40.899178] [WARN ] [MAIN ] CSTM: No existing data found, performing full refresh instead. [2025-11-03T18:13:40.936034] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-11-03T18:13:40.957843] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-11-03T18:13:40.958011] [DEBUG] [LOCAL ] CSTM: No primary data file found to delete. [2025-11-03T18:13:40.970423] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-11-03T18:13:41.203721] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:13:41.287927] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-11-03T18:13:41.317527] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-11-03T18:13:41.365711] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-11-03T18:13:41.383706] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-11-03T18:13:41.411944] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T18:13:41.539378] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-11-03T18:13:41.596612] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:41.898263] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:42.073337] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:13:42.334906] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-11-03T18:13:42.805557] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T18:13:43.034451] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T18:13:43.134841] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-11-03T18:13:43.934850] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-11-03T18:13:44.498201] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:13:44.734863] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-11-03T18:13:44.914142] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T18:13:45.534864] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-11-03T18:13:45.834002] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T18:13:46.334845] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-11-03T18:13:46.676971] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T18:13:47.134888] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-11-03T18:13:47.619805] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T18:13:47.679163] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-11-03T18:13:47.934850] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-11-03T18:13:48.734816] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-11-03T18:13:48.852741] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T18:13:49.253371] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-11-03T18:13:49.534843] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-11-03T18:13:50.197056] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T18:13:50.334845] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-11-03T18:13:51.134858] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-11. [2025-11-03T18:13:51.472612] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T18:13:51.934854] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-11-03T18:13:52.578493] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-11-03T18:13:52.734857] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-11-03T18:13:52.900291] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-11 (1.77 seconds). [2025-11-03T18:13:52.901592] [INFO ] [REMOTE ] CSAN: Full fetch complete (60484 records). [2025-11-03T18:13:52.901738] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-11-03T18:13:53.303727] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-11-03T18:13:53.303813] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-11-03T18:13:53.304530] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-11-03T18:13:53.304590] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-11-03T18:13:53.305832] [DEBUG] [LOCAL ] CSAN: Trimmed 60484 records to 41990 (keeping 200 days of data) [2025-11-03T18:13:53.398803] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T18:13:53.535453] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-11-03T18:13:53.566995] [DEBUG] [LOCAL ] CSAN: Primary data saved (41990 records). [2025-11-03T18:13:53.567145] [INFO ] [MAIN ] CSAN: Full history saved. [2025-11-03T18:13:53.567228] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CSAN took 38.1s. Estimated remaining: 4h 11m 28s. Rate: 7.3 symbols/min [2025-11-03T18:13:53.750352] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:13:53.762045] [DEBUG] [LOCAL ] CSV: Loaded 11963 existing records from primary storage. [2025-11-03T18:13:53.762274] [INFO ] [MAIN ] CSV: Loaded 11963 existing records. [2025-11-03T18:13:53.942824] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:13:53.943057] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-11-03T18:13:53.943106] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-11-03T18:13:53.943421] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-11-03T18:13:53.943477] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-11-03T18:13:54.249447] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T18:13:54.318701] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:13:54.334821] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-11-03T18:13:55.134871] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-11-03T18:13:55.259443] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T18:13:55.740780] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T18:13:55.934849] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-11-03T18:13:56.523531] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-11-03T18:13:56.734916] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-11-03T18:13:57.401573] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T18:13:57.534874] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-11-03T18:13:58.307734] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T18:13:58.334815] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-11-03T18:13:59.133041] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-11-03T18:13:59.136695] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-11-03T18:13:59.934920] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-11-03T18:14:00.308288] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T18:14:00.734903] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-11-03T18:14:01.534842] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-11-03T18:14:01.588521] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T18:14:02.041957] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:14:02.224879] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T18:14:02.334863] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-11. [2025-11-03T18:14:02.857363] [DEBUG] [REMOTE ] CSR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:14:02.857687] [WARN ] [REMOTE ] CSR: No data returned for month 2025-11 [2025-11-03T18:14:02.857772] [FATAL] [REMOTE ] CSR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:14:02.857845] [FATAL] [MAIN ] CSR: Failed to fetch primary data. [2025-11-03T18:14:02.857882] [WARN ] [MAIN ] CSR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:14:02.857953] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-11-03T18:14:02.858016] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-11-03T18:14:02.858050] [INFO ] [LOCAL ] CSR: Starting deletion of derivative data. [2025-11-03T18:14:02.858204] [DEBUG] [LOCAL ] CSR: Deleted derivative data file. [2025-11-03T18:14:02.858284] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CSR took 22.3s. Estimated remaining: 4h 11m 23s. Rate: 7.3 symbols/min [2025-11-03T18:14:03.029280] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:03.029444] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-11-03T18:14:03.029480] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-11-03T18:14:03.029589] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-11-03T18:14:03.029629] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-11-03T18:14:03.029726] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-11-03T18:14:03.029766] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-11-03T18:14:03.139989] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-11-03T18:14:03.386079] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:03.840907] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T18:14:03.934858] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-11-03T18:14:04.520004] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T18:14:04.734894] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-11-03T18:14:05.534860] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-11-03T18:14:06.044866] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T18:14:06.281673] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T18:14:06.334861] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-11-03T18:14:07.134903] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-11-03T18:14:07.570839] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T18:14:07.934863] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-11-03T18:14:08.164544] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:14:08.734875] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-11-03T18:14:08.903911] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:14:08.904257] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-11-03T18:14:08.904355] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:14:08.904402] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-11-03T18:14:08.904473] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:14:08.904547] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-11-03T18:14:08.904609] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-11-03T18:14:08.904671] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-11-03T18:14:08.904737] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-11-03T18:14:08.904783] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSW took 6.0s. Estimated remaining: 4h 11m 7s. Rate: 7.3 symbols/min [2025-11-03T18:14:09.088615] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:09.122007] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-11-03T18:14:09.137698] [DEBUG] [LOCAL ] CTBB: Loaded 6275 existing records from primary storage. [2025-11-03T18:14:09.138149] [INFO ] [MAIN ] CTBB: Loaded 6275 existing records. [2025-11-03T18:14:09.339535] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:09.339781] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-11-03T18:14:09.339831] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-11-03T18:14:09.340067] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-11-03T18:14:09.340123] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-11-03T18:14:09.540123] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-11-03T18:14:09.706543] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:10.334857] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-11-03T18:14:10.762869] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:14:10.942282] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-11-03T18:14:11.134932] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-11-03T18:14:11.934870] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-11-03T18:14:12.509102] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T18:14:12.667094] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T18:14:12.734869] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-11. [2025-11-03T18:14:13.534906] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-11-03T18:14:14.137853] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T18:14:14.334882] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-11-03T18:14:14.444886] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-11 (1.71 seconds). [2025-11-03T18:14:14.446195] [INFO ] [REMOTE ] CSL: Full fetch complete (46139 records). [2025-11-03T18:14:14.446312] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-11-03T18:14:14.833038] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T18:14:14.835667] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-11-03T18:14:14.838132] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-11-03T18:14:14.838917] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-11-03T18:14:14.838980] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-11-03T18:14:14.839985] [DEBUG] [LOCAL ] CSL: Trimmed 46139 records to 30961 (keeping 200 days of data) [2025-11-03T18:14:15.026847] [DEBUG] [LOCAL ] CSL: Primary data saved (30961 records). [2025-11-03T18:14:15.026973] [INFO ] [MAIN ] CSL: Full history saved. [2025-11-03T18:14:15.027048] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSL took 51.4s. Estimated remaining: 4h 10m 52s. Rate: 7.3 symbols/min [2025-11-03T18:14:15.140126] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-11-03T18:14:15.197799] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:15.204408] [DEBUG] [LOCAL ] CTDD: Loaded 5015 existing records from primary storage. [2025-11-03T18:14:15.204608] [INFO ] [MAIN ] CTDD: Loaded 5015 existing records. [2025-11-03T18:14:15.378274] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:15.378507] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-11-03T18:14:15.378556] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-11-03T18:14:15.378799] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-11-03T18:14:15.378856] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-11-03T18:14:15.729204] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:15.934832] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-11-03T18:14:16.386427] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-11-03T18:14:16.444995] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T18:14:16.734847] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-11. [2025-11-03T18:14:17.534832] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-11-03T18:14:18.206860] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T18:14:18.334881] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-11-03T18:14:18.786067] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-11 (2.05 seconds). [2025-11-03T18:14:18.785883] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T18:14:18.790421] [INFO ] [REMOTE ] CSTM: Full fetch complete (69531 records). [2025-11-03T18:14:18.790532] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-11-03T18:14:19.143846] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-11. [2025-11-03T18:14:19.204623] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-11-03T18:14:19.204732] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-11-03T18:14:19.205608] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-11-03T18:14:19.205693] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-11-03T18:14:19.207118] [DEBUG] [LOCAL ] CSTM: Trimmed 69531 records to 47279 (keeping 200 days of data) [2025-11-03T18:14:19.469684] [DEBUG] [LOCAL ] CSTM: Primary data saved (47279 records). [2025-11-03T18:14:19.469812] [INFO ] [MAIN ] CSTM: Full history saved. [2025-11-03T18:14:19.469882] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSTM took 38.8s. Estimated remaining: 4h 10m 31s. Rate: 7.3 symbols/min [2025-11-03T18:14:19.643833] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:19.644003] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-11-03T18:14:19.644042] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-11-03T18:14:19.644185] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-11-03T18:14:19.644261] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-11-03T18:14:19.644332] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-11-03T18:14:19.644368] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-11-03T18:14:19.939934] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-11-03T18:14:20.002058] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T18:14:20.028574] [INFO ] [REMOTE ] CSV: Full fetch complete (18725 records). [2025-11-03T18:14:20.028467] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:20.029010] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-11-03T18:14:20.404746] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T18:14:20.404568] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-11-03T18:14:20.404888] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-11-03T18:14:20.407279] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-11-03T18:14:20.407347] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-11-03T18:14:20.407985] [DEBUG] [LOCAL ] CSV: Trimmed 18725 records to 11709 (keeping 200 days of data) [2025-11-03T18:14:20.475749] [DEBUG] [LOCAL ] CSV: Primary data saved (11709 records). [2025-11-03T18:14:20.475869] [INFO ] [MAIN ] CSV: Full history saved. [2025-11-03T18:14:20.475944] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSV took 26.9s. Estimated remaining: 4h 9m 58s. Rate: 7.3 symbols/min [2025-11-03T18:14:20.647423] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:20.672219] [DEBUG] [LOCAL ] CTO: Loaded 27479 existing records from primary storage. [2025-11-03T18:14:20.672466] [INFO ] [MAIN ] CTO: Loaded 27479 existing records. [2025-11-03T18:14:20.740054] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-11-03T18:14:20.852544] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:20.852787] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-11-03T18:14:20.852837] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-11-03T18:14:20.853346] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-11-03T18:14:20.853404] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-11-03T18:14:21.218744] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:21.388366] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-11-03T18:14:21.534823] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-11-03T18:14:21.901781] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T18:14:22.334854] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-11-03T18:14:23.134822] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-11-03T18:14:23.300317] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T18:14:23.583633] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-11-03T18:14:23.934900] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-11-03T18:14:24.077526] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:14:24.077839] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-11-03T18:14:24.077922] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:14:24.077997] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-11-03T18:14:24.078062] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:14:24.078133] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-11-03T18:14:24.078197] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-11-03T18:14:24.078231] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-11-03T18:14:24.078270] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-11-03T18:14:24.078317] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CTEV took 4.6s. Estimated remaining: 4h 9m 34s. Rate: 7.3 symbols/min [2025-11-03T18:14:24.244389] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:24.276493] [DEBUG] [LOCAL ] CTOS: Loaded 37693 existing records from primary storage. [2025-11-03T18:14:24.276797] [INFO ] [MAIN ] CTOS: Loaded 37693 existing records. [2025-11-03T18:14:24.449212] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:24.449387] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-11-03T18:14:24.449432] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-11-03T18:14:24.450005] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-11-03T18:14:24.450061] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-11-03T18:14:24.746304] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-11-03T18:14:24.825853] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:25.534928] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-11-03T18:14:25.761947] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T18:14:26.014539] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-11-03T18:14:26.334881] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-11-03T18:14:27.134933] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-11-03T18:14:27.408452] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T18:14:27.934904] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-11-03T18:14:28.335504] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T18:14:28.525922] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T18:14:28.734905] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-11-03T18:14:29.256893] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-11-03T18:14:29.534930] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-11-03T18:14:30.334840] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-11-03T18:14:30.493378] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T18:14:31.134879] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-11-03T18:14:31.345073] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T18:14:31.703393] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T18:14:31.934880] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-11-03T18:14:32.734838] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-11-03T18:14:33.203544] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T18:14:33.534852] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-11-03T18:14:33.872923] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T18:14:34.334895] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-11-03T18:14:34.737178] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:14:35.069800] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-11-03T18:14:35.134817] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-11-03T18:14:35.934878] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-11-03T18:14:36.108727] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T18:14:36.459770] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-11-03T18:14:36.734853] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-11-03T18:14:37.534885] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-11-03T18:14:37.609846] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T18:14:38.334857] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-11-03T18:14:38.651154] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T18:14:38.803468] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T18:14:39.134870] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-11-03T18:14:39.547692] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T18:14:39.934860] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-11-03T18:14:40.363871] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-11-03T18:14:40.734872] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-11-03T18:14:41.534825] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-11-03T18:14:41.706886] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T18:14:42.179469] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-11-03T18:14:42.334841] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-11-03T18:14:43.134856] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-11-03T18:14:43.486265] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T18:14:43.608517] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-11-03T18:14:43.934876] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-11-03T18:14:44.734815] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-11-03T18:14:44.874604] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T18:14:45.167312] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T18:14:45.534854] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-11-03T18:14:46.334859] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-11-03T18:14:46.614577] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T18:14:47.134907] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-11-03T18:14:47.498501] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T18:14:47.934846] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-11. [2025-11-03T18:14:48.125199] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T18:14:48.557992] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T18:14:48.558694] [INFO ] [REMOTE ] CTBB: Full fetch complete (9938 records). [2025-11-03T18:14:48.558762] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-11-03T18:14:48.745620] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-11-03T18:14:48.927823] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-11-03T18:14:48.927919] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-11-03T18:14:48.928176] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-11-03T18:14:48.928216] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-11-03T18:14:48.928625] [DEBUG] [LOCAL ] CTBB: Trimmed 9938 records to 6183 (keeping 200 days of data) [2025-11-03T18:14:48.964751] [DEBUG] [LOCAL ] CTBB: Primary data saved (6183 records). [2025-11-03T18:14:48.964862] [INFO ] [MAIN ] CTBB: Full history saved. [2025-11-03T18:14:48.964936] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CTBB took 40.1s. Estimated remaining: 4h 10m 22s. Rate: 7.3 symbols/min [2025-11-03T18:14:49.131194] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:49.178423] [DEBUG] [LOCAL ] CTRA: Loaded 54426 existing records from primary storage. [2025-11-03T18:14:49.178758] [INFO ] [MAIN ] CTRA: Loaded 54426 existing records. [2025-11-03T18:14:49.356374] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:49.361136] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T18:14:49.360983] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-11-03T18:14:49.363151] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-11-03T18:14:49.364189] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-11-03T18:14:49.364252] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-11-03T18:14:49.550011] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-11. [2025-11-03T18:14:49.774270] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:50.200823] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T18:14:50.201911] [INFO ] [REMOTE ] CTDD: Full fetch complete (7886 records). [2025-11-03T18:14:50.202002] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-11-03T18:14:50.339992] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-11-03T18:14:50.597327] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-11-03T18:14:50.597407] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-11-03T18:14:50.597609] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-11-03T18:14:50.597679] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-11-03T18:14:50.598211] [DEBUG] [LOCAL ] CTDD: Trimmed 7886 records to 4933 (keeping 200 days of data) [2025-11-03T18:14:50.629280] [DEBUG] [LOCAL ] CTDD: Primary data saved (4933 records). [2025-11-03T18:14:50.629417] [INFO ] [MAIN ] CTDD: Full history saved. [2025-11-03T18:14:50.629496] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTDD took 35.6s. Estimated remaining: 4h 9m 52s. Rate: 7.3 symbols/min [2025-11-03T18:14:50.809254] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:50.851759] [DEBUG] [LOCAL ] CTRE: Loaded 50135 existing records from primary storage. [2025-11-03T18:14:50.852062] [INFO ] [MAIN ] CTRE: Loaded 50135 existing records. [2025-11-03T18:14:51.027981] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:51.028267] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-11-03T18:14:51.028314] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-11-03T18:14:51.029170] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-11-03T18:14:51.029228] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-11-03T18:14:51.138477] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-11. [2025-11-03T18:14:51.393057] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:51.934823] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-11-03T18:14:52.049037] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-11-03T18:14:52.651946] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T18:14:52.653964] [INFO ] [REMOTE ] CTO: Full fetch complete (41584 records). [2025-11-03T18:14:52.654087] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-11-03T18:14:52.744742] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-11-03T18:14:53.075615] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-11-03T18:14:53.075780] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-11-03T18:14:53.076779] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-11-03T18:14:53.076846] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-11-03T18:14:53.078238] [DEBUG] [LOCAL ] CTO: Trimmed 41584 records to 27136 (keeping 200 days of data) [2025-11-03T18:14:53.263468] [DEBUG] [LOCAL ] CTO: Primary data saved (27136 records). [2025-11-03T18:14:53.263757] [INFO ] [MAIN ] CTO: Full history saved. [2025-11-03T18:14:53.263907] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CTO took 32.8s. Estimated remaining: 4h 9m 25s. Rate: 7.3 symbols/min [2025-11-03T18:14:53.415698] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-11-03T18:14:53.500003] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:53.540128] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-11-03T18:14:53.543411] [DEBUG] [LOCAL ] CTRI: Loaded 41963 existing records from primary storage. [2025-11-03T18:14:53.543824] [INFO ] [MAIN ] CTRI: Loaded 41963 existing records. [2025-11-03T18:14:53.738160] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:14:53.738438] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-11-03T18:14:53.738492] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-11-03T18:14:53.739393] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-11-03T18:14:53.739455] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-11-03T18:14:54.132432] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:14:54.164257] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T18:14:54.334871] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-11-03T18:14:54.960823] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T18:14:55.134905] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-11-03T18:14:55.945009] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-11-03T18:14:55.971287] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-11-03T18:14:56.272287] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T18:14:56.734916] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-11-03T18:14:57.369916] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T18:14:57.534841] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-11. [2025-11-03T18:14:57.846981] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T18:14:58.334848] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-11-03T18:14:59.025343] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-11 (1.49 seconds). [2025-11-03T18:14:59.026567] [INFO ] [REMOTE ] CTOS: Full fetch complete (54269 records). [2025-11-03T18:14:59.026670] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-11-03T18:14:59.140111] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-11-03T18:14:59.416059] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-11-03T18:14:59.416154] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-11-03T18:14:59.416896] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-11-03T18:14:59.416972] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-11-03T18:14:59.418264] [DEBUG] [LOCAL ] CTOS: Trimmed 54269 records to 36943 (keeping 200 days of data) [2025-11-03T18:14:59.532161] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:14:59.656348] [DEBUG] [LOCAL ] CTOS: Primary data saved (36943 records). [2025-11-03T18:14:59.656478] [INFO ] [MAIN ] CTOS: Full history saved. [2025-11-03T18:14:59.657072] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTOS took 35.6s. Estimated remaining: 4h 9m 11s. Rate: 7.3 symbols/min [2025-11-03T18:14:59.829029] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:14:59.847693] [DEBUG] [LOCAL ] CTS: Loaded 19617 existing records from primary storage. [2025-11-03T18:14:59.847957] [INFO ] [MAIN ] CTS: Loaded 19617 existing records. [2025-11-03T18:14:59.940017] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-11-03T18:15:00.029150] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:15:00.029351] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-11-03T18:15:00.029400] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-11-03T18:15:00.029886] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-11-03T18:15:00.029944] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-11-03T18:15:00.381172] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:00.581153] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T18:15:00.734828] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-11-03T18:15:01.152332] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:15:01.534915] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-11-03T18:15:02.330688] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T18:15:02.334909] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-11-03T18:15:02.557168] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-11-03T18:15:03.116614] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T18:15:03.134919] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-11-03T18:15:03.874620] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T18:15:03.934840] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-11-03T18:15:04.739921] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-11-03T18:15:04.750619] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T18:15:05.534871] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-11-03T18:15:06.252397] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T18:15:06.334882] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-11-03T18:15:06.950927] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T18:15:06.984828] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-11-03T18:15:07.134859] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-11-03T18:15:07.934895] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-11-03T18:15:08.637434] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T18:15:08.668018] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T18:15:08.734845] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-11-03T18:15:09.534881] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-11-03T18:15:10.191231] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T18:15:10.334829] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-11-03T18:15:10.657472] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:15:11.134910] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-11-03T18:15:11.934873] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-11-03T18:15:12.001237] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-11-03T18:15:12.457436] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T18:15:12.721755] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T18:15:12.734809] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-11-03T18:15:13.535675] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T18:15:13.534997] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-11-03T18:15:14.334858] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-11-03T18:15:14.831396] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T18:15:15.134876] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-11-03T18:15:15.284910] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T18:15:15.934896] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-11-03T18:15:16.734917] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-11-03T18:15:16.934459] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-11-03T18:15:17.401672] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T18:15:17.467033] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T18:15:17.534867] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-11. [2025-11-03T18:15:18.334894] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-11-03T18:15:18.699282] [DEBUG] [REMOTE ] CTRA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:15:18.699592] [WARN ] [REMOTE ] CTRA: No data returned for month 2025-11 [2025-11-03T18:15:18.699703] [FATAL] [REMOTE ] CTRA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:15:18.699799] [FATAL] [MAIN ] CTRA: Failed to fetch primary data. [2025-11-03T18:15:18.699869] [WARN ] [MAIN ] CTRA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:15:18.699940] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-11-03T18:15:18.700003] [DEBUG] [LOCAL ] CTRA: No primary data file found to delete. [2025-11-03T18:15:18.700054] [INFO ] [LOCAL ] CTRA: Starting deletion of derivative data. [2025-11-03T18:15:18.700192] [DEBUG] [LOCAL ] CTRA: Deleted derivative data file. [2025-11-03T18:15:18.700750] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTRA took 29.7s. Estimated remaining: 4h 9m 38s. Rate: 7.3 symbols/min [2025-11-03T18:15:18.880180] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:15:18.880377] [DEBUG] [LOCAL ] CTVA: No existing data file found in primary storage. [2025-11-03T18:15:18.880425] [WARN ] [MAIN ] CTVA: No existing data found, performing full refresh instead. [2025-11-03T18:15:18.880534] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-11-03T18:15:18.880575] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-11-03T18:15:18.880617] [DEBUG] [LOCAL ] CTVA: No primary data file found to delete. [2025-11-03T18:15:18.880677] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-11-03T18:15:19.140173] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-11-03T18:15:19.282841] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:19.277970] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T18:15:19.934919] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-11-03T18:15:20.136006] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T18:15:20.734932] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-11-03T18:15:21.298584] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T18:15:21.534941] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-11-03T18:15:21.810981] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T18:15:22.334875] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-11. [2025-11-03T18:15:23.040776] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T18:15:23.134917] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-11-03T18:15:23.934948] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-11-03T18:15:24.270481] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T18:15:24.329393] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-11 (1.99 seconds). [2025-11-03T18:15:24.331532] [INFO ] [REMOTE ] CTRE: Full fetch complete (71531 records). [2025-11-03T18:15:24.331636] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-11-03T18:15:24.735547] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-11-03T18:15:24.735984] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-11-03T18:15:24.737018] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-11-03T18:15:24.735760] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-11. [2025-11-03T18:15:24.737289] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-11-03T18:15:24.739565] [DEBUG] [LOCAL ] CTRE: Trimmed 71531 records to 49464 (keeping 200 days of data) [2025-11-03T18:15:25.037416] [DEBUG] [LOCAL ] CTRE: Primary data saved (49464 records). [2025-11-03T18:15:25.037541] [INFO ] [MAIN ] CTRE: Full history saved. [2025-11-03T18:15:25.037618] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTRE took 34.4s. Estimated remaining: 4h 9m 24s. Rate: 7.3 symbols/min [2025-11-03T18:15:25.212399] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:15:25.212845] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-11-03T18:15:25.212905] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-11-03T18:15:25.213016] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-11-03T18:15:25.213083] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-11-03T18:15:25.213126] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-11-03T18:15:25.213159] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-11-03T18:15:25.475215] [DEBUG] [REMOTE ] CTS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:15:25.499395] [WARN ] [REMOTE ] CTS: No data returned for month 2025-11 [2025-11-03T18:15:25.506555] [FATAL] [REMOTE ] CTS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:15:25.518240] [FATAL] [MAIN ] CTS: Failed to fetch primary data. [2025-11-03T18:15:25.518355] [WARN ] [MAIN ] CTS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:15:25.539952] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-11-03T18:15:25.534622] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-11-03T18:15:25.572700] [DEBUG] [LOCAL ] CTS: No primary data file found to delete. [2025-11-03T18:15:25.615128] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:25.615245] [INFO ] [LOCAL ] CTS: Starting deletion of derivative data. [2025-11-03T18:15:25.616053] [DEBUG] [LOCAL ] CTS: Deleted derivative data file. [2025-11-03T18:15:25.616234] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTS took 26.0s. Estimated remaining: 4h 8m 50s. Rate: 7.3 symbols/min [2025-11-03T18:15:25.777801] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-11-03T18:15:25.843626] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:15:25.843930] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-11-03T18:15:25.843973] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-11-03T18:15:25.844102] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-11-03T18:15:25.844147] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-11-03T18:15:25.844189] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-11-03T18:15:25.844224] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-11-03T18:15:26.235197] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:26.334899] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-11-03T18:15:26.769328] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T18:15:27.134830] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-11-03T18:15:27.836574] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T18:15:27.934824] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-11-03T18:15:28.376631] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:15:28.734847] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-11-03T18:15:29.367616] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T18:15:29.417589] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T18:15:29.534836] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-11-03T18:15:29.787768] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-11-03T18:15:30.334853] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-11-03T18:15:30.605484] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-11-03T18:15:31.134857] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-11-03T18:15:31.934868] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-11-03T18:15:32.186261] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-11-03T18:15:32.396939] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T18:15:32.734870] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-11-03T18:15:32.987500] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-11-03T18:15:33.534875] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-11-03T18:15:34.334873] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-11-03T18:15:35.135001] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-11-03T18:15:35.135176] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-11-03T18:15:35.325202] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-11-03T18:15:35.702867] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T18:15:35.934832] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-11-03T18:15:36.734854] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-11-03T18:15:37.391839] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T18:15:37.534851] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-11-03T18:15:38.075975] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T18:15:38.334902] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-11-03T18:15:38.850733] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T18:15:39.134889] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-11-03T18:15:39.621013] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:15:39.934863] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-11-03T18:15:40.251445] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-11-03T18:15:40.502145] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T18:15:40.734874] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-11-03T18:15:41.534901] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-11-03T18:15:42.031635] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T18:15:42.334855] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-11-03T18:15:43.031029] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T18:15:43.134853] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-11-03T18:15:43.723723] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T18:15:43.934849] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-11-03T18:15:44.182760] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-11-03T18:15:44.459677] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T18:15:44.734882] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-11-03T18:15:45.534924] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-11-03T18:15:45.760939] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-11-03T18:15:46.334852] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-11-03T18:15:46.587532] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-11-03T18:15:46.589790] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-11-03T18:15:47.134920] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-11. [2025-11-03T18:15:47.934912] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-11. [2025-11-03T18:15:48.259512] [DEBUG] [REMOTE ] CUBB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:15:48.259852] [WARN ] [REMOTE ] CUBB: No data returned for month 2025-11 [2025-11-03T18:15:48.259936] [FATAL] [REMOTE ] CUBB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:15:48.260010] [FATAL] [MAIN ] CUBB: Failed to fetch primary data. [2025-11-03T18:15:48.260072] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:15:48.260144] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-11-03T18:15:48.260207] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-11-03T18:15:48.260243] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-11-03T18:15:48.260282] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-11-03T18:15:48.260326] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CUBB took 23.2s. Estimated remaining: 4h 9m 30s. Rate: 7.3 symbols/min [2025-11-03T18:15:48.439177] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:15:48.469918] [DEBUG] [LOCAL ] CUBI: Loaded 27104 existing records from primary storage. [2025-11-03T18:15:48.470314] [INFO ] [MAIN ] CUBI: Loaded 27104 existing records. [2025-11-03T18:15:48.678061] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:15:48.678362] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-11-03T18:15:48.678424] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-11-03T18:15:48.679105] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-11-03T18:15:48.679165] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-11-03T18:15:48.741580] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-11-03T18:15:49.041553] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:49.398863] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T18:15:49.400342] [INFO ] [REMOTE ] CTVA: Full fetch complete (77250 records). [2025-11-03T18:15:49.400438] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-11-03T18:15:49.540076] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-11. [2025-11-03T18:15:49.794037] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-11-03T18:15:49.794128] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-11-03T18:15:49.795005] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-11-03T18:15:49.795071] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-11-03T18:15:49.796576] [DEBUG] [LOCAL ] CTVA: Trimmed 77250 records to 53317 (keeping 200 days of data) [2025-11-03T18:15:50.121943] [DEBUG] [LOCAL ] CTVA: Primary data saved (53317 records). [2025-11-03T18:15:50.122119] [INFO ] [MAIN ] CTVA: Full history saved. [2025-11-03T18:15:50.122205] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CTVA took 31.4s. Estimated remaining: 4h 9m 0s. Rate: 7.3 symbols/min [2025-11-03T18:15:50.327954] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-11-03T18:15:50.330748] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:15:50.342134] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-11-03T18:15:50.388306] [DEBUG] [LOCAL ] CUK: Loaded 51808 existing records from primary storage. [2025-11-03T18:15:50.388694] [INFO ] [MAIN ] CUK: Loaded 51808 existing records. [2025-11-03T18:15:50.564040] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:15:50.564267] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-11-03T18:15:50.564315] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-11-03T18:15:50.565179] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-11-03T18:15:50.565237] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-11-03T18:15:50.720355] [DEBUG] [REMOTE ] CTRI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:15:50.775024] [WARN ] [REMOTE ] CTRI: No data returned for month 2025-11 [2025-11-03T18:15:50.813267] [FATAL] [REMOTE ] CTRI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:15:50.835008] [FATAL] [MAIN ] CTRI: Failed to fetch primary data. [2025-11-03T18:15:50.845802] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:15:50.845883] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-11-03T18:15:50.856722] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-11-03T18:15:50.861911] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-11-03T18:15:50.884693] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-11-03T18:15:50.898814] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CTRI took 57.6s. Estimated remaining: 4h 8m 28s. Rate: 7.3 symbols/min [2025-11-03T18:15:50.932507] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:51.109352] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:15:51.115172] [DEBUG] [LOCAL ] CULP: Loaded 2825 existing records from primary storage. [2025-11-03T18:15:51.115400] [INFO ] [MAIN ] CULP: Loaded 2825 existing records. [2025-11-03T18:15:51.149954] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-11-03T18:15:51.357163] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:15:51.357600] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-11-03T18:15:51.357779] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-11-03T18:15:51.366128] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-11-03T18:15:51.366229] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-11-03T18:15:51.433923] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T18:15:51.764018] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:15:51.934918] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-11-03T18:15:52.563711] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T18:15:52.734915] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-11-03T18:15:53.231790] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:15:53.534907] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-11-03T18:15:53.920003] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T18:15:54.334888] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-11-03T18:15:54.861985] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:15:55.067307] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T18:15:55.134815] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-11-03T18:15:55.929029] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-11-03T18:15:55.934980] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-11-03T18:15:56.734854] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-11-03T18:15:56.798376] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-11-03T18:15:57.330445] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T18:15:57.534894] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-11-03T18:15:58.334883] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-11-03T18:15:58.677945] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T18:15:58.764144] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T18:15:59.134893] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-11-03T18:15:59.934881] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-11-03T18:16:00.634764] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T18:16:00.734862] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-11. [2025-11-03T18:16:01.499199] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T18:16:01.534902] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-11-03T18:16:02.334906] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-11-03T18:16:02.813477] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-11 (2.08 seconds). [2025-11-03T18:16:02.815500] [INFO ] [REMOTE ] CUBE: Full fetch complete (73356 records). [2025-11-03T18:16:02.815633] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-11-03T18:16:03.136454] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-11-03T18:16:03.247840] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-11-03T18:16:03.249103] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T18:16:03.248517] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-11-03T18:16:03.250434] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-11-03T18:16:03.255502] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-11-03T18:16:03.257423] [DEBUG] [LOCAL ] CUBE: Trimmed 73356 records to 50923 (keeping 200 days of data) [2025-11-03T18:16:03.286527] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-11-03T18:16:03.591432] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T18:16:03.612273] [DEBUG] [LOCAL ] CUBE: Primary data saved (50923 records). [2025-11-03T18:16:03.612419] [INFO ] [MAIN ] CUBE: Full history saved. [2025-11-03T18:16:03.612492] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CUBE took 38.0s. Estimated remaining: 4h 8m 34s. Rate: 7.3 symbols/min [2025-11-03T18:16:03.777139] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:03.807746] [DEBUG] [LOCAL ] CURB: Loaded 33160 existing records from primary storage. [2025-11-03T18:16:03.808032] [INFO ] [MAIN ] CURB: Loaded 33160 existing records. [2025-11-03T18:16:03.944571] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-11-03T18:16:03.990528] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:16:03.990832] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-11-03T18:16:03.990886] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-11-03T18:16:03.991479] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-11-03T18:16:03.991537] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-11-03T18:16:04.335885] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:04.734838] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-11-03T18:16:04.815619] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T18:16:05.534855] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-11-03T18:16:05.980504] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T18:16:06.334860] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-11-03T18:16:06.558229] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T18:16:06.755879] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-11-03T18:16:07.134905] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-11-03T18:16:07.600885] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T18:16:07.934888] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-11-03T18:16:08.734898] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-11-03T18:16:08.812787] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T18:16:09.063883] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-11-03T18:16:09.534890] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-11-03T18:16:09.908043] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-11-03T18:16:10.334874] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-11-03T18:16:10.717276] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-11-03T18:16:11.134857] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-11-03T18:16:11.564637] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T18:16:11.934853] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-11-03T18:16:12.734875] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-11-03T18:16:12.955157] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T18:16:13.098554] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T18:16:13.534867] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-11-03T18:16:14.334859] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-11-03T18:16:14.592998] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T18:16:15.134888] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-11-03T18:16:15.882220] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T18:16:15.934834] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-11-03T18:16:16.373413] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T18:16:16.734921] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-11. [2025-11-03T18:16:17.232488] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:16:17.370930] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T18:16:17.371881] [INFO ] [REMOTE ] CULP: Full fetch complete (4424 records). [2025-11-03T18:16:17.371972] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-11-03T18:16:17.541968] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-11-03T18:16:17.760741] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-11-03T18:16:17.760844] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-11-03T18:16:17.761017] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-11-03T18:16:17.761091] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-11-03T18:16:17.761442] [DEBUG] [LOCAL ] CULP: Trimmed 4424 records to 2777 (keeping 200 days of data) [2025-11-03T18:16:17.776784] [DEBUG] [LOCAL ] CULP: Primary data saved (2777 records). [2025-11-03T18:16:17.776849] [INFO ] [MAIN ] CULP: Full history saved. [2025-11-03T18:16:17.776920] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CULP took 26.9s. Estimated remaining: 4h 8m 45s. Rate: 7.3 symbols/min [2025-11-03T18:16:17.953703] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:17.978749] [DEBUG] [LOCAL ] CURV: Loaded 27958 existing records from primary storage. [2025-11-03T18:16:17.979044] [INFO ] [MAIN ] CURV: Loaded 27958 existing records. [2025-11-03T18:16:18.167951] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:16:18.168206] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-11-03T18:16:18.168259] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-11-03T18:16:18.168751] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-11-03T18:16:18.168812] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-11-03T18:16:18.357771] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-11-03T18:16:18.554377] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:18.899021] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T18:16:19.134898] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-11-03T18:16:19.302120] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T18:16:19.934865] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-11-03T18:16:19.975819] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T18:16:20.734899] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-11-03T18:16:21.503538] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T18:16:21.541487] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-11-03T18:16:21.548688] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T18:16:22.334890] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-11-03T18:16:22.794769] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T18:16:23.134872] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-11-03T18:16:23.934828] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-11-03T18:16:23.977854] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T18:16:24.007531] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-11-03T18:16:24.734861] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-11. [2025-11-03T18:16:24.788504] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T18:16:25.534926] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-11-03T18:16:26.061126] [DEBUG] [REMOTE ] CUK: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:16:26.061501] [WARN ] [REMOTE ] CUK: No data returned for month 2025-11 [2025-11-03T18:16:26.061603] [FATAL] [REMOTE ] CUK: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:16:26.061737] [FATAL] [MAIN ] CUK: Failed to fetch primary data. [2025-11-03T18:16:26.061816] [WARN ] [MAIN ] CUK: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:16:26.061915] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-11-03T18:16:26.061980] [DEBUG] [LOCAL ] CUK: No primary data file found to delete. [2025-11-03T18:16:26.062016] [INFO ] [LOCAL ] CUK: Starting deletion of derivative data. [2025-11-03T18:16:26.062186] [DEBUG] [LOCAL ] CUK: Deleted derivative data file. [2025-11-03T18:16:26.063022] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CUK took 35.9s. Estimated remaining: 4h 8m 37s. Rate: 7.3 symbols/min [2025-11-03T18:16:26.273230] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:26.319375] [DEBUG] [LOCAL ] CUZ: Loaded 50056 existing records from primary storage. [2025-11-03T18:16:26.319724] [INFO ] [MAIN ] CUZ: Loaded 50056 existing records. [2025-11-03T18:16:26.340601] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-11-03T18:16:26.514828] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:16:26.515180] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-11-03T18:16:26.515266] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-11-03T18:16:26.516289] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-11-03T18:16:26.516354] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-11-03T18:16:26.645431] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-11-03T18:16:26.912722] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:27.134869] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-11-03T18:16:27.194972] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T18:16:27.934830] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-11-03T18:16:28.011579] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T18:16:28.569718] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T18:16:28.734908] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-11. [2025-11-03T18:16:29.534879] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-11-03T18:16:30.062636] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-11 (1.33 seconds). [2025-11-03T18:16:30.063737] [INFO ] [REMOTE ] CUBI: Full fetch complete (39042 records). [2025-11-03T18:16:30.063825] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-11-03T18:16:30.343061] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-11-03T18:16:30.444309] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-11-03T18:16:30.444467] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-11-03T18:16:30.445185] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-11-03T18:16:30.445298] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-11-03T18:16:30.460190] [DEBUG] [LOCAL ] CUBI: Trimmed 39042 records to 26565 (keeping 200 days of data) [2025-11-03T18:16:30.460836] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T18:16:30.620983] [DEBUG] [LOCAL ] CUBI: Primary data saved (26565 records). [2025-11-03T18:16:30.621128] [INFO ] [MAIN ] CUBI: Full history saved. [2025-11-03T18:16:30.621207] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CUBI took 42.4s. Estimated remaining: 4h 8m 17s. Rate: 7.3 symbols/min [2025-11-03T18:16:31.134890] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-11-03T18:16:31.772510] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:16:31.934861] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-11-03T18:16:32.163472] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T18:16:32.734911] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-11-03T18:16:33.156724] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:16:33.534881] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-11-03T18:16:33.658609] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T18:16:34.334899] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-11-03T18:16:34.741716] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T18:16:35.134838] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-11-03T18:16:35.173946] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T18:16:35.934882] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-11-03T18:16:36.374554] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T18:16:36.734852] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-11-03T18:16:37.093811] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T18:16:37.534853] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-11-03T18:16:38.092885] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T18:16:38.335030] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-11-03T18:16:38.764708] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T18:16:39.134875] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-11. [2025-11-03T18:16:39.322216] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T18:16:39.934848] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-11-03T18:16:40.613459] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-11 (1.48 seconds). [2025-11-03T18:16:40.614497] [INFO ] [REMOTE ] CURV: Full fetch complete (39143 records). [2025-11-03T18:16:40.614586] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-11-03T18:16:40.734935] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-11-03T18:16:41.016725] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T18:16:41.032184] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-11-03T18:16:41.039681] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-11-03T18:16:41.040371] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-11-03T18:16:41.040496] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-11-03T18:16:41.042955] [DEBUG] [LOCAL ] CURV: Trimmed 39143 records to 27710 (keeping 200 days of data) [2025-11-03T18:16:41.194198] [DEBUG] [LOCAL ] CURV: Primary data saved (27710 records). [2025-11-03T18:16:41.194355] [INFO ] [MAIN ] CURV: Full history saved. [2025-11-03T18:16:41.194452] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CURV took 23.4s. Estimated remaining: 4h 8m 16s. Rate: 7.3 symbols/min [2025-11-03T18:16:41.534859] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-11-03T18:16:42.140212] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T18:16:42.335033] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-11-03T18:16:42.568417] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:16:43.134901] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-11. [2025-11-03T18:16:43.561495] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T18:16:43.934865] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-11-03T18:16:44.590771] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T18:16:44.592130] [INFO ] [REMOTE ] CURB: Full fetch complete (47841 records). [2025-11-03T18:16:44.592220] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-11-03T18:16:44.972468] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-11-03T18:16:44.972618] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-11-03T18:16:44.973284] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-11-03T18:16:44.973336] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-11-03T18:16:44.974322] [DEBUG] [LOCAL ] CURB: Trimmed 47841 records to 32679 (keeping 200 days of data) [2025-11-03T18:16:45.157823] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:16:45.194145] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-11-03T18:16:45.213508] [DEBUG] [LOCAL ] CURB: Primary data saved (32679 records). [2025-11-03T18:16:45.213714] [INFO ] [MAIN ] CURB: Full history saved. [2025-11-03T18:16:45.213801] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CURB took 41.6s. Estimated remaining: 4h 7m 54s. Rate: 7.3 symbols/min [2025-11-03T18:16:46.735439] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T18:16:46.747361] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-11-03T18:16:48.141887] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T18:16:48.153336] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-11. [2025-11-03T18:16:49.844064] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-11 (1.69 seconds). [2025-11-03T18:16:49.845549] [INFO ] [REMOTE ] CUZ: Full fetch complete (70935 records). [2025-11-03T18:16:49.845710] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-11-03T18:16:50.240412] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-11-03T18:16:50.240490] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-11-03T18:16:50.241291] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-11-03T18:16:50.241353] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-11-03T18:16:50.242622] [DEBUG] [LOCAL ] CUZ: Trimmed 70935 records to 49414 (keeping 200 days of data) [2025-11-03T18:16:50.537442] [DEBUG] [LOCAL ] CUZ: Primary data saved (49414 records). [2025-11-03T18:16:50.537584] [INFO ] [MAIN ] CUZ: Full history saved. [2025-11-03T18:16:50.538286] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CUZ took 24.5s. Estimated remaining: 4h 7m 37s. Rate: 7.3 symbols/min [2025-11-03T18:16:51.125450] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:51.194403] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:51.217554] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:51.250114] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:16:51.250515] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-11-03T18:16:51.250566] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-11-03T18:16:51.250688] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-11-03T18:16:51.250742] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-11-03T18:16:51.250785] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-11-03T18:16:51.250817] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-11-03T18:16:51.372949] [DEBUG] [LOCAL ] CVLG: Loaded 15372 existing records from primary storage. [2025-11-03T18:16:51.377251] [INFO ] [MAIN ] CVLG: Loaded 15372 existing records. [2025-11-03T18:16:51.377128] [DEBUG] [LOCAL ] CVEO: Loaded 15355 existing records from primary storage. [2025-11-03T18:16:51.403688] [INFO ] [MAIN ] CVEO: Loaded 15355 existing records. [2025-11-03T18:16:51.796134] [DEBUG] [LOCAL ] CVE: Loaded 54338 existing records from primary storage. [2025-11-03T18:16:51.915903] [INFO ] [MAIN ] CVE: Loaded 54338 existing records. [2025-11-03T18:16:51.962673] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:16:51.984337] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-11-03T18:16:51.999779] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-11-03T18:16:52.037197] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-11-03T18:16:52.068891] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:16:52.099283] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:52.099699] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-11-03T18:16:52.099624] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-11-03T18:16:52.103699] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-11-03T18:16:52.124481] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-11-03T18:16:52.205553] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-11-03T18:16:52.243834] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-11-03T18:16:52.511561] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:16:52.569083] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-11-03T18:16:52.598520] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-11-03T18:16:52.635325] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-11-03T18:16:52.648087] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-11-03T18:16:53.030276] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:53.117153] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-11-03T18:16:53.245580] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:53.265296] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-11-03T18:16:53.346135] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:16:53.346472] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-11-03T18:16:53.540285] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:16:53.549370] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-11-03T18:16:53.832430] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-11-03T18:16:53.834896] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-11-03T18:16:53.973759] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-11-03T18:16:53.977488] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-11-03T18:16:54.465826] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T18:16:54.469263] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-11-03T18:16:54.555318] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T18:16:54.566043] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-11-03T18:16:54.595010] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T18:16:54.597630] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-11-03T18:16:54.694954] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T18:16:55.134828] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-11-03T18:16:55.163065] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T18:16:55.195204] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-11-03T18:16:55.938380] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-11-03T18:16:55.944394] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T18:16:56.521749] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T18:16:56.568619] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-11-03T18:16:56.734907] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-11-03T18:16:57.495834] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T18:16:57.534863] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-11-03T18:16:58.274567] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T18:16:58.334862] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-11-03T18:16:58.899792] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T18:16:59.134891] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-11-03T18:16:59.787336] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-11-03T18:16:59.934886] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-11-03T18:17:00.573397] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T18:17:00.734878] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-11-03T18:17:01.463031] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T18:17:01.534909] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-11. [2025-11-03T18:17:02.334876] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-11-03T18:17:02.708675] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T18:17:02.709893] [INFO ] [REMOTE ] CVEO: Full fetch complete (21336 records). [2025-11-03T18:17:02.709969] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-11-03T18:17:03.121274] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-11-03T18:17:03.121774] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-11-03T18:17:03.122483] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-11-03T18:17:03.122634] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-11-03T18:17:03.137569] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-11-03T18:17:03.140900] [DEBUG] [LOCAL ] CVEO: Trimmed 21336 records to 15285 (keeping 200 days of data) [2025-11-03T18:17:03.143454] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-11-03T18:17:03.247719] [DEBUG] [LOCAL ] CVEO: Primary data saved (15285 records). [2025-11-03T18:17:03.247943] [INFO ] [MAIN ] CVEO: Full history saved. [2025-11-03T18:17:03.248055] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 12.7s. Estimated remaining: 4h 7m 43s. Rate: 7.3 symbols/min [2025-11-03T18:17:03.421995] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:17:03.474479] [DEBUG] [LOCAL ] CVNA: Loaded 53581 existing records from primary storage. [2025-11-03T18:17:03.474860] [INFO ] [MAIN ] CVNA: Loaded 53581 existing records. [2025-11-03T18:17:03.733113] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:17:03.733357] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-11-03T18:17:03.733405] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-11-03T18:17:03.734418] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-11-03T18:17:03.734478] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-11-03T18:17:03.937249] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-11-03T18:17:04.132188] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:17:04.740761] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-11-03T18:17:04.748108] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T18:17:05.213172] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T18:17:05.534915] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-11-03T18:17:06.196948] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T18:17:06.334827] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-11-03T18:17:06.455047] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T18:17:07.134940] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-11-03T18:17:07.845474] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T18:17:07.879312] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-11-03T18:17:07.934823] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-11-03T18:17:08.734849] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-11-03T18:17:09.432587] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-11-03T18:17:09.534848] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-11-03T18:17:09.868978] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-11-03T18:17:10.334854] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-11-03T18:17:11.085608] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-11-03T18:17:11.134825] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-11-03T18:17:11.935550] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-11-03T18:17:11.941697] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T18:17:12.543155] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T18:17:12.734838] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-11-03T18:17:13.204416] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T18:17:13.534867] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-11-03T18:17:14.326506] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-11-03T18:17:14.336897] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-11-03T18:17:14.939809] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T18:17:15.134852] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-11-03T18:17:15.674443] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-11-03T18:17:15.723979] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-11-03T18:17:15.934828] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-11-03T18:17:16.734858] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-11-03T18:17:17.548024] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-11-03T18:17:17.558071] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-11-03T18:17:17.930852] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T18:17:18.334911] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-11-03T18:17:18.741126] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T18:17:19.134865] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-11-03T18:17:19.934863] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-11-03T18:17:20.285538] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-11-03T18:17:20.476551] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:17:20.611023] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-11-03T18:17:20.734871] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-11-03T18:17:21.534917] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-11. [2025-11-03T18:17:22.242438] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-11-03T18:17:22.334830] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-11-03T18:17:22.363114] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-11 (0.83 seconds). [2025-11-03T18:17:22.364337] [INFO ] [REMOTE ] CVLG: Full fetch complete (21493 records). [2025-11-03T18:17:22.364408] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-11-03T18:17:22.729393] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-11-03T18:17:22.729468] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-11-03T18:17:22.729918] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-11-03T18:17:22.729977] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-11-03T18:17:22.730548] [DEBUG] [LOCAL ] CVLG: Trimmed 21493 records to 15090 (keeping 200 days of data) [2025-11-03T18:17:22.819472] [DEBUG] [LOCAL ] CVLG: Primary data saved (15090 records). [2025-11-03T18:17:22.819600] [INFO ] [MAIN ] CVLG: Full history saved. [2025-11-03T18:17:22.819701] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CVLG took 32.3s. Estimated remaining: 4h 8m 11s. Rate: 7.3 symbols/min [2025-11-03T18:17:22.986039] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:17:23.033021] [DEBUG] [LOCAL ] CVS: Loaded 54474 existing records from primary storage. [2025-11-03T18:17:23.033430] [INFO ] [MAIN ] CVS: Loaded 54474 existing records. [2025-11-03T18:17:23.139907] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-11-03T18:17:23.218788] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:17:23.219036] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-11-03T18:17:23.219091] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-11-03T18:17:23.220094] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-11-03T18:17:23.220155] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-11-03T18:17:23.570072] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:17:23.934826] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-11-03T18:17:24.033844] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-11-03T18:17:24.350325] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:17:24.734907] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-11-03T18:17:25.534891] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-11-03T18:17:25.578751] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T18:17:25.954306] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:17:26.334891] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-11-03T18:17:27.134875] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-11-03T18:17:27.343913] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-11-03T18:17:27.700755] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T18:17:27.934820] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-11. [2025-11-03T18:17:28.587032] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-11-03T18:17:28.734858] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-10. [2025-11-03T18:17:29.534850] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-11-03T18:17:30.157618] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T18:17:30.334822] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-11. [2025-11-03T18:17:30.756924] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-11 (2.82 seconds). [2025-11-03T18:17:30.758824] [INFO ] [REMOTE ] CVNA: Full fetch complete (76711 records). [2025-11-03T18:17:30.758942] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-11-03T18:17:31.137549] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-11-03T18:17:31.186053] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-11-03T18:17:31.186223] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-11-03T18:17:31.187329] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-11-03T18:17:31.187532] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-11-03T18:17:31.202926] [DEBUG] [LOCAL ] CVNA: Trimmed 76711 records to 52816 (keeping 200 days of data) [2025-11-03T18:17:31.226226] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-11-03T18:17:31.553422] [DEBUG] [LOCAL ] CVNA: Primary data saved (52816 records). [2025-11-03T18:17:31.553571] [INFO ] [MAIN ] CVNA: Full history saved. [2025-11-03T18:17:31.554362] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CVNA took 28.3s. Estimated remaining: 4h 8m 4s. Rate: 7.3 symbols/min [2025-11-03T18:17:31.724933] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:17:31.778212] [DEBUG] [LOCAL ] CVX: Loaded 54540 existing records from primary storage. [2025-11-03T18:17:31.778516] [INFO ] [MAIN ] CVX: Loaded 54540 existing records. [2025-11-03T18:17:31.940356] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-11-03T18:17:31.962247] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:17:31.962493] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-11-03T18:17:31.962554] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-11-03T18:17:31.963612] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-11-03T18:17:31.963713] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-11-03T18:17:32.326090] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:17:32.326886] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-11 (1.99 seconds). [2025-11-03T18:17:32.328526] [INFO ] [REMOTE ] CVI: Full fetch complete (67224 records). [2025-11-03T18:17:32.328608] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-11-03T18:17:32.719879] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-11-03T18:17:32.720060] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-11-03T18:17:32.720999] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-11-03T18:17:32.721217] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-11-03T18:17:32.747896] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-11-03T18:17:32.752403] [DEBUG] [LOCAL ] CVI: Trimmed 67224 records to 46511 (keeping 200 days of data) [2025-11-03T18:17:32.754365] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-11-03T18:17:33.027218] [DEBUG] [LOCAL ] CVI: Primary data saved (46511 records). [2025-11-03T18:17:33.027374] [INFO ] [MAIN ] CVI: Full history saved. [2025-11-03T18:17:33.027487] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CVI took 42.5s. Estimated remaining: 4h 7m 35s. Rate: 7.3 symbols/min [2025-11-03T18:17:33.192265] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:17:33.211442] [DEBUG] [LOCAL ] CW: Loaded 22103 existing records from primary storage. [2025-11-03T18:17:33.211696] [INFO ] [MAIN ] CW: Loaded 22103 existing records. [2025-11-03T18:17:33.384602] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:17:33.384824] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-11-03T18:17:33.384871] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-11-03T18:17:33.385368] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-11-03T18:17:33.385425] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-11-03T18:17:33.541677] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-11-03T18:17:33.750292] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:17:33.782591] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-11-03T18:17:34.334897] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-11-03T18:17:34.587873] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-11-03T18:17:35.119819] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-11-03T18:17:35.134876] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-11-03T18:17:35.261632] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:17:35.934859] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-11-03T18:17:36.734930] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-11. [2025-11-03T18:17:36.947624] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T18:17:36.990992] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-11-03T18:17:37.534860] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-11-03T18:17:38.090381] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-11 (1.36 seconds). [2025-11-03T18:17:38.091974] [INFO ] [REMOTE ] CVE: Full fetch complete (77710 records). [2025-11-03T18:17:38.092125] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-11-03T18:17:38.339147] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-11-03T18:17:38.524097] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-11-03T18:17:38.524210] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-11-03T18:17:38.530544] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-11-03T18:17:38.539695] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-11-03T18:17:38.541055] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T18:17:38.547980] [DEBUG] [LOCAL ] CVE: Trimmed 77710 records to 53557 (keeping 200 days of data) [2025-11-03T18:17:38.865440] [DEBUG] [LOCAL ] CVE: Primary data saved (53557 records). [2025-11-03T18:17:38.865577] [INFO ] [MAIN ] CVE: Full history saved. [2025-11-03T18:17:38.865675] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CVE took 48.3s. Estimated remaining: 4h 7m 19s. Rate: 7.3 symbols/min [2025-11-03T18:17:39.035010] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:17:39.035175] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-11-03T18:17:39.035251] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-11-03T18:17:39.035355] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-11-03T18:17:39.035396] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-11-03T18:17:39.035436] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-11-03T18:17:39.035468] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-11-03T18:17:39.140005] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-11-03T18:17:39.383209] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:17:39.934871] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-11-03T18:17:40.223271] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-11-03T18:17:40.398484] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T18:17:40.734861] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-11-03T18:17:40.899991] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T18:17:41.534890] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-11-03T18:17:42.113560] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T18:17:42.334894] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-11-03T18:17:42.662905] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T18:17:43.134876] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-11-03T18:17:43.934853] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-11-03T18:17:44.087514] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T18:17:44.734912] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-11-03T18:17:44.836634] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-11-03T18:17:45.242715] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T18:17:45.534883] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-11-03T18:17:46.201265] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T18:17:46.334907] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-11-03T18:17:46.469419] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T18:17:47.134945] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-11-03T18:17:47.542369] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T18:17:47.934944] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-11-03T18:17:48.734941] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-11-03T18:17:48.980486] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-11-03T18:17:49.502039] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-11-03T18:17:49.526379] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T18:17:49.534800] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-11-03T18:17:50.283779] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-11-03T18:17:50.334855] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-11-03T18:17:51.134857] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-11-03T18:17:51.859827] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T18:17:51.934820] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-11. [2025-11-03T18:17:52.734913] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-11-03T18:17:53.252115] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T18:17:53.253441] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-11-03T18:17:53.266144] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-11-03T18:17:53.266558] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-11-03T18:17:53.540031] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-11-03T18:17:53.673322] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-11-03T18:17:53.673405] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-11-03T18:17:53.674334] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-11-03T18:17:53.674401] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-11-03T18:17:53.675877] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-11-03T18:17:54.001364] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-11-03T18:17:54.001488] [INFO ] [MAIN ] CVS: Full history saved. [2025-11-03T18:17:54.002088] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVS took 31.2s. Estimated remaining: 4h 7m 32s. Rate: 7.3 symbols/min [2025-11-03T18:17:54.173142] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:17:54.207536] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T18:17:54.251707] [DEBUG] [LOCAL ] CWEN: Loaded 45776 existing records from primary storage. [2025-11-03T18:17:54.252008] [INFO ] [MAIN ] CWEN: Loaded 45776 existing records. [2025-11-03T18:17:54.340084] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-11-03T18:17:54.447451] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:17:54.447697] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-11-03T18:17:54.447765] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-11-03T18:17:54.448537] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-11-03T18:17:54.448595] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-11-03T18:17:54.804597] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:17:55.134853] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-11-03T18:17:55.318764] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-11-03T18:17:55.677805] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T18:17:55.934943] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-11-03T18:17:56.474332] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T18:17:56.734862] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-11-03T18:17:57.534902] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-11-03T18:17:57.877792] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-11-03T18:17:57.879494] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-11-03T18:17:58.334887] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-11-03T18:17:58.854393] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:17:59.134813] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-11-03T18:17:59.242620] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:17:59.934853] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-11-03T18:18:00.574881] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T18:18:00.734868] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-11-03T18:18:01.534908] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-11-03T18:18:01.851768] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-11-03T18:18:01.951558] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T18:18:02.334909] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-11-03T18:18:02.456267] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T18:18:03.134948] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-11-03T18:18:03.539345] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:18:03.934893] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-11-03T18:18:04.734944] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-11. [2025-11-03T18:18:05.028883] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-11-03T18:18:05.531839] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-11-03T18:18:05.544552] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-11-03T18:18:05.875163] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T18:18:05.876454] [INFO ] [REMOTE ] CW: Full fetch complete (33262 records). [2025-11-03T18:18:05.876549] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-11-03T18:18:06.312986] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-11-03T18:18:06.313084] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-11-03T18:18:06.313741] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-11-03T18:18:06.313818] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-11-03T18:18:06.314684] [DEBUG] [LOCAL ] CW: Trimmed 33262 records to 22038 (keeping 200 days of data) [2025-11-03T18:18:06.375378] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-11-03T18:18:06.476619] [DEBUG] [LOCAL ] CW: Primary data saved (22038 records). [2025-11-03T18:18:06.476786] [INFO ] [MAIN ] CW: Full history saved. [2025-11-03T18:18:06.476877] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CW took 33.4s. Estimated remaining: 4h 7m 37s. Rate: 7.3 symbols/min [2025-11-03T18:18:06.686536] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:06.739570] [DEBUG] [LOCAL ] CWH: Loaded 51988 existing records from primary storage. [2025-11-03T18:18:06.739970] [INFO ] [MAIN ] CWH: Loaded 51988 existing records. [2025-11-03T18:18:06.966235] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:06.966478] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-11-03T18:18:06.966528] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-11-03T18:18:06.967486] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-11-03T18:18:06.967547] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-11-03T18:18:07.143966] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-11-03T18:18:07.328170] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:07.764296] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T18:18:07.812723] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-11-03T18:18:07.934880] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-11-03T18:18:08.541636] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T18:18:08.734930] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-11-03T18:18:09.311931] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T18:18:09.534935] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-11-03T18:18:09.973059] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:18:10.334841] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-11-03T18:18:10.702028] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T18:18:11.134881] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-11. [2025-11-03T18:18:11.323371] [DEBUG] [REMOTE ] CVX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:18:11.323905] [WARN ] [REMOTE ] CVX: No data returned for month 2025-11 [2025-11-03T18:18:11.324005] [FATAL] [REMOTE ] CVX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:18:11.324108] [FATAL] [MAIN ] CVX: Failed to fetch primary data. [2025-11-03T18:18:11.324172] [WARN ] [MAIN ] CVX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:18:11.324248] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-11-03T18:18:11.324322] [DEBUG] [LOCAL ] CVX: No primary data file found to delete. [2025-11-03T18:18:11.324359] [INFO ] [LOCAL ] CVX: Starting deletion of derivative data. [2025-11-03T18:18:11.324693] [DEBUG] [LOCAL ] CVX: Deleted derivative data file. [2025-11-03T18:18:11.325905] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVX took 39.8s. Estimated remaining: 4h 7m 18s. Rate: 7.3 symbols/min [2025-11-03T18:18:11.516441] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:11.544767] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T18:18:11.595377] [DEBUG] [LOCAL ] CWK: Loaded 50347 existing records from primary storage. [2025-11-03T18:18:11.595754] [INFO ] [MAIN ] CWK: Loaded 50347 existing records. [2025-11-03T18:18:11.790767] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:11.790991] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-11-03T18:18:11.791040] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-11-03T18:18:11.791804] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-11-03T18:18:11.791862] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-11-03T18:18:11.945523] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-11. [2025-11-03T18:18:12.141560] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:12.734895] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-11-03T18:18:13.534890] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-11-03T18:18:13.972678] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-11 (2.03 seconds). [2025-11-03T18:18:13.974251] [INFO ] [REMOTE ] CWAN: Full fetch complete (75679 records). [2025-11-03T18:18:13.974357] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-11-03T18:18:14.356201] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-11-03T18:18:14.395942] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-11-03T18:18:14.397774] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T18:18:14.398050] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-11-03T18:18:14.399100] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-11-03T18:18:14.402336] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-11-03T18:18:14.410265] [DEBUG] [LOCAL ] CWAN: Trimmed 75679 records to 52688 (keeping 200 days of data) [2025-11-03T18:18:14.709157] [DEBUG] [LOCAL ] CWAN: Primary data saved (52688 records). [2025-11-03T18:18:14.709407] [INFO ] [MAIN ] CWAN: Full history saved. [2025-11-03T18:18:14.709514] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CWAN took 35.8s. Estimated remaining: 4h 6m 55s. Rate: 7.3 symbols/min [2025-11-03T18:18:14.809741] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T18:18:14.911546] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:14.936342] [DEBUG] [LOCAL ] CWT: Loaded 28175 existing records from primary storage. [2025-11-03T18:18:14.936585] [INFO ] [MAIN ] CWT: Loaded 28175 existing records. [2025-11-03T18:18:15.111852] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:15.112193] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-11-03T18:18:15.112245] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-11-03T18:18:15.112907] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-11-03T18:18:15.112965] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-11-03T18:18:15.142696] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-11-03T18:18:15.485170] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:15.703818] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T18:18:15.934886] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-11-03T18:18:16.433881] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T18:18:16.734940] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-11-03T18:18:16.987745] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T18:18:17.534879] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-11-03T18:18:17.686025] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:18:18.334884] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-11-03T18:18:18.839982] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:18:19.134864] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-11-03T18:18:19.152444] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T18:18:19.934865] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-11-03T18:18:20.405434] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T18:18:20.734896] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-11-03T18:18:20.968588] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T18:18:21.534844] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-11-03T18:18:22.231947] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T18:18:22.334844] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-11-03T18:18:22.861281] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T18:18:23.134846] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-11. [2025-11-03T18:18:23.375484] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T18:18:23.934849] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-11-03T18:18:24.070496] [DEBUG] [REMOTE ] CWEN: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:18:24.071008] [WARN ] [REMOTE ] CWEN: No data returned for month 2025-11 [2025-11-03T18:18:24.071124] [FATAL] [REMOTE ] CWEN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:18:24.071260] [FATAL] [MAIN ] CWEN: Failed to fetch primary data. [2025-11-03T18:18:24.071541] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:18:24.071625] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-11-03T18:18:24.071740] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-11-03T18:18:24.071785] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-11-03T18:18:24.071941] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-11-03T18:18:24.072422] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CWEN took 30.1s. Estimated remaining: 4h 6m 50s. Rate: 7.3 symbols/min [2025-11-03T18:18:24.241771] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:24.289451] [DEBUG] [LOCAL ] CX: Loaded 53523 existing records from primary storage. [2025-11-03T18:18:24.289789] [INFO ] [MAIN ] CX: Loaded 53523 existing records. [2025-11-03T18:18:24.467442] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:24.467717] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-11-03T18:18:24.467779] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-11-03T18:18:24.468622] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-11-03T18:18:24.468722] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-11-03T18:18:24.735322] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-11-03T18:18:24.828494] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:24.895421] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T18:18:25.534834] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-11-03T18:18:26.334819] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-11-03T18:18:26.371472] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T18:18:26.405565] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-11-03T18:18:27.134908] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-11-03T18:18:27.784330] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T18:18:27.934869] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-11-03T18:18:28.593165] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T18:18:28.734820] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-11-03T18:18:28.908591] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T18:18:29.534850] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-11-03T18:18:29.900304] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T18:18:30.334848] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-11-03T18:18:30.816264] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T18:18:31.134857] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-11-03T18:18:31.571551] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T18:18:31.934848] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-11-03T18:18:32.423838] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T18:18:32.734818] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-11-03T18:18:32.870152] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T18:18:33.534853] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-11-03T18:18:34.091013] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T18:18:34.334858] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-11-03T18:18:35.134880] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-11-03T18:18:35.229454] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-11-03T18:18:35.584869] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T18:18:35.934828] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-11-03T18:18:35.968593] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T18:18:36.734887] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-11-03T18:18:37.185039] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T18:18:37.534857] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-11-03T18:18:38.009599] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T18:18:38.334874] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-11-03T18:18:38.778336] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T18:18:39.134850] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-11-03T18:18:39.514349] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T18:18:39.934859] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-11-03T18:18:40.302310] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T18:18:40.734926] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-11-03T18:18:40.963184] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:18:41.534918] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-11. [2025-11-03T18:18:42.218335] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T18:18:42.334827] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-11-03T18:18:43.062618] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T18:18:43.064179] [INFO ] [REMOTE ] CWT: Full fetch complete (41482 records). [2025-11-03T18:18:43.064258] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-11-03T18:18:43.142947] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-11-03T18:18:43.478412] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-11-03T18:18:43.478523] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-11-03T18:18:43.479239] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-11-03T18:18:43.479387] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-11-03T18:18:43.480476] [DEBUG] [LOCAL ] CWT: Trimmed 41482 records to 27723 (keeping 200 days of data) [2025-11-03T18:18:43.659572] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:18:43.672051] [DEBUG] [LOCAL ] CWT: Primary data saved (27723 records). [2025-11-03T18:18:43.672378] [INFO ] [MAIN ] CWT: Full history saved. [2025-11-03T18:18:43.682734] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWT took 29.0s. Estimated remaining: 4h 7m 18s. Rate: 7.3 symbols/min [2025-11-03T18:18:43.859217] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:43.859421] [DEBUG] [LOCAL ] CXE: No existing data file found in primary storage. [2025-11-03T18:18:43.859463] [WARN ] [MAIN ] CXE: No existing data found, performing full refresh instead. [2025-11-03T18:18:43.859599] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-11-03T18:18:43.859688] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-11-03T18:18:43.859751] [DEBUG] [LOCAL ] CXE: No primary data file found to delete. [2025-11-03T18:18:43.859787] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-11-03T18:18:43.939986] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-11-03T18:18:44.226677] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:44.432570] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:18:44.734941] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-11-03T18:18:45.399132] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-11-03T18:18:45.484016] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T18:18:45.534826] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-11. [2025-11-03T18:18:46.334860] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-11-03T18:18:47.134921] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-11. [2025-11-03T18:18:47.591963] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T18:18:47.636506] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-11 (2.10 seconds). [2025-11-03T18:18:47.637987] [INFO ] [REMOTE ] CWH: Full fetch complete (73386 records). [2025-11-03T18:18:47.638076] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-11-03T18:18:47.939984] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-11-03T18:18:48.030548] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-11-03T18:18:48.030664] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-11-03T18:18:48.031494] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-11-03T18:18:48.031536] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-11-03T18:18:48.033003] [DEBUG] [LOCAL ] CWH: Trimmed 73386 records to 51221 (keeping 200 days of data) [2025-11-03T18:18:48.335616] [DEBUG] [LOCAL ] CWH: Primary data saved (51221 records). [2025-11-03T18:18:48.335763] [INFO ] [MAIN ] CWH: Full history saved. [2025-11-03T18:18:48.336478] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CWH took 41.9s. Estimated remaining: 4h 6m 58s. Rate: 7.3 symbols/min [2025-11-03T18:18:48.506319] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:48.513012] [DEBUG] [LOCAL ] CXH: Loaded 4362 existing records from primary storage. [2025-11-03T18:18:48.513218] [INFO ] [MAIN ] CXH: Loaded 4362 existing records. [2025-11-03T18:18:48.644621] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:18:48.711435] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:48.711684] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-11-03T18:18:48.711746] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-11-03T18:18:48.711986] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-11-03T18:18:48.712045] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-11-03T18:18:48.742231] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-11-03T18:18:49.043964] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-11 (1.91 seconds). [2025-11-03T18:18:49.055220] [INFO ] [REMOTE ] CWK: Full fetch complete (71532 records). [2025-11-03T18:18:49.073918] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-11-03T18:18:49.073851] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:49.470688] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-11-03T18:18:49.470833] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-11-03T18:18:49.471840] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-11-03T18:18:49.471950] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-11-03T18:18:49.473388] [DEBUG] [LOCAL ] CWK: Trimmed 71532 records to 49584 (keeping 200 days of data) [2025-11-03T18:18:49.537981] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-11-03T18:18:49.568839] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T18:18:49.777776] [DEBUG] [LOCAL ] CWK: Primary data saved (49584 records). [2025-11-03T18:18:49.777935] [INFO ] [MAIN ] CWK: Full history saved. [2025-11-03T18:18:49.778784] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWK took 38.5s. Estimated remaining: 4h 6m 28s. Rate: 7.3 symbols/min [2025-11-03T18:18:49.944100] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:49.984992] [DEBUG] [LOCAL ] CXM: Loaded 47633 existing records from primary storage. [2025-11-03T18:18:49.985284] [INFO ] [MAIN ] CXM: Loaded 47633 existing records. [2025-11-03T18:18:50.157396] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:50.157626] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-11-03T18:18:50.157706] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-11-03T18:18:50.158399] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-11-03T18:18:50.158456] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-11-03T18:18:50.340761] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-11-03T18:18:50.505267] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:50.852669] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T18:18:50.882787] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:18:51.134865] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-11-03T18:18:51.934852] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-11-03T18:18:52.473809] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:18:52.734856] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-11-03T18:18:53.064461] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T18:18:53.118742] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-11-03T18:18:53.534873] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-11-03T18:18:53.998187] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T18:18:54.334894] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-11-03T18:18:54.776110] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T18:18:55.134855] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-11-03T18:18:55.934875] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-11-03T18:18:56.428632] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-11-03T18:18:56.734828] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-11-03T18:18:56.779412] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T18:18:57.324877] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-11-03T18:18:57.534889] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-11. [2025-11-03T18:18:58.334893] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-11-03T18:18:58.534558] [DEBUG] [REMOTE ] CX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:18:58.534905] [WARN ] [REMOTE ] CX: No data returned for month 2025-11 [2025-11-03T18:18:58.535008] [FATAL] [REMOTE ] CX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:18:58.535109] [FATAL] [MAIN ] CX: Failed to fetch primary data. [2025-11-03T18:18:58.535174] [WARN ] [MAIN ] CX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:18:58.535247] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-11-03T18:18:58.535309] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-11-03T18:18:58.535344] [INFO ] [LOCAL ] CX: Starting deletion of derivative data. [2025-11-03T18:18:58.535515] [DEBUG] [LOCAL ] CX: Deleted derivative data file. [2025-11-03T18:18:58.536085] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CX took 34.5s. Estimated remaining: 4h 6m 22s. Rate: 7.3 symbols/min [2025-11-03T18:18:58.651239] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T18:18:58.716967] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:18:58.749793] [DEBUG] [LOCAL ] CXT: Loaded 30744 existing records from primary storage. [2025-11-03T18:18:58.750128] [INFO ] [MAIN ] CXT: Loaded 30744 existing records. [2025-11-03T18:18:58.930233] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:18:58.930442] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-11-03T18:18:58.930488] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-11-03T18:18:58.931034] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-11-03T18:18:58.931092] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-11-03T18:18:59.140143] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-11-03T18:18:59.290029] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:18:59.527326] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-11-03T18:18:59.934865] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-11-03T18:19:00.734919] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-11-03T18:19:01.146764] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T18:19:01.534913] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-11-03T18:19:01.858975] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-11-03T18:19:02.150447] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T18:19:02.334930] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-11-03T18:19:03.134897] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-11-03T18:19:03.378844] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T18:19:03.632264] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-11-03T18:19:03.934868] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-11-03T18:19:04.464574] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-11-03T18:19:04.734880] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-11-03T18:19:05.534895] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-11. [2025-11-03T18:19:05.995983] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T18:19:06.122172] [DEBUG] [REMOTE ] CXE: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:19:06.122462] [WARN ] [REMOTE ] CXE: No data returned for month 2025-11 [2025-11-03T18:19:06.122548] [FATAL] [REMOTE ] CXE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:19:06.122661] [FATAL] [MAIN ] CXE: Failed to fetch primary data. [2025-11-03T18:19:06.122729] [WARN ] [MAIN ] CXE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:19:06.122802] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-11-03T18:19:06.122864] [DEBUG] [LOCAL ] CXE: No primary data file found to delete. [2025-11-03T18:19:06.122899] [INFO ] [LOCAL ] CXE: Starting deletion of derivative data. [2025-11-03T18:19:06.122937] [DEBUG] [LOCAL ] CXE: No derivative data file found to delete. [2025-11-03T18:19:06.122981] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CXE took 22.4s. Estimated remaining: 4h 6m 11s. Rate: 7.3 symbols/min [2025-11-03T18:19:06.292943] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:19:06.330661] [DEBUG] [LOCAL ] CXW: Loaded 44078 existing records from primary storage. [2025-11-03T18:19:06.330973] [INFO ] [MAIN ] CXW: Loaded 44078 existing records. [2025-11-03T18:19:06.341688] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-11-03T18:19:06.508811] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:19:06.509031] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-11-03T18:19:06.509082] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-11-03T18:19:06.509809] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-11-03T18:19:06.509869] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-11-03T18:19:06.860865] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:19:07.134849] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-11-03T18:19:07.507525] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T18:19:07.934904] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-11-03T18:19:08.503873] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T18:19:08.683890] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T18:19:08.734819] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-11-03T18:19:09.534893] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-11-03T18:19:09.895872] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T18:19:10.334880] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-11-03T18:19:10.900417] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T18:19:11.134894] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-11-03T18:19:11.518911] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-11-03T18:19:11.520519] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T18:19:11.934883] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-11-03T18:19:12.741168] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-11-03T18:19:12.753808] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-11-03T18:19:13.534874] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-11-03T18:19:14.050842] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T18:19:14.334918] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-11-03T18:19:14.503108] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T18:19:15.134975] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-11-03T18:19:15.606845] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T18:19:15.903490] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-11-03T18:19:15.934890] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-11-03T18:19:16.734836] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-11-03T18:19:17.033729] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:19:17.534901] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-11-03T18:19:17.955775] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T18:19:18.334877] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-11-03T18:19:18.890148] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T18:19:18.916350] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T18:19:19.134856] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-11-03T18:19:19.934914] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-11-03T18:19:20.226171] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T18:19:20.734896] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-11-03T18:19:20.983496] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-11-03T18:19:21.131273] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T18:19:21.534856] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-11-03T18:19:22.334866] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-11-03T18:19:22.626476] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T18:19:23.134910] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-11-03T18:19:23.672466] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T18:19:23.934852] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-11-03T18:19:24.423829] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:19:24.734890] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-11-03T18:19:25.003578] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T18:19:25.158963] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-11-03T18:19:25.534905] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-11-03T18:19:26.334884] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-11-03T18:19:26.670092] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-11-03T18:19:26.840317] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T18:19:27.134894] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-11-03T18:19:27.934860] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-11-03T18:19:28.377838] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T18:19:28.734868] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-11. [2025-11-03T18:19:29.268095] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:19:29.399224] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T18:19:29.399964] [INFO ] [REMOTE ] CXH: Full fetch complete (5290 records). [2025-11-03T18:19:29.400032] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-11-03T18:19:29.546063] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-11. [2025-11-03T18:19:29.760698] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-11-03T18:19:29.760777] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-11-03T18:19:29.760913] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-11-03T18:19:29.760951] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-11-03T18:19:29.761331] [DEBUG] [LOCAL ] CXH: Trimmed 5290 records to 4337 (keeping 200 days of data) [2025-11-03T18:19:29.785975] [DEBUG] [LOCAL ] CXH: Primary data saved (4337 records). [2025-11-03T18:19:29.786042] [INFO ] [MAIN ] CXH: Full history saved. [2025-11-03T18:19:29.786107] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CXH took 41.4s. Estimated remaining: 4h 6m 51s. Rate: 7.3 symbols/min [2025-11-03T18:19:29.956593] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:19:29.981851] [DEBUG] [LOCAL ] CYD: Loaded 27178 existing records from primary storage. [2025-11-03T18:19:29.982103] [INFO ] [MAIN ] CYD: Loaded 27178 existing records. [2025-11-03T18:19:30.157938] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:19:30.158151] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-11-03T18:19:30.158197] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-11-03T18:19:30.158697] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-11-03T18:19:30.158754] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-11-03T18:19:30.339991] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-11-03T18:19:30.428931] [DEBUG] [REMOTE ] CXT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:19:30.439672] [WARN ] [REMOTE ] CXT: No data returned for month 2025-11 [2025-11-03T18:19:30.445318] [FATAL] [REMOTE ] CXT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:19:30.461101] [FATAL] [MAIN ] CXT: Failed to fetch primary data. [2025-11-03T18:19:30.489335] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:19:30.507320] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-11-03T18:19:30.516389] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-11-03T18:19:30.519963] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:19:30.520089] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-11-03T18:19:30.520495] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-11-03T18:19:30.520575] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXT took 32.0s. Estimated remaining: 4h 6m 19s. Rate: 7.3 symbols/min [2025-11-03T18:19:30.684348] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:19:30.723708] [DEBUG] [LOCAL ] CYH: Loaded 48335 existing records from primary storage. [2025-11-03T18:19:30.723986] [INFO ] [MAIN ] CYH: Loaded 48335 existing records. [2025-11-03T18:19:30.896210] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:19:30.896403] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-11-03T18:19:30.896450] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-11-03T18:19:30.897214] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-11-03T18:19:30.897270] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-11-03T18:19:31.140421] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-11-03T18:19:31.242925] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:19:31.500615] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:19:31.934847] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-11-03T18:19:32.510427] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T18:19:32.734855] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-11. [2025-11-03T18:19:33.363960] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:19:33.534848] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-11-03T18:19:33.783045] [DEBUG] [REMOTE ] CXM: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:19:33.783337] [WARN ] [REMOTE ] CXM: No data returned for month 2025-11 [2025-11-03T18:19:33.783451] [FATAL] [REMOTE ] CXM: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:19:33.783526] [FATAL] [MAIN ] CXM: Failed to fetch primary data. [2025-11-03T18:19:33.783585] [WARN ] [MAIN ] CXM: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:19:33.783631] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-11-03T18:19:33.783725] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-11-03T18:19:33.783766] [INFO ] [LOCAL ] CXM: Starting deletion of derivative data. [2025-11-03T18:19:33.783912] [DEBUG] [LOCAL ] CXM: Deleted derivative data file. [2025-11-03T18:19:33.784611] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CXM took 44.0s. Estimated remaining: 4h 5m 56s. Rate: 7.3 symbols/min [2025-11-03T18:19:33.954399] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:19:33.954570] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-11-03T18:19:33.954612] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-11-03T18:19:33.954773] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-11-03T18:19:33.954814] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-11-03T18:19:33.954855] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-11-03T18:19:33.954886] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-11-03T18:19:34.306731] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:19:34.334816] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-11-03T18:19:34.872899] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T18:19:35.134851] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-11-03T18:19:35.855145] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T18:19:35.934866] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-11-03T18:19:36.395368] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T18:19:36.734847] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-11. [2025-11-03T18:19:37.363028] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T18:19:37.534847] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-11-03T18:19:38.152270] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T18:19:38.334850] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-11-03T18:19:38.559979] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T18:19:38.561471] [INFO ] [REMOTE ] CXW: Full fetch complete (64793 records). [2025-11-03T18:19:38.561584] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-11-03T18:19:38.947450] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-11-03T18:19:38.947545] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-11-03T18:19:38.948335] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-11-03T18:19:38.948399] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-11-03T18:19:38.949776] [DEBUG] [LOCAL ] CXW: Trimmed 64793 records to 43377 (keeping 200 days of data) [2025-11-03T18:19:39.142958] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-11-03T18:19:39.197727] [DEBUG] [LOCAL ] CXW: Primary data saved (43377 records). [2025-11-03T18:19:39.197834] [INFO ] [MAIN ] CXW: Full history saved. [2025-11-03T18:19:39.197907] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXW took 33.1s. Estimated remaining: 4h 5m 39s. Rate: 7.3 symbols/min [2025-11-03T18:19:39.384486] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T18:19:39.386246] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:19:39.402283] [DEBUG] [LOCAL ] DAC: Loaded 11936 existing records from primary storage. [2025-11-03T18:19:39.402510] [INFO ] [MAIN ] DAC: Loaded 11936 existing records. [2025-11-03T18:19:39.603205] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:19:39.603464] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-11-03T18:19:39.603518] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-11-03T18:19:39.603863] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-11-03T18:19:39.603920] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-11-03T18:19:39.938195] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-11-03T18:19:39.951613] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:19:40.502127] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T18:19:40.734837] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-11-03T18:19:41.009305] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-11-03T18:19:41.534815] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-11-03T18:19:41.559805] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T18:19:42.334930] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-11-03T18:19:43.010473] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:19:43.044776] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T18:19:43.134901] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-11-03T18:19:43.735201] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-11-03T18:19:43.934822] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-11-03T18:19:44.734882] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-11-03T18:19:45.022182] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T18:19:45.457249] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T18:19:45.534862] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-11-03T18:19:46.166111] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T18:19:46.334821] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-11-03T18:19:46.957946] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T18:19:47.134871] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-11-03T18:19:47.693567] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T18:19:47.934861] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-11-03T18:19:48.501559] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T18:19:48.734880] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-11-03T18:19:49.411420] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-11-03T18:19:49.534887] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-11-03T18:19:50.149541] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T18:19:50.334873] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-11-03T18:19:51.134864] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-11. [2025-11-03T18:19:51.382547] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T18:19:51.934905] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-11-03T18:19:52.032295] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T18:19:52.033100] [INFO ] [REMOTE ] DAC: Full fetch complete (18563 records). [2025-11-03T18:19:52.033168] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-11-03T18:19:52.391212] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-11-03T18:19:52.391289] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-11-03T18:19:52.391714] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-11-03T18:19:52.391778] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-11-03T18:19:52.392277] [DEBUG] [LOCAL ] DAC: Trimmed 18563 records to 11694 (keeping 200 days of data) [2025-11-03T18:19:52.460971] [DEBUG] [LOCAL ] DAC: Primary data saved (11694 records). [2025-11-03T18:19:52.461096] [INFO ] [MAIN ] DAC: Full history saved. [2025-11-03T18:19:52.461171] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. DAC took 13.3s. Estimated remaining: 4h 5m 46s. Rate: 7.3 symbols/min [2025-11-03T18:19:52.623890] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:19:52.670076] [DEBUG] [LOCAL ] DAL: Loaded 54533 existing records from primary storage. [2025-11-03T18:19:52.670385] [INFO ] [MAIN ] DAL: Loaded 54533 existing records. [2025-11-03T18:19:52.742386] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-11-03T18:19:52.845024] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:19:52.845172] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-11-03T18:19:52.845222] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-11-03T18:19:52.846165] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-11-03T18:19:52.846252] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-11-03T18:19:53.192482] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:19:53.443039] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-11-03T18:19:53.542718] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-11-03T18:19:53.548321] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T18:19:54.334869] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-11-03T18:19:55.129223] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-11-03T18:19:55.140242] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-11-03T18:19:55.612163] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T18:19:55.934833] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-11-03T18:19:56.734825] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-11-03T18:19:56.951170] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-11-03T18:19:57.373379] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T18:19:57.534818] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-11-03T18:19:57.602014] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T18:19:58.334874] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-11-03T18:19:58.977812] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-11-03T18:19:59.134835] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-11-03T18:19:59.934822] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-11-03T18:19:59.975672] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-11-03T18:20:00.004947] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T18:20:00.734851] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-11-03T18:20:01.258220] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:20:01.534907] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-11-03T18:20:02.054600] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T18:20:02.334941] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-11-03T18:20:03.140021] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-11-03T18:20:03.157493] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-11-03T18:20:03.934852] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-11-03T18:20:04.089910] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T18:20:04.734894] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-11-03T18:20:05.137432] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-11-03T18:20:05.298174] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T18:20:05.534882] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-11-03T18:20:06.334868] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-11-03T18:20:06.587347] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-11-03T18:20:06.840807] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:20:07.134861] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-11-03T18:20:07.315236] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T18:20:07.934831] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-11. [2025-11-03T18:20:08.734832] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-11-03T18:20:08.778283] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T18:20:09.452991] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-11 (1.52 seconds). [2025-11-03T18:20:09.454105] [INFO ] [REMOTE ] CYD: Full fetch complete (37229 records). [2025-11-03T18:20:09.454177] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-11-03T18:20:09.539991] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-11-03T18:20:09.854163] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-11-03T18:20:09.854239] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-11-03T18:20:09.854815] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-11-03T18:20:09.854876] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-11-03T18:20:09.855631] [DEBUG] [LOCAL ] CYD: Trimmed 37229 records to 26788 (keeping 200 days of data) [2025-11-03T18:20:10.010401] [DEBUG] [LOCAL ] CYD: Primary data saved (26788 records). [2025-11-03T18:20:10.010534] [INFO ] [MAIN ] CYD: Full history saved. [2025-11-03T18:20:10.010617] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CYD took 40.2s. Estimated remaining: 4h 6m 6s. Rate: 7.3 symbols/min [2025-11-03T18:20:10.185362] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:20:10.219787] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T18:20:10.267895] [DEBUG] [LOCAL ] DAN: Loaded 50070 existing records from primary storage. [2025-11-03T18:20:10.268186] [INFO ] [MAIN ] DAN: Loaded 50070 existing records. [2025-11-03T18:20:10.341702] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-11-03T18:20:10.444406] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:20:10.444600] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-11-03T18:20:10.444668] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-11-03T18:20:10.445468] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-11-03T18:20:10.445526] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-11-03T18:20:10.793610] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:20:11.134863] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-11-03T18:20:11.757101] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-11-03T18:20:11.934822] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-11. [2025-11-03T18:20:12.046600] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T18:20:12.411923] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T18:20:12.734907] [INFO ] [REMOTE ] D: Fetching primary data for 2025-11. [2025-11-03T18:20:13.534860] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-11-03T18:20:14.022673] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-11 (2.09 seconds). [2025-11-03T18:20:14.024089] [INFO ] [REMOTE ] CYH: Full fetch complete (70089 records). [2025-11-03T18:20:14.024174] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-11-03T18:20:14.310542] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-11 (1.58 seconds). [2025-11-03T18:20:14.338624] [INFO ] [REMOTE ] D: Full fetch complete (77813 records). [2025-11-03T18:20:14.343980] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-11-03T18:20:14.338479] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-11-03T18:20:14.516502] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-11-03T18:20:14.536129] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-11-03T18:20:14.539540] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-11-03T18:20:14.539970] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-11-03T18:20:14.606087] [DEBUG] [LOCAL ] CYH: Trimmed 70089 records to 47658 (keeping 200 days of data) [2025-11-03T18:20:14.964601] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-11-03T18:20:14.965594] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-11-03T18:20:14.966634] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-11-03T18:20:14.967059] [DEBUG] [LOCAL ] D: Saving primary data. [2025-11-03T18:20:14.980050] [DEBUG] [LOCAL ] D: Trimmed 77813 records to 53649 (keeping 200 days of data) [2025-11-03T18:20:15.199369] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-11-03T18:20:15.225914] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-11-03T18:20:15.400589] [DEBUG] [LOCAL ] CYH: Primary data saved (47658 records). [2025-11-03T18:20:15.413700] [INFO ] [MAIN ] CYH: Full history saved. [2025-11-03T18:20:15.414414] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. CYH took 44.9s. Estimated remaining: 4h 5m 49s. Rate: 7.3 symbols/min [2025-11-03T18:20:15.623949] [DEBUG] [LOCAL ] D: Primary data saved (53649 records). [2025-11-03T18:20:15.645706] [INFO ] [MAIN ] D: Full history saved. [2025-11-03T18:20:15.652009] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. D took 41.9s. Estimated remaining: 4h 5m 16s. Rate: 7.3 symbols/min [2025-11-03T18:20:15.746517] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:20:15.875967] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:20:15.878008] [DEBUG] [LOCAL ] DAO: Loaded 20067 existing records from primary storage. [2025-11-03T18:20:15.878362] [INFO ] [MAIN ] DAO: Loaded 20067 existing records. [2025-11-03T18:20:16.069595] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:20:16.082872] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-11-03T18:20:16.082926] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-11-03T18:20:16.083299] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-11-03T18:20:16.083355] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-11-03T18:20:16.207396] [DEBUG] [LOCAL ] DAR: Loaded 52719 existing records from primary storage. [2025-11-03T18:20:16.213487] [INFO ] [MAIN ] DAR: Loaded 52719 existing records. [2025-11-03T18:20:16.563260] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:20:16.574833] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-11-03T18:20:16.580410] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-11-03T18:20:16.655290] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:20:16.649723] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-11-03T18:20:16.655660] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-11-03T18:20:16.655611] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-11-03T18:20:17.023055] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.68 seconds). [2025-11-03T18:20:17.044049] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:20:17.054817] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-11-03T18:20:17.518440] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-11-03T18:20:17.534805] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-11-03T18:20:17.745051] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-11-03T18:20:18.334841] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-11-03T18:20:18.469322] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T18:20:18.550133] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T18:20:19.134849] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-11-03T18:20:19.934848] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-11-03T18:20:20.477720] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T18:20:20.521240] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-11-03T18:20:20.734920] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-11-03T18:20:20.902083] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T18:20:21.534855] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-11-03T18:20:21.980640] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T18:20:22.334844] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-11-03T18:20:23.085267] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-11-03T18:20:23.134811] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-11-03T18:20:23.934876] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-11-03T18:20:24.172989] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-11-03T18:20:24.394547] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T18:20:24.734890] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-11-03T18:20:25.525948] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-11-03T18:20:25.536755] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-11-03T18:20:25.873288] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T18:20:26.334824] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-11-03T18:20:26.421969] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T18:20:27.134862] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-11-03T18:20:27.934867] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-11-03T18:20:27.968715] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T18:20:28.464570] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T18:20:28.734867] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-11-03T18:20:28.810604] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T18:20:29.534913] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-11-03T18:20:30.008778] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T18:20:30.334928] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-11-03T18:20:30.879952] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T18:20:31.134909] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-11-03T18:20:31.548714] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:20:31.740854] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T18:20:31.934912] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-11-03T18:20:32.734914] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-11-03T18:20:33.155198] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:20:33.534900] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-11-03T18:20:34.334903] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-11-03T18:20:34.568852] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-11-03T18:20:34.829187] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:20:35.134832] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-11-03T18:20:35.651879] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T18:20:35.934904] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-11-03T18:20:36.464595] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T18:20:36.734932] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-11. [2025-11-03T18:20:37.435442] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T18:20:37.534857] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-11-03T18:20:38.334879] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-11-03T18:20:38.498102] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-11 (1.76 seconds). [2025-11-03T18:20:38.499717] [INFO ] [REMOTE ] DAN: Full fetch complete (71555 records). [2025-11-03T18:20:38.499834] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-11-03T18:20:38.887339] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-11-03T18:20:38.887429] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-11-03T18:20:38.888286] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-11-03T18:20:38.888351] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-11-03T18:20:38.889786] [DEBUG] [LOCAL ] DAN: Trimmed 71555 records to 49351 (keeping 200 days of data) [2025-11-03T18:20:39.106179] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-11-03T18:20:39.139262] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-11-03T18:20:39.199967] [DEBUG] [LOCAL ] DAN: Primary data saved (49351 records). [2025-11-03T18:20:39.200107] [INFO ] [MAIN ] DAN: Full history saved. [2025-11-03T18:20:39.201060] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. DAN took 29.2s. Estimated remaining: 4h 5m 55s. Rate: 7.2 symbols/min [2025-11-03T18:20:39.377555] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:20:39.417147] [DEBUG] [LOCAL ] DAVA: Loaded 42604 existing records from primary storage. [2025-11-03T18:20:39.417456] [INFO ] [MAIN ] DAVA: Loaded 42604 existing records. [2025-11-03T18:20:39.595010] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:20:39.595392] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-11-03T18:20:39.595468] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-11-03T18:20:39.607010] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-11-03T18:20:39.625426] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-11-03T18:20:39.702679] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-11-03T18:20:39.940050] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-11-03T18:20:39.994126] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:20:40.683020] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T18:20:40.738481] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-11. [2025-11-03T18:20:40.744344] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-11-03T18:20:41.534907] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-11. [2025-11-03T18:20:42.201187] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T18:20:42.202822] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-11-03T18:20:42.202915] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-11-03T18:20:42.349358] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-11-03T18:20:42.603920] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-11-03T18:20:42.603997] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-11-03T18:20:42.604870] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-11-03T18:20:42.604933] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-11-03T18:20:42.606409] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-11-03T18:20:42.926335] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-11-03T18:20:42.926461] [INFO ] [MAIN ] DAL: Full history saved. [2025-11-03T18:20:42.926537] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. DAL took 50.5s. Estimated remaining: 4h 5m 33s. Rate: 7.3 symbols/min [2025-11-03T18:20:43.101970] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:20:43.141790] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-11-03T18:20:43.144352] [DEBUG] [LOCAL ] DAY: Loaded 49823 existing records from primary storage. [2025-11-03T18:20:43.144753] [INFO ] [MAIN ] DAY: Loaded 49823 existing records. [2025-11-03T18:20:43.324468] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:20:43.324744] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-11-03T18:20:43.324798] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-11-03T18:20:43.325481] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-11-03T18:20:43.325540] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-11-03T18:20:43.584318] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-11 (2.05 seconds). [2025-11-03T18:20:43.596360] [INFO ] [REMOTE ] DAR: Full fetch complete (75254 records). [2025-11-03T18:20:43.602185] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-11-03T18:20:43.754094] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:20:43.804167] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-11-03T18:20:43.940017] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-11-03T18:20:44.051050] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:20:44.150215] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-11-03T18:20:44.150302] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-11-03T18:20:44.151238] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-11-03T18:20:44.151305] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-11-03T18:20:44.152885] [DEBUG] [LOCAL ] DAR: Trimmed 75254 records to 51976 (keeping 200 days of data) [2025-11-03T18:20:44.448179] [DEBUG] [LOCAL ] DAR: Primary data saved (51976 records). [2025-11-03T18:20:44.448311] [INFO ] [MAIN ] DAR: Full history saved. [2025-11-03T18:20:44.449099] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAR took 28.8s. Estimated remaining: 4h 5m 4s. Rate: 7.3 symbols/min [2025-11-03T18:20:44.628068] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:20:44.628616] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-11-03T18:20:44.628690] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-11-03T18:20:44.628870] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-11-03T18:20:44.628923] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-11-03T18:20:44.628967] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-11-03T18:20:44.628999] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-11-03T18:20:44.740013] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-11-03T18:20:45.013718] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:20:45.265279] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T18:20:45.473161] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T18:20:45.534823] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-11-03T18:20:46.334881] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-11-03T18:20:46.628072] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T18:20:47.134863] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-11-03T18:20:47.719598] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T18:20:47.934880] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-11-03T18:20:48.507399] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T18:20:48.734843] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-11-03T18:20:48.826420] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T18:20:49.534865] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-11-03T18:20:49.737309] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T18:20:50.334855] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-11-03T18:20:50.722312] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T18:20:51.134906] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-11-03T18:20:51.590012] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T18:20:51.934913] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-11-03T18:20:52.503570] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:20:52.734902] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-11-03T18:20:53.432065] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T18:20:53.534918] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-11-03T18:20:53.994590] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T18:20:54.334906] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-11-03T18:20:54.736298] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T18:20:55.134940] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-11-03T18:20:55.764373] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T18:20:55.934871] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-11-03T18:20:56.257933] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-11-03T18:20:56.734908] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-11-03T18:20:57.472771] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T18:20:57.534809] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-11-03T18:20:57.873831] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T18:20:58.334848] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-11-03T18:20:59.120611] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-11-03T18:20:59.134801] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-11-03T18:20:59.583948] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T18:20:59.934847] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-11. [2025-11-03T18:21:00.735002] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-11-03T18:21:00.740880] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-11-03T18:21:01.237093] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T18:21:01.238265] [INFO ] [REMOTE ] DAO: Full fetch complete (33105 records). [2025-11-03T18:21:01.238353] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-11-03T18:21:01.539990] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-11-03T18:21:01.610354] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-11-03T18:21:01.610443] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-11-03T18:21:01.611063] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-11-03T18:21:01.611126] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-11-03T18:21:01.612022] [DEBUG] [LOCAL ] DAO: Trimmed 33105 records to 19646 (keeping 200 days of data) [2025-11-03T18:21:01.718759] [DEBUG] [LOCAL ] DAO: Primary data saved (19646 records). [2025-11-03T18:21:01.718897] [INFO ] [MAIN ] DAO: Full history saved. [2025-11-03T18:21:01.718977] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAO took 46.3s. Estimated remaining: 4h 5m 23s. Rate: 7.2 symbols/min [2025-11-03T18:21:01.886955] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:01.887124] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-11-03T18:21:01.887197] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-11-03T18:21:01.887330] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-11-03T18:21:01.887380] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-11-03T18:21:01.887422] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-11-03T18:21:01.887453] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-11-03T18:21:02.264158] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:02.317636] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-11-03T18:21:02.334815] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-11-03T18:21:02.987305] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T18:21:03.134853] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-11-03T18:21:03.618488] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T18:21:03.934872] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-11-03T18:21:04.005323] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T18:21:04.734892] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-11-03T18:21:05.239490] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:21:05.534843] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-11-03T18:21:06.336058] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-11-03T18:21:06.341716] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T18:21:07.007122] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-11-03T18:21:07.134867] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-11-03T18:21:07.934882] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-11-03T18:21:07.981369] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-11-03T18:21:08.638934] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:21:08.734814] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-11-03T18:21:08.809843] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T18:21:09.475102] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T18:21:09.534896] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-11-03T18:21:10.315147] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-11-03T18:21:10.334814] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-11-03T18:21:11.134851] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-11. [2025-11-03T18:21:11.150517] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-11-03T18:21:11.934921] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-11-03T18:21:12.056382] [DEBUG] [REMOTE ] DAVA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:21:12.056712] [WARN ] [REMOTE ] DAVA: No data returned for month 2025-11 [2025-11-03T18:21:12.056824] [FATAL] [REMOTE ] DAVA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:21:12.056921] [FATAL] [MAIN ] DAVA: Failed to fetch primary data. [2025-11-03T18:21:12.056993] [WARN ] [MAIN ] DAVA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:21:12.057084] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-11-03T18:21:12.057167] [DEBUG] [LOCAL ] DAVA: No primary data file found to delete. [2025-11-03T18:21:12.057222] [INFO ] [LOCAL ] DAVA: Starting deletion of derivative data. [2025-11-03T18:21:12.057441] [DEBUG] [LOCAL ] DAVA: Deleted derivative data file. [2025-11-03T18:21:12.058260] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAVA took 32.9s. Estimated remaining: 4h 5m 21s. Rate: 7.2 symbols/min [2025-11-03T18:21:12.236167] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:12.273930] [DEBUG] [LOCAL ] DBI: Loaded 43345 existing records from primary storage. [2025-11-03T18:21:12.274238] [INFO ] [MAIN ] DBI: Loaded 43345 existing records. [2025-11-03T18:21:12.446386] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:21:12.446585] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-11-03T18:21:12.446631] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-11-03T18:21:12.447415] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-11-03T18:21:12.447472] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-11-03T18:21:12.740180] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-11. [2025-11-03T18:21:12.794588] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:13.278916] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:21:13.534880] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-11-03T18:21:14.084940] [DEBUG] [REMOTE ] DB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:21:14.085312] [WARN ] [REMOTE ] DB: No data returned for month 2025-11 [2025-11-03T18:21:14.085423] [FATAL] [REMOTE ] DB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:21:14.085528] [FATAL] [MAIN ] DB: Failed to fetch primary data. [2025-11-03T18:21:14.085607] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:21:14.085720] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-11-03T18:21:14.085803] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-11-03T18:21:14.085854] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-11-03T18:21:14.085914] [DEBUG] [LOCAL ] DB: No derivative data file found to delete. [2025-11-03T18:21:14.085982] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DB took 29.6s. Estimated remaining: 4h 4m 54s. Rate: 7.3 symbols/min [2025-11-03T18:21:14.260100] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:14.260314] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-11-03T18:21:14.260361] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-11-03T18:21:14.260469] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-11-03T18:21:14.260528] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-11-03T18:21:14.260587] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-11-03T18:21:14.260619] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-11-03T18:21:14.342572] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-11-03T18:21:14.633299] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:14.901563] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T18:21:15.134883] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-11-03T18:21:15.646183] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T18:21:15.934877] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-11. [2025-11-03T18:21:16.054200] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T18:21:16.734941] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-11-03T18:21:17.412777] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T18:21:17.534833] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-11-03T18:21:17.918861] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T18:21:17.920341] [INFO ] [REMOTE ] DAY: Full fetch complete (71971 records). [2025-11-03T18:21:17.920435] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-11-03T18:21:18.363737] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-11-03T18:21:18.340097] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-11-03T18:21:18.363950] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-11-03T18:21:18.365015] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-11-03T18:21:18.365111] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-11-03T18:21:18.367900] [DEBUG] [LOCAL ] DAY: Trimmed 71971 records to 49061 (keeping 200 days of data) [2025-11-03T18:21:18.704326] [DEBUG] [LOCAL ] DAY: Primary data saved (49061 records). [2025-11-03T18:21:18.704473] [INFO ] [MAIN ] DAY: Full history saved. [2025-11-03T18:21:18.704613] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DAY took 35.8s. Estimated remaining: 4h 4m 34s. Rate: 7.3 symbols/min [2025-11-03T18:21:18.876614] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T18:21:18.932369] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:18.977619] [DEBUG] [LOCAL ] DBRG: Loaded 50748 existing records from primary storage. [2025-11-03T18:21:18.977950] [INFO ] [MAIN ] DBRG: Loaded 50748 existing records. [2025-11-03T18:21:19.163987] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:21:19.158066] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-11-03T18:21:19.165332] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-11-03T18:21:19.165426] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-11-03T18:21:19.166572] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-11-03T18:21:19.166637] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-11-03T18:21:19.445609] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T18:21:19.547879] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:19.934861] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-11-03T18:21:20.640234] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:21:20.734879] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-11-03T18:21:21.458420] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T18:21:21.534834] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-11-03T18:21:21.615403] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T18:21:22.334852] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-11-03T18:21:22.888320] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T18:21:23.065390] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T18:21:23.134825] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-11-03T18:21:23.934866] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-11-03T18:21:24.071616] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T18:21:24.734931] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-11-03T18:21:25.415016] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T18:21:25.534868] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-11-03T18:21:25.983288] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T18:21:26.334855] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-11. [2025-11-03T18:21:26.869476] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T18:21:26.973865] [DEBUG] [REMOTE ] DBD: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:21:26.974191] [WARN ] [REMOTE ] DBD: No data returned for month 2025-11 [2025-11-03T18:21:26.974281] [FATAL] [REMOTE ] DBD: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:21:26.974370] [FATAL] [MAIN ] DBD: Failed to fetch primary data. [2025-11-03T18:21:26.974455] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:21:26.974547] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-11-03T18:21:26.974629] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-11-03T18:21:26.974719] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-11-03T18:21:26.974787] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-11-03T18:21:26.974849] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DBD took 25.3s. Estimated remaining: 4h 4m 26s. Rate: 7.3 symbols/min [2025-11-03T18:21:27.139952] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-11-03T18:21:27.175517] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:27.209028] [DEBUG] [LOCAL ] DCI: Loaded 37184 existing records from primary storage. [2025-11-03T18:21:27.209307] [INFO ] [MAIN ] DCI: Loaded 37184 existing records. [2025-11-03T18:21:27.407506] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:21:27.407755] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-11-03T18:21:27.407807] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-11-03T18:21:27.408447] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-11-03T18:21:27.408518] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-11-03T18:21:27.804341] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:27.809969] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T18:21:27.934831] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-11-03T18:21:28.734849] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-11-03T18:21:29.161337] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T18:21:29.534854] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-11-03T18:21:30.086099] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T18:21:30.334915] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-11-03T18:21:30.636463] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T18:21:30.730974] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T18:21:31.134852] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-11-03T18:21:31.934845] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-11-03T18:21:32.073349] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-11-03T18:21:32.488291] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-11-03T18:21:32.734902] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-11-03T18:21:33.205200] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T18:21:33.534852] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-11-03T18:21:34.334849] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-11-03T18:21:34.727538] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T18:21:35.134956] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-11-03T18:21:35.654339] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-11-03T18:21:35.934838] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-11-03T18:21:36.055041] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-11-03T18:21:36.734890] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-11-03T18:21:37.220407] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:21:37.534920] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-11-03T18:21:37.911932] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T18:21:38.334879] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-11-03T18:21:38.728283] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T18:21:39.134952] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-11-03T18:21:39.134859] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T18:21:39.934860] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-11-03T18:21:40.290054] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-11-03T18:21:40.734893] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-11-03T18:21:41.285842] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-11-03T18:21:41.285575] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-11-03T18:21:41.534880] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-11-03T18:21:42.334989] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-11-03T18:21:42.748806] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:21:43.134916] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-11-03T18:21:43.733301] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:21:43.934877] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-11-03T18:21:44.204621] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T18:21:44.734825] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-11-03T18:21:44.952985] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T18:21:45.534929] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-11-03T18:21:45.823999] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T18:21:46.068133] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-11-03T18:21:46.334858] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-11-03T18:21:47.134874] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-11-03T18:21:47.815190] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T18:21:47.934879] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-11-03T18:21:48.140965] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T18:21:48.471601] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-11-03T18:21:48.734906] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-11-03T18:21:49.534887] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-11-03T18:21:49.942798] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T18:21:50.334871] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-11-03T18:21:50.590325] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T18:21:51.134892] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-11. [2025-11-03T18:21:51.839203] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T18:21:51.934867] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-11. [2025-11-03T18:21:52.088178] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-11 (0.95 seconds). [2025-11-03T18:21:52.089002] [INFO ] [REMOTE ] DBL: Full fetch complete (12666 records). [2025-11-03T18:21:52.089079] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-11-03T18:21:52.448240] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-11-03T18:21:52.448315] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-11-03T18:21:52.448620] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-11-03T18:21:52.448704] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-11-03T18:21:52.449177] [DEBUG] [LOCAL ] DBL: Trimmed 12666 records to 9199 (keeping 200 days of data) [2025-11-03T18:21:52.503781] [DEBUG] [LOCAL ] DBL: Primary data saved (9199 records). [2025-11-03T18:21:52.503909] [INFO ] [MAIN ] DBL: Full history saved. [2025-11-03T18:21:52.503977] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DBL took 38.4s. Estimated remaining: 4h 5m 10s. Rate: 7.2 symbols/min [2025-11-03T18:21:52.675728] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:52.691050] [DEBUG] [LOCAL ] DCO: Loaded 15396 existing records from primary storage. [2025-11-03T18:21:52.691273] [INFO ] [MAIN ] DCO: Loaded 15396 existing records. [2025-11-03T18:21:52.746265] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-11. [2025-11-03T18:21:52.872106] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:21:52.872309] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-11-03T18:21:52.872356] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-11-03T18:21:52.872696] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-11-03T18:21:52.872752] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-11-03T18:21:53.224943] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:53.534915] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-11-03T18:21:54.136824] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-11 (2.20 seconds). [2025-11-03T18:21:54.138426] [INFO ] [REMOTE ] DBRG: Full fetch complete (72796 records). [2025-11-03T18:21:54.138513] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-11-03T18:21:54.340889] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-11 (1.59 seconds). [2025-11-03T18:21:54.335459] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-11-03T18:21:54.384438] [INFO ] [REMOTE ] DBI: Full fetch complete (63981 records). [2025-11-03T18:21:54.406071] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-11-03T18:21:54.670829] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-11-03T18:21:54.722196] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-11-03T18:21:54.779406] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-11-03T18:21:54.812105] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-11-03T18:21:54.891066] [DEBUG] [LOCAL ] DBRG: Trimmed 72796 records to 50025 (keeping 200 days of data) [2025-11-03T18:21:54.935300] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-11-03T18:21:54.935684] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-11-03T18:21:54.936393] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-11-03T18:21:54.936504] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-11-03T18:21:55.034845] [DEBUG] [LOCAL ] DBI: Trimmed 63981 records to 42480 (keeping 200 days of data) [2025-11-03T18:21:55.135145] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-11-03T18:21:55.276013] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T18:21:55.276395] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-11. [2025-11-03T18:21:55.481220] [DEBUG] [LOCAL ] DBRG: Primary data saved (50025 records). [2025-11-03T18:21:55.481868] [INFO ] [MAIN ] DBRG: Full history saved. [2025-11-03T18:21:55.482210] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DBRG took 36.8s. Estimated remaining: 4h 4m 45s. Rate: 7.2 symbols/min [2025-11-03T18:21:55.668936] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:55.692354] [DEBUG] [LOCAL ] DBI: Primary data saved (42480 records). [2025-11-03T18:21:55.692508] [INFO ] [MAIN ] DBI: Full history saved. [2025-11-03T18:21:55.693281] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBI took 43.6s. Estimated remaining: 4h 4m 13s. Rate: 7.3 symbols/min [2025-11-03T18:21:55.874549] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:55.890717] [DEBUG] [LOCAL ] DD: Loaded 53680 existing records from primary storage. [2025-11-03T18:21:55.891048] [INFO ] [MAIN ] DD: Loaded 53680 existing records. [2025-11-03T18:21:55.954472] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-11-03T18:21:56.092187] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:21:56.092494] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-11-03T18:21:56.092543] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-11-03T18:21:56.093398] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-11-03T18:21:56.093456] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-11-03T18:21:56.250299] [DEBUG] [LOCAL ] DDD: Loaded 51686 existing records from primary storage. [2025-11-03T18:21:56.269678] [INFO ] [MAIN ] DDD: Loaded 51686 existing records. [2025-11-03T18:21:56.621309] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:21:56.655153] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-11-03T18:21:56.659305] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-11-03T18:21:56.659251] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:56.660159] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-11-03T18:21:56.660258] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-11-03T18:21:56.738002] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T18:21:56.737370] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-11-03T18:21:56.871677] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-11 (1.60 seconds). [2025-11-03T18:21:56.947947] [INFO ] [REMOTE ] DCI: Full fetch complete (53966 records). [2025-11-03T18:21:56.969923] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-11-03T18:21:57.173712] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:57.448051] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-11-03T18:21:57.448129] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-11-03T18:21:57.448816] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-11-03T18:21:57.448876] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-11-03T18:21:57.449865] [DEBUG] [LOCAL ] DCI: Trimmed 53966 records to 36649 (keeping 200 days of data) [2025-11-03T18:21:57.537040] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-11-03T18:21:57.664348] [DEBUG] [LOCAL ] DCI: Primary data saved (36649 records). [2025-11-03T18:21:57.664472] [INFO ] [MAIN ] DCI: Full history saved. [2025-11-03T18:21:57.665091] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DCI took 30.7s. Estimated remaining: 4h 3m 46s. Rate: 7.3 symbols/min [2025-11-03T18:21:57.831745] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:21:57.831911] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-11-03T18:21:57.831949] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-11-03T18:21:57.832076] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-11-03T18:21:57.832125] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-11-03T18:21:57.832167] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-11-03T18:21:57.832199] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-11-03T18:21:58.198575] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:21:58.199693] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T18:21:58.231566] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T18:21:58.334808] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-11-03T18:21:59.134920] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-11-03T18:21:59.516448] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:21:59.934831] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-11-03T18:22:00.617571] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-11-03T18:22:00.734823] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-11-03T18:22:01.032371] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T18:22:01.534944] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-11-03T18:22:02.072760] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T18:22:02.334902] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-11-03T18:22:02.850812] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T18:22:03.134851] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-11-03T18:22:03.370328] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T18:22:03.934860] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-11-03T18:22:04.421498] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T18:22:04.734857] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-11-03T18:22:05.022397] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T18:22:05.534854] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-11-03T18:22:06.279387] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-11-03T18:22:06.334863] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-11-03T18:22:07.001902] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T18:22:07.134859] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-11-03T18:22:07.777716] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-11-03T18:22:07.940687] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-11-03T18:22:07.954711] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-11-03T18:22:08.734866] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-11-03T18:22:09.316469] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T18:22:09.497409] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T18:22:09.534818] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-11-03T18:22:10.334901] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-11-03T18:22:11.026091] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T18:22:11.134858] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-11-03T18:22:11.879950] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T18:22:11.934844] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-11-03T18:22:12.591074] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T18:22:12.734882] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-11-03T18:22:13.151914] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T18:22:13.534862] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-11-03T18:22:14.200674] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T18:22:14.334839] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-11-03T18:22:14.847171] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T18:22:15.134869] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-11-03T18:22:15.671359] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:22:15.934878] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-11-03T18:22:16.569256] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T18:22:16.734846] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-11-03T18:22:17.197619] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:22:17.534889] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-11-03T18:22:18.174206] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T18:22:18.334887] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-11-03T18:22:18.405921] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T18:22:19.134862] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-11-03T18:22:19.934896] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-11-03T18:22:19.975368] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T18:22:20.734827] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-11-03T18:22:20.866117] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T18:22:20.985266] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-11-03T18:22:21.357178] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T18:22:21.534866] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-11. [2025-11-03T18:22:22.334880] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-11-03T18:22:22.641858] [DEBUG] [REMOTE ] DD: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:22:22.642154] [WARN ] [REMOTE ] DD: No data returned for month 2025-11 [2025-11-03T18:22:22.642246] [FATAL] [REMOTE ] DD: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:22:22.642326] [FATAL] [MAIN ] DD: Failed to fetch primary data. [2025-11-03T18:22:22.642388] [WARN ] [MAIN ] DD: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:22:22.642459] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-11-03T18:22:22.642520] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-11-03T18:22:22.642555] [INFO ] [LOCAL ] DD: Starting deletion of derivative data. [2025-11-03T18:22:22.642743] [DEBUG] [LOCAL ] DD: Deleted derivative data file. [2025-11-03T18:22:22.642826] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DD took 27.2s. Estimated remaining: 4h 4m 27s. Rate: 7.2 symbols/min [2025-11-03T18:22:22.821586] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:22:22.833567] [DEBUG] [LOCAL ] DDS: Loaded 11955 existing records from primary storage. [2025-11-03T18:22:22.833822] [INFO ] [MAIN ] DDS: Loaded 11955 existing records. [2025-11-03T18:22:23.028298] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:22:23.028577] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-11-03T18:22:23.028631] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-11-03T18:22:23.029043] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-11-03T18:22:23.029103] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-11-03T18:22:23.140023] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-11-03T18:22:23.398691] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T18:22:23.425958] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:22:23.934826] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-11-03T18:22:24.013960] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T18:22:24.680831] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T18:22:24.735050] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-11-03T18:22:25.460466] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T18:22:25.534903] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-11. [2025-11-03T18:22:26.334865] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-11-03T18:22:27.134857] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-11-03T18:22:27.593472] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:22:27.668560] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-11-03T18:22:27.903258] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-11 (2.37 seconds). [2025-11-03T18:22:27.904785] [INFO ] [REMOTE ] DDD: Full fetch complete (74117 records). [2025-11-03T18:22:27.904908] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-11-03T18:22:27.939973] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-11-03T18:22:28.322299] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-11-03T18:22:28.322397] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-11-03T18:22:28.323320] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-11-03T18:22:28.323383] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-11-03T18:22:28.324811] [DEBUG] [LOCAL ] DDD: Trimmed 74117 records to 51002 (keeping 200 days of data) [2025-11-03T18:22:28.606562] [DEBUG] [LOCAL ] DDD: Primary data saved (51002 records). [2025-11-03T18:22:28.606726] [INFO ] [MAIN ] DDD: Full history saved. [2025-11-03T18:22:28.607504] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DDD took 32.9s. Estimated remaining: 4h 4m 12s. Rate: 7.2 symbols/min [2025-11-03T18:22:28.734929] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-11-03T18:22:29.377789] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T18:22:29.422918] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T18:22:29.534841] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-11. [2025-11-03T18:22:30.334919] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-11-03T18:22:30.987378] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-11-03T18:22:31.134885] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-11-03T18:22:31.547573] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-11 (2.01 seconds). [2025-11-03T18:22:31.548960] [INFO ] [REMOTE ] DDL: Full fetch complete (54201 records). [2025-11-03T18:22:31.549056] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-11-03T18:22:31.940843] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-11-03T18:22:31.962420] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-11-03T18:22:31.962507] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-11-03T18:22:31.963232] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-11-03T18:22:31.963299] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-11-03T18:22:31.964517] [DEBUG] [LOCAL ] DDL: Trimmed 54201 records to 36735 (keeping 200 days of data) [2025-11-03T18:22:32.134178] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T18:22:32.188284] [DEBUG] [LOCAL ] DDL: Primary data saved (36735 records). [2025-11-03T18:22:32.188432] [INFO ] [MAIN ] DDL: Full history saved. [2025-11-03T18:22:32.188502] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DDL took 34.5s. Estimated remaining: 4h 3m 50s. Rate: 7.3 symbols/min [2025-11-03T18:22:32.734909] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-11. [2025-11-03T18:22:32.783152] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T18:22:33.534970] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-11-03T18:22:33.794336] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T18:22:33.795311] [INFO ] [REMOTE ] DCO: Full fetch complete (20072 records). [2025-11-03T18:22:33.795387] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-11-03T18:22:34.163862] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-11-03T18:22:34.163961] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-11-03T18:22:34.164446] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-11-03T18:22:34.164497] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-11-03T18:22:34.165081] [DEBUG] [LOCAL ] DCO: Trimmed 20072 records to 15330 (keeping 200 days of data) [2025-11-03T18:22:34.253880] [DEBUG] [LOCAL ] DCO: Primary data saved (15330 records). [2025-11-03T18:22:34.254025] [INFO ] [MAIN ] DCO: Full history saved. [2025-11-03T18:22:34.258742] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DCO took 41.8s. Estimated remaining: 4h 3m 24s. Rate: 7.3 symbols/min [2025-11-03T18:22:34.264560] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T18:22:34.334868] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-11-03T18:22:34.972952] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T18:22:35.134909] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-11-03T18:22:35.686121] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-11-03T18:22:35.934954] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-11-03T18:22:36.569217] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-11-03T18:22:36.734861] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-11-03T18:22:37.352685] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T18:22:37.534936] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-11-03T18:22:38.047827] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T18:22:38.334898] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-11. [2025-11-03T18:22:39.106549] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-11 (0.77 seconds). [2025-11-03T18:22:39.107466] [INFO ] [REMOTE ] DDS: Full fetch complete (18203 records). [2025-11-03T18:22:39.107535] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-11-03T18:22:39.556636] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-11-03T18:22:39.556750] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-11-03T18:22:39.557172] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-11-03T18:22:39.557483] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-11-03T18:22:39.558711] [DEBUG] [LOCAL ] DDS: Trimmed 18203 records to 11810 (keeping 200 days of data) [2025-11-03T18:22:39.640297] [DEBUG] [LOCAL ] DDS: Primary data saved (11810 records). [2025-11-03T18:22:39.640429] [INFO ] [MAIN ] DDS: Full history saved. [2025-11-03T18:22:39.640507] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDS took 17.0s. Estimated remaining: 4h 3m 7s. Rate: 7.3 symbols/min [2025-11-03T18:22:40.282754] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:22:40.369968] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:22:40.509242] [DEBUG] [LOCAL ] DDT: Loaded 1808 existing records from primary storage. [2025-11-03T18:22:40.502994] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:22:40.509974] [INFO ] [MAIN ] DDT: Loaded 1808 existing records. [2025-11-03T18:22:40.565188] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:22:40.722089] [DEBUG] [LOCAL ] DEA: Loaded 40188 existing records from primary storage. [2025-11-03T18:22:40.762337] [INFO ] [MAIN ] DEA: Loaded 40188 existing records. [2025-11-03T18:22:40.765837] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:22:40.800008] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-11-03T18:22:40.853382] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-11-03T18:22:40.864597] [DEBUG] [LOCAL ] DEC: Loaded 30197 existing records from primary storage. [2025-11-03T18:22:40.869991] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-11-03T18:22:40.882078] [DEBUG] [LOCAL ] DE: Loaded 47962 existing records from primary storage. [2025-11-03T18:22:40.875594] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-11-03T18:22:40.882679] [INFO ] [MAIN ] DEC: Loaded 30197 existing records. [2025-11-03T18:22:40.945816] [INFO ] [MAIN ] DE: Loaded 47962 existing records. [2025-11-03T18:22:41.317805] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:22:41.367522] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-11-03T18:22:41.411218] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-11-03T18:22:41.462627] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-11-03T18:22:41.477523] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-11-03T18:22:41.772200] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:22:41.834733] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-11-03T18:22:41.829257] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:22:41.874196] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-11-03T18:22:41.887543] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-11-03T18:22:41.904599] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-11-03T18:22:41.915255] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-11-03T18:22:41.960165] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:22:41.925873] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-11-03T18:22:41.965914] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-11-03T18:22:41.965456] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-11-03T18:22:41.965785] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-11-03T18:22:42.687023] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-11-03T18:22:42.753376] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-11-03T18:22:42.840065] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:22:42.841712] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-11-03T18:22:43.011993] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:22:43.014892] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-11-03T18:22:43.021013] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:22:43.021551] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-11-03T18:22:43.208346] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-11-03T18:22:43.209697] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-11-03T18:22:43.563032] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T18:22:43.934913] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-11-03T18:22:44.060433] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T18:22:44.139586] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T18:22:44.419836] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-11-03T18:22:44.448107] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:22:44.734925] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-11-03T18:22:45.534833] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-11-03T18:22:45.654472] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T18:22:46.334926] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-11-03T18:22:46.752627] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:22:47.134915] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-11-03T18:22:47.346543] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T18:22:47.436916] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-11-03T18:22:47.934871] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-11-03T18:22:48.258118] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-11-03T18:22:48.734926] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-11-03T18:22:49.534871] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-11-03T18:22:49.897230] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T18:22:50.334858] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-11-03T18:22:50.731254] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T18:22:51.010976] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-11-03T18:22:51.134902] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-11-03T18:22:51.934883] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-11-03T18:22:52.231757] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T18:22:52.734888] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-11-03T18:22:53.098314] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-11-03T18:22:53.229876] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T18:22:53.534879] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-11-03T18:22:54.334855] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-11-03T18:22:54.930830] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T18:22:55.134874] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-11-03T18:22:55.601208] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T18:22:55.603311] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T18:22:55.934861] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-11-03T18:22:56.734818] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-11-03T18:22:56.912296] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T18:22:57.092826] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T18:22:57.534849] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-11. [2025-11-03T18:22:58.105515] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T18:22:58.106177] [INFO ] [REMOTE ] DDT: Full fetch complete (2825 records). [2025-11-03T18:22:58.106245] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-11-03T18:22:58.340027] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-11-03T18:22:58.488242] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-11-03T18:22:58.488319] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-11-03T18:22:58.488432] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-11-03T18:22:58.488473] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-11-03T18:22:58.488880] [DEBUG] [LOCAL ] DDT: Trimmed 2825 records to 1778 (keeping 200 days of data) [2025-11-03T18:22:58.499926] [DEBUG] [LOCAL ] DDT: Primary data saved (1778 records). [2025-11-03T18:22:58.500001] [INFO ] [MAIN ] DDT: Full history saved. [2025-11-03T18:22:58.500074] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 18.9s. Estimated remaining: 4h 3m 30s. Rate: 7.2 symbols/min [2025-11-03T18:22:58.677607] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:22:58.728970] [DEBUG] [LOCAL ] DECK: Loaded 54083 existing records from primary storage. [2025-11-03T18:22:58.729291] [INFO ] [MAIN ] DECK: Loaded 54083 existing records. [2025-11-03T18:22:58.911605] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:22:58.911876] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-11-03T18:22:58.911930] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-11-03T18:22:58.912825] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-11-03T18:22:58.912884] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-11-03T18:22:59.140016] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-11-03T18:22:59.289621] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:22:59.934911] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-11-03T18:23:00.734996] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-11-03T18:23:05.853712] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (7.51 seconds). [2025-11-03T18:23:05.863013] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-11-03T18:23:06.067976] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (6.93 seconds). [2025-11-03T18:23:06.078831] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-11-03T18:23:06.192495] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (6.26 seconds). [2025-11-03T18:23:06.202664] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-11-03T18:23:06.239699] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (5.50 seconds). [2025-11-03T18:23:06.246528] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-11-03T18:23:07.172734] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T18:23:07.179888] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-11-03T18:23:07.475915] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T18:23:07.486283] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-11-03T18:23:07.924121] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-11-03T18:23:07.935873] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-11-03T18:23:08.084010] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T18:23:08.090863] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-11-03T18:23:08.244304] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-11-03T18:23:08.252470] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-11-03T18:23:08.855688] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-11-03T18:23:08.861611] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-11-03T18:23:09.023304] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T18:23:09.329678] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T18:23:09.534825] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-11-03T18:23:09.666207] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-11-03T18:23:09.759341] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-11-03T18:23:10.334906] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-11-03T18:23:10.943079] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T18:23:11.134851] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-11-03T18:23:11.654720] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T18:23:11.934886] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-11-03T18:23:12.568288] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T18:23:12.734847] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-11-03T18:23:13.350438] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T18:23:13.534855] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-11-03T18:23:14.099905] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T18:23:14.334906] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-11-03T18:23:15.134826] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-11-03T18:23:15.347970] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-11-03T18:23:15.934854] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-11-03T18:23:16.221289] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-11-03T18:23:16.374518] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T18:23:16.734912] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-11. [2025-11-03T18:23:17.497291] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-11-03T18:23:17.534862] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-11-03T18:23:18.334876] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-11. [2025-11-03T18:23:18.561595] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T18:23:18.563485] [INFO ] [REMOTE ] DEA: Full fetch complete (61390 records). [2025-11-03T18:23:18.563621] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-11-03T18:23:18.954716] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-11-03T18:23:18.954807] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-11-03T18:23:18.955527] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-11-03T18:23:18.955566] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-11-03T18:23:18.956721] [DEBUG] [LOCAL ] DEA: Trimmed 61390 records to 39407 (keeping 200 days of data) [2025-11-03T18:23:19.139068] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-11. [2025-11-03T18:23:19.230486] [DEBUG] [LOCAL ] DEA: Primary data saved (39407 records). [2025-11-03T18:23:19.230968] [INFO ] [MAIN ] DEA: Full history saved. [2025-11-03T18:23:19.232356] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DEA took 39.6s. Estimated remaining: 4h 3m 58s. Rate: 7.2 symbols/min [2025-11-03T18:23:19.232218] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-11-03T18:23:19.410617] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:23:19.410783] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-11-03T18:23:19.410825] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-11-03T18:23:19.410946] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-11-03T18:23:19.410987] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-11-03T18:23:19.411027] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-11-03T18:23:19.411058] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-11-03T18:23:19.764204] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-11 (1.43 seconds). [2025-11-03T18:23:19.769266] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:23:19.771585] [INFO ] [REMOTE ] DE: Full fetch complete (69809 records). [2025-11-03T18:23:19.771795] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-11-03T18:23:19.948882] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-11-03T18:23:20.172150] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-11-03T18:23:20.172292] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-11-03T18:23:20.173202] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-11-03T18:23:20.173267] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-11-03T18:23:20.174613] [DEBUG] [LOCAL ] DE: Trimmed 69809 records to 47290 (keeping 200 days of data) [2025-11-03T18:23:20.471079] [DEBUG] [LOCAL ] DE: Primary data saved (47290 records). [2025-11-03T18:23:20.471224] [INFO ] [MAIN ] DE: Full history saved. [2025-11-03T18:23:20.472260] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DE took 40.8s. Estimated remaining: 4h 3m 29s. Rate: 7.2 symbols/min [2025-11-03T18:23:20.652925] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:23:20.706382] [DEBUG] [LOCAL ] DELL: Loaded 54515 existing records from primary storage. [2025-11-03T18:23:20.706769] [INFO ] [MAIN ] DELL: Loaded 54515 existing records. [2025-11-03T18:23:20.738805] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-11-03T18:23:20.787991] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-11 (1.65 seconds). [2025-11-03T18:23:20.816784] [INFO ] [REMOTE ] DEC: Full fetch complete (44862 records). [2025-11-03T18:23:20.838465] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-11-03T18:23:20.966273] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:23:20.978426] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-11-03T18:23:20.983680] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-11-03T18:23:21.005561] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-11-03T18:23:21.005749] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-11-03T18:23:21.593959] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-11-03T18:23:21.613179] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-11-03T18:23:21.631912] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-11-03T18:23:21.637897] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-11-03T18:23:21.734668] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:23:21.734853] [DEBUG] [LOCAL ] DEC: Trimmed 44862 records to 29761 (keeping 200 days of data) [2025-11-03T18:23:21.735489] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-11-03T18:23:21.955296] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-11-03T18:23:21.977817] [DEBUG] [LOCAL ] DEC: Primary data saved (29761 records). [2025-11-03T18:23:21.977953] [INFO ] [MAIN ] DEC: Full history saved. [2025-11-03T18:23:21.978042] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DEC took 42.2s. Estimated remaining: 4h 3m 1s. Rate: 7.3 symbols/min [2025-11-03T18:23:22.162915] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:23:22.163204] [DEBUG] [LOCAL ] DEO: No existing data file found in primary storage. [2025-11-03T18:23:22.163301] [WARN ] [MAIN ] DEO: No existing data found, performing full refresh instead. [2025-11-03T18:23:22.163488] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-11-03T18:23:22.163543] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-11-03T18:23:22.163587] [DEBUG] [LOCAL ] DEO: No primary data file found to delete. [2025-11-03T18:23:22.163620] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-11-03T18:23:22.338155] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-11-03T18:23:22.526231] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:23:22.559075] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-11-03T18:23:23.134852] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-11-03T18:23:23.471036] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T18:23:23.670575] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-11-03T18:23:23.934916] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-11-03T18:23:24.725981] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-11-03T18:23:24.740186] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-11-03T18:23:25.093403] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T18:23:25.534850] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-11-03T18:23:26.334824] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-11-03T18:23:26.379732] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-11-03T18:23:27.098079] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T18:23:27.134961] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-11-03T18:23:27.934864] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-11-03T18:23:28.052917] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-11-03T18:23:28.647806] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T18:23:28.734869] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-11-03T18:23:29.534854] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-11-03T18:23:29.736884] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-11-03T18:23:30.212258] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T18:23:30.334856] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-11-03T18:23:31.134855] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-11-03T18:23:31.504871] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-11-03T18:23:31.546698] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:23:31.934891] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-11-03T18:23:32.734873] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-11-03T18:23:33.264187] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:23:33.313363] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-11-03T18:23:33.534881] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-11-03T18:23:34.052623] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:23:34.334850] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-11-03T18:23:35.134877] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-11. [2025-11-03T18:23:35.367193] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-11-03T18:23:35.934865] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-11-03T18:23:36.079182] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-11-03T18:23:36.734851] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-11-03T18:23:37.145932] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:23:37.534903] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-11-03T18:23:38.172796] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-11 (3.04 seconds). [2025-11-03T18:23:38.175783] [INFO ] [REMOTE ] DECK: Full fetch complete (77315 records). [2025-11-03T18:23:38.175934] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-11-03T18:23:38.341457] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-11-03T18:23:38.662539] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-11-03T18:23:38.710038] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-11-03T18:23:38.710305] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-11-03T18:23:38.712014] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-11-03T18:23:38.712183] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-11-03T18:23:38.714621] [DEBUG] [LOCAL ] DECK: Trimmed 77315 records to 53311 (keeping 200 days of data) [2025-11-03T18:23:39.135868] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-11-03T18:23:39.218465] [DEBUG] [LOCAL ] DECK: Primary data saved (53311 records). [2025-11-03T18:23:39.218696] [INFO ] [MAIN ] DECK: Full history saved. [2025-11-03T18:23:39.220143] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DECK took 40.7s. Estimated remaining: 4h 3m 19s. Rate: 7.2 symbols/min [2025-11-03T18:23:39.485769] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:23:39.522403] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-11-03T18:23:39.557830] [DEBUG] [LOCAL ] DFH: Loaded 31483 existing records from primary storage. [2025-11-03T18:23:39.558254] [INFO ] [MAIN ] DFH: Loaded 31483 existing records. [2025-11-03T18:23:39.755861] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:23:39.770830] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-11-03T18:23:39.780174] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-11-03T18:23:39.781527] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-11-03T18:23:39.781571] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-11-03T18:23:39.785072] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-11-03T18:23:39.940003] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-11-03T18:23:40.176017] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:23:40.647694] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T18:23:40.734900] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-11-03T18:23:41.009179] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T18:23:41.534900] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-11-03T18:23:42.334827] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-11-03T18:23:42.497832] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-11-03T18:23:42.719529] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T18:23:43.134925] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-11-03T18:23:43.841488] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:23:43.934860] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-11. [2025-11-03T18:23:44.734863] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-11-03T18:23:44.845134] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-11-03T18:23:45.534895] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-11-03T18:23:46.234993] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T18:23:46.334835] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-11-03T18:23:46.502566] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-11-03T18:23:46.558243] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-11 (2.62 seconds). [2025-11-03T18:23:46.559956] [INFO ] [REMOTE ] DEO: Full fetch complete (71767 records). [2025-11-03T18:23:46.560053] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-11-03T18:23:46.986276] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-11-03T18:23:46.986445] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-11-03T18:23:46.987719] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-11-03T18:23:46.987794] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-11-03T18:23:46.989763] [DEBUG] [LOCAL ] DEO: Trimmed 71767 records to 49216 (keeping 200 days of data) [2025-11-03T18:23:47.182446] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-11-03T18:23:47.324933] [DEBUG] [LOCAL ] DEO: Primary data saved (49216 records). [2025-11-03T18:23:47.325118] [INFO ] [MAIN ] DEO: Full history saved. [2025-11-03T18:23:47.325205] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DEO took 25.3s. Estimated remaining: 4h 3m 10s. Rate: 7.2 symbols/min [2025-11-03T18:23:47.518888] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:23:47.543077] [DEBUG] [LOCAL ] DFIN: Loaded 22533 existing records from primary storage. [2025-11-03T18:23:47.543497] [INFO ] [MAIN ] DFIN: Loaded 22533 existing records. [2025-11-03T18:23:47.750256] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:23:47.750784] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-11-03T18:23:47.750906] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-11-03T18:23:47.751397] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-11-03T18:23:47.751522] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-11-03T18:23:47.939732] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-11-03T18:23:47.983518] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-11-03T18:23:48.245070] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:23:48.734900] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-11-03T18:23:48.926420] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T18:23:48.994234] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-11-03T18:23:49.534863] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-11-03T18:23:49.961053] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T18:23:50.334890] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-11-03T18:23:50.489766] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T18:23:51.134877] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-11-03T18:23:51.164967] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T18:23:51.934874] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-11-03T18:23:52.739962] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-11-03T18:23:52.749814] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T18:23:53.165706] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-11-03T18:23:53.534869] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-11-03T18:23:53.972250] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T18:23:54.334857] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-11. [2025-11-03T18:23:54.435103] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-11-03T18:23:55.134855] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-11-03T18:23:55.934885] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-11. [2025-11-03T18:23:56.014589] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T18:23:56.595189] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T18:23:56.596614] [INFO ] [REMOTE ] DEI: Full fetch complete (69937 records). [2025-11-03T18:23:56.596733] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-11-03T18:23:56.740062] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-11-03T18:23:56.996095] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-11-03T18:23:56.996178] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-11-03T18:23:56.997064] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-11-03T18:23:56.997129] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-11-03T18:23:56.998514] [DEBUG] [LOCAL ] DEI: Trimmed 69937 records to 48175 (keeping 200 days of data) [2025-11-03T18:23:57.298347] [DEBUG] [LOCAL ] DEI: Primary data saved (48175 records). [2025-11-03T18:23:57.298483] [INFO ] [MAIN ] DEI: Full history saved. [2025-11-03T18:23:57.298555] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DEI took 38.1s. Estimated remaining: 4h 3m 6s. Rate: 7.2 symbols/min [2025-11-03T18:23:57.477581] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:23:57.488117] [DEBUG] [LOCAL ] DFP: Loaded 10808 existing records from primary storage. [2025-11-03T18:23:57.488315] [INFO ] [MAIN ] DFP: Loaded 10808 existing records. [2025-11-03T18:23:57.550206] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-11-03T18:23:57.678710] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:23:57.678910] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-11-03T18:23:57.678959] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-11-03T18:23:57.679235] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-11-03T18:23:57.679294] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-11-03T18:23:58.064597] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T18:23:58.068895] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:23:58.334877] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-11-03T18:23:58.778875] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T18:23:58.936891] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T18:23:59.134841] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-11-03T18:23:59.278397] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-11 (3.34 seconds). [2025-11-03T18:23:59.280687] [INFO ] [REMOTE ] DELL: Full fetch complete (77914 records). [2025-11-03T18:23:59.280865] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-11-03T18:23:59.699847] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-11-03T18:23:59.706323] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-11-03T18:23:59.708182] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-11-03T18:23:59.707903] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-11-03T18:23:59.711310] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-11-03T18:23:59.712724] [DEBUG] [LOCAL ] DELL: Trimmed 77914 records to 53735 (keeping 200 days of data) [2025-11-03T18:23:59.934847] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-11-03T18:24:00.056722] [DEBUG] [LOCAL ] DELL: Primary data saved (53735 records). [2025-11-03T18:24:00.056865] [INFO ] [MAIN ] DELL: Full history saved. [2025-11-03T18:24:00.057634] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DELL took 39.6s. Estimated remaining: 4h 2m 42s. Rate: 7.2 symbols/min [2025-11-03T18:24:00.231573] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:00.231778] [DEBUG] [LOCAL ] DG: No existing data file found in primary storage. [2025-11-03T18:24:00.231820] [WARN ] [MAIN ] DG: No existing data found, performing full refresh instead. [2025-11-03T18:24:00.231929] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-11-03T18:24:00.231969] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-11-03T18:24:00.232010] [DEBUG] [LOCAL ] DG: No primary data file found to delete. [2025-11-03T18:24:00.232041] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-11-03T18:24:00.622051] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:00.734850] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-11-03T18:24:00.953242] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T18:24:01.534874] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-11-03T18:24:02.223547] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T18:24:02.335265] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T18:24:02.335599] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-11-03T18:24:03.134906] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-11-03T18:24:03.731807] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T18:24:03.934831] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-11-03T18:24:04.193596] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T18:24:04.638577] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T18:24:04.734861] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-11-03T18:24:05.534905] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-11-03T18:24:05.718173] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T18:24:06.340003] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-11. [2025-11-03T18:24:06.352546] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T18:24:07.134875] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-11-03T18:24:07.660593] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T18:24:07.661798] [INFO ] [REMOTE ] DFH: Full fetch complete (46938 records). [2025-11-03T18:24:07.661872] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-11-03T18:24:07.828496] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-11-03T18:24:07.940000] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-11-03T18:24:08.069867] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-11-03T18:24:08.069950] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-11-03T18:24:08.070617] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-11-03T18:24:08.070685] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-11-03T18:24:08.071705] [DEBUG] [LOCAL ] DFH: Trimmed 46938 records to 30931 (keeping 200 days of data) [2025-11-03T18:24:08.255207] [DEBUG] [LOCAL ] DFH: Primary data saved (30931 records). [2025-11-03T18:24:08.255343] [INFO ] [MAIN ] DFH: Full history saved. [2025-11-03T18:24:08.256093] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFH took 29.0s. Estimated remaining: 4h 2m 34s. Rate: 7.2 symbols/min [2025-11-03T18:24:08.438551] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:08.484973] [DEBUG] [LOCAL ] DGX: Loaded 45053 existing records from primary storage. [2025-11-03T18:24:08.485287] [INFO ] [MAIN ] DGX: Loaded 45053 existing records. [2025-11-03T18:24:08.682850] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:24:08.683179] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-11-03T18:24:08.683247] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-11-03T18:24:08.684271] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-11-03T18:24:08.684343] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-11-03T18:24:08.744803] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-11-03T18:24:08.972416] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T18:24:09.092905] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:09.534839] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-11-03T18:24:09.557947] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-11-03T18:24:10.334878] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-11-03T18:24:11.136269] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-11-03T18:24:11.139969] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-11-03T18:24:11.167918] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T18:24:11.934868] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-11-03T18:24:12.443564] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:24:12.474391] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T18:24:12.734860] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-11-03T18:24:13.303181] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-11-03T18:24:13.534853] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-11-03T18:24:14.334848] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-11-03T18:24:14.974080] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T18:24:15.134863] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-11-03T18:24:15.516132] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:24:15.934849] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-11-03T18:24:16.734821] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-11-03T18:24:16.864418] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T18:24:16.933997] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-11-03T18:24:17.361319] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-11-03T18:24:17.534870] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-11-03T18:24:18.334854] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-11-03T18:24:18.933261] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T18:24:19.134849] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-11-03T18:24:19.664133] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T18:24:19.934888] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-11-03T18:24:19.992448] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T18:24:20.734852] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-11-03T18:24:21.187579] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T18:24:21.447928] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T18:24:21.534855] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-11. [2025-11-03T18:24:22.334908] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-11-03T18:24:22.704846] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T18:24:22.705939] [INFO ] [REMOTE ] DFIN: Full fetch complete (33977 records). [2025-11-03T18:24:22.706039] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-11-03T18:24:22.976064] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-11-03T18:24:23.094465] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-11-03T18:24:23.094556] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-11-03T18:24:23.095188] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-11-03T18:24:23.095252] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-11-03T18:24:23.096282] [DEBUG] [LOCAL ] DFIN: Trimmed 33977 records to 22065 (keeping 200 days of data) [2025-11-03T18:24:23.142706] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-11-03T18:24:23.228804] [DEBUG] [LOCAL ] DFIN: Primary data saved (22065 records). [2025-11-03T18:24:23.228948] [INFO ] [MAIN ] DFIN: Full history saved. [2025-11-03T18:24:23.229034] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DFIN took 35.9s. Estimated remaining: 4h 2m 45s. Rate: 7.2 symbols/min [2025-11-03T18:24:23.400422] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:23.419364] [DEBUG] [LOCAL ] DHF: Loaded 20503 existing records from primary storage. [2025-11-03T18:24:23.419842] [INFO ] [MAIN ] DHF: Loaded 20503 existing records. [2025-11-03T18:24:23.598362] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:24:23.598598] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-11-03T18:24:23.598671] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-11-03T18:24:23.599091] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-11-03T18:24:23.599147] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-11-03T18:24:23.948108] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-11-03T18:24:23.953348] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:24.734962] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-11-03T18:24:24.785040] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T18:24:25.169425] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T18:24:25.534831] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-11-03T18:24:25.614043] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T18:24:26.334879] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-11-03T18:24:26.712911] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:24:27.134860] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-11. [2025-11-03T18:24:27.934904] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-11-03T18:24:27.985660] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-11-03T18:24:28.006454] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T18:24:28.007344] [INFO ] [REMOTE ] DFP: Full fetch complete (15827 records). [2025-11-03T18:24:28.007421] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-11-03T18:24:28.364545] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-11-03T18:24:28.364667] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-11-03T18:24:28.365064] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-11-03T18:24:28.365104] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-11-03T18:24:28.365592] [DEBUG] [LOCAL ] DFP: Trimmed 15827 records to 10642 (keeping 200 days of data) [2025-11-03T18:24:28.432179] [DEBUG] [LOCAL ] DFP: Primary data saved (10642 records). [2025-11-03T18:24:28.432352] [INFO ] [MAIN ] DFP: Full history saved. [2025-11-03T18:24:28.432453] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DFP took 31.1s. Estimated remaining: 4h 2m 27s. Rate: 7.2 symbols/min [2025-11-03T18:24:28.598744] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:28.649469] [DEBUG] [LOCAL ] DHI: Loaded 54119 existing records from primary storage. [2025-11-03T18:24:28.649796] [INFO ] [MAIN ] DHI: Loaded 54119 existing records. [2025-11-03T18:24:28.740033] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-11-03T18:24:28.827104] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:24:28.827350] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-11-03T18:24:28.827401] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-11-03T18:24:28.828541] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-11-03T18:24:28.828598] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-11-03T18:24:29.181443] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:29.223335] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:24:29.534903] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-11-03T18:24:30.319196] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T18:24:30.334803] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-11-03T18:24:30.900599] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T18:24:31.134843] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-11-03T18:24:31.938530] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-11-03T18:24:31.939901] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T18:24:32.009219] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T18:24:32.734869] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-11-03T18:24:33.094536] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:24:33.534870] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-11-03T18:24:34.224975] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T18:24:34.334904] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-11-03T18:24:34.359068] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T18:24:35.134920] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-11-03T18:24:35.634797] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:24:35.934882] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-11-03T18:24:36.617374] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T18:24:36.734908] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-11. [2025-11-03T18:24:37.432514] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T18:24:37.534939] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-11-03T18:24:37.683280] [DEBUG] [REMOTE ] DGX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:24:37.683708] [WARN ] [REMOTE ] DGX: No data returned for month 2025-11 [2025-11-03T18:24:37.683831] [FATAL] [REMOTE ] DGX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:24:37.683950] [FATAL] [MAIN ] DGX: Failed to fetch primary data. [2025-11-03T18:24:37.684023] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:24:37.684096] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-11-03T18:24:37.684165] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-11-03T18:24:37.684209] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-11-03T18:24:37.684441] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-11-03T18:24:37.684972] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DGX took 29.4s. Estimated remaining: 4h 2m 22s. Rate: 7.2 symbols/min [2025-11-03T18:24:37.919674] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:37.919913] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-11-03T18:24:37.919988] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-11-03T18:24:37.920129] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-11-03T18:24:37.920181] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-11-03T18:24:37.920226] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-11-03T18:24:37.920259] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-11-03T18:24:38.296523] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:38.334880] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-11-03T18:24:39.134920] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-11. [2025-11-03T18:24:39.191275] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-11-03T18:24:39.821910] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T18:24:39.934868] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-11-03T18:24:40.734858] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-11-03T18:24:41.444183] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-11-03T18:24:41.534830] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-11-03T18:24:41.566350] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-11 (2.43 seconds). [2025-11-03T18:24:41.568163] [INFO ] [REMOTE ] DG: Full fetch complete (77239 records). [2025-11-03T18:24:41.568292] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-11-03T18:24:41.977572] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T18:24:42.005707] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-11-03T18:24:42.006137] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-11-03T18:24:42.007269] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-11-03T18:24:42.007333] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-11-03T18:24:42.008793] [DEBUG] [LOCAL ] DG: Trimmed 77239 records to 53158 (keeping 200 days of data) [2025-11-03T18:24:42.332809] [DEBUG] [LOCAL ] DG: Primary data saved (53158 records). [2025-11-03T18:24:42.332929] [INFO ] [MAIN ] DG: Full history saved. [2025-11-03T18:24:42.332995] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DG took 42.3s. Estimated remaining: 4h 2m 3s. Rate: 7.2 symbols/min [2025-11-03T18:24:42.344037] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-11-03T18:24:42.503080] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:42.544481] [DEBUG] [LOCAL ] DHT: Loaded 48510 existing records from primary storage. [2025-11-03T18:24:42.544797] [INFO ] [MAIN ] DHT: Loaded 48510 existing records. [2025-11-03T18:24:42.718582] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:24:42.718846] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-11-03T18:24:42.718894] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-11-03T18:24:42.719694] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-11-03T18:24:42.719751] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-11-03T18:24:43.083249] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:43.128920] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T18:24:43.140120] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-11-03T18:24:43.153599] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-11-03T18:24:43.934870] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-11-03T18:24:44.581592] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T18:24:44.734836] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-11-03T18:24:44.769134] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-11-03T18:24:45.534872] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-11-03T18:24:46.244607] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T18:24:46.313244] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T18:24:46.334867] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-11-03T18:24:47.134827] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-11-03T18:24:47.194839] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-11-03T18:24:47.934866] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-11-03T18:24:48.483549] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T18:24:48.734880] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-11-03T18:24:49.234318] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:24:49.534868] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-11-03T18:24:50.260855] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T18:24:50.334825] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-11-03T18:24:50.906268] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:24:51.134854] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-11-03T18:24:51.783356] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T18:24:51.934850] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-11-03T18:24:52.647335] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T18:24:52.734864] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-11-03T18:24:53.286185] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T18:24:53.534906] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-11-03T18:24:54.320367] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:24:54.334801] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-11-03T18:24:54.399589] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-11-03T18:24:55.043622] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T18:24:55.134854] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-11. [2025-11-03T18:24:55.934912] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-11-03T18:24:55.993941] [DEBUG] [REMOTE ] DHR: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-11-03T18:24:55.994305] [WARN ] [REMOTE ] DHR: No data returned for month 2025-07 [2025-11-03T18:24:55.994413] [FATAL] [REMOTE ] DHR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:24:55.994506] [FATAL] [MAIN ] DHR: Failed to fetch primary data. [2025-11-03T18:24:55.994558] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:24:55.994664] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-11-03T18:24:55.994762] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-11-03T18:24:55.994812] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-11-03T18:24:55.994868] [DEBUG] [LOCAL ] DHR: No derivative data file found to delete. [2025-11-03T18:24:55.994930] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DHR took 18.3s. Estimated remaining: 4h 2m 10s. Rate: 7.2 symbols/min [2025-11-03T18:24:56.117262] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T18:24:56.126707] [INFO ] [REMOTE ] DHF: Full fetch complete (29885 records). [2025-11-03T18:24:56.137121] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-11-03T18:24:56.284035] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:56.303599] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-11-03T18:24:56.306104] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-11-03T18:24:56.306521] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-11-03T18:24:56.312035] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-11-03T18:24:56.327613] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-11-03T18:24:56.356120] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-11-03T18:24:56.791044] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-11-03T18:24:56.737082] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-11-03T18:24:56.815278] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-11-03T18:24:56.825342] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-11-03T18:24:56.825517] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-11-03T18:24:56.864512] [DEBUG] [LOCAL ] DHF: Trimmed 29885 records to 20277 (keeping 200 days of data) [2025-11-03T18:24:57.037122] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:57.060144] [DEBUG] [LOCAL ] DHF: Primary data saved (20277 records). [2025-11-03T18:24:57.060627] [INFO ] [MAIN ] DHF: Full history saved. [2025-11-03T18:24:57.060776] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DHF took 33.8s. Estimated remaining: 4h 1m 41s. Rate: 7.2 symbols/min [2025-11-03T18:24:57.224306] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:24:57.236421] [DEBUG] [LOCAL ] DIAX: Loaded 12263 existing records from primary storage. [2025-11-03T18:24:57.236637] [INFO ] [MAIN ] DIAX: Loaded 12263 existing records. [2025-11-03T18:24:57.408085] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:24:57.408284] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-11-03T18:24:57.408335] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-11-03T18:24:57.408721] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-11-03T18:24:57.408777] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-11-03T18:24:57.543526] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-11-03T18:24:57.779255] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:24:58.334836] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-11-03T18:24:58.373028] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-11-03T18:24:59.032339] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T18:24:59.134893] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-11-03T18:24:59.338039] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-11-03T18:24:59.934885] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-11-03T18:25:00.344907] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:25:00.729834] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T18:25:00.734806] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-11-03T18:25:01.534992] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-11-03T18:25:01.721197] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T18:25:02.334891] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-11-03T18:25:02.857070] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T18:25:03.134887] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-11-03T18:25:03.195986] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-11-03T18:25:03.934863] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-11-03T18:25:03.989747] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T18:25:04.507362] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-11-03T18:25:04.734876] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-11-03T18:25:05.534910] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-11. [2025-11-03T18:25:05.702397] [DEBUG] [REMOTE ] DHI: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:25:05.702744] [WARN ] [REMOTE ] DHI: No data returned for month 2025-11 [2025-11-03T18:25:05.702836] [FATAL] [REMOTE ] DHI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:25:05.702912] [FATAL] [MAIN ] DHI: Failed to fetch primary data. [2025-11-03T18:25:05.702947] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:25:05.703008] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-11-03T18:25:05.703070] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-11-03T18:25:05.703104] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-11-03T18:25:05.703268] [DEBUG] [LOCAL ] DHI: Deleted derivative data file. [2025-11-03T18:25:05.703965] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DHI took 37.3s. Estimated remaining: 4h 1m 34s. Rate: 7.2 symbols/min [2025-11-03T18:25:05.874179] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:25:05.908263] [DEBUG] [LOCAL ] DIN: Loaded 36684 existing records from primary storage. [2025-11-03T18:25:05.908565] [INFO ] [MAIN ] DIN: Loaded 36684 existing records. [2025-11-03T18:25:06.087070] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:25:06.087384] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-11-03T18:25:06.087457] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-11-03T18:25:06.088182] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-11-03T18:25:06.088330] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-11-03T18:25:06.244151] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T18:25:06.343978] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-11-03T18:25:06.492404] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:25:07.134845] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-11-03T18:25:07.151283] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-11-03T18:25:07.934925] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-11-03T18:25:08.495040] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T18:25:08.537762] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T18:25:08.734957] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-11-03T18:25:09.281623] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-11-03T18:25:09.534851] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-11-03T18:25:10.334855] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-11-03T18:25:10.976043] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T18:25:11.134831] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-11-03T18:25:11.163995] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T18:25:11.934856] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-11-03T18:25:12.404530] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T18:25:12.435044] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T18:25:12.734852] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-11-03T18:25:13.298455] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-11-03T18:25:13.534834] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-11-03T18:25:14.157979] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T18:25:14.334840] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-11-03T18:25:14.855780] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-11-03T18:25:15.134849] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-11-03T18:25:15.934904] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-11-03T18:25:16.219333] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T18:25:16.613117] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-11-03T18:25:16.734854] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-11-03T18:25:17.534863] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-11-03T18:25:17.958715] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T18:25:17.979736] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-11-03T18:25:18.334853] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-11-03T18:25:19.134876] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-11. [2025-11-03T18:25:19.892552] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T18:25:19.934836] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-11. [2025-11-03T18:25:19.951612] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T18:25:19.952386] [INFO ] [REMOTE ] DIAX: Full fetch complete (17665 records). [2025-11-03T18:25:19.952452] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-11-03T18:25:20.319181] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-11-03T18:25:20.319261] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-11-03T18:25:20.319671] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-11-03T18:25:20.319733] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-11-03T18:25:20.320301] [DEBUG] [LOCAL ] DIAX: Trimmed 17665 records to 12070 (keeping 200 days of data) [2025-11-03T18:25:20.392101] [DEBUG] [LOCAL ] DIAX: Primary data saved (12070 records). [2025-11-03T18:25:20.392241] [INFO ] [MAIN ] DIAX: Full history saved. [2025-11-03T18:25:20.392317] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DIAX took 23.3s. Estimated remaining: 4h 1m 44s. Rate: 7.2 symbols/min [2025-11-03T18:25:20.563984] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:25:20.611813] [DEBUG] [LOCAL ] DINO: Loaded 53527 existing records from primary storage. [2025-11-03T18:25:20.612120] [INFO ] [MAIN ] DINO: Loaded 53527 existing records. [2025-11-03T18:25:20.748176] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-11-03T18:25:20.789334] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:25:20.789533] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-11-03T18:25:20.789594] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-11-03T18:25:20.790613] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-11-03T18:25:20.790710] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-11-03T18:25:21.061492] [DEBUG] [REMOTE ] DHT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:25:21.074498] [WARN ] [REMOTE ] DHT: No data returned for month 2025-11 [2025-11-03T18:25:21.091320] [FATAL] [REMOTE ] DHT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:25:21.091492] [FATAL] [MAIN ] DHT: Failed to fetch primary data. [2025-11-03T18:25:21.099503] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:25:21.101835] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-11-03T18:25:21.101909] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-11-03T18:25:21.102230] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-11-03T18:25:21.117973] [DEBUG] [LOCAL ] DHT: Deleted derivative data file. [2025-11-03T18:25:21.124207] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHT took 38.8s. Estimated remaining: 4h 1m 14s. Rate: 7.2 symbols/min [2025-11-03T18:25:21.250677] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:25:21.357331] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:25:21.408009] [DEBUG] [LOCAL ] DIS: Loaded 54568 existing records from primary storage. [2025-11-03T18:25:21.408358] [INFO ] [MAIN ] DIS: Loaded 54568 existing records. [2025-11-03T18:25:21.535084] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-11-03T18:25:21.559814] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T18:25:21.604040] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:25:21.604709] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-11-03T18:25:21.604789] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-11-03T18:25:21.606034] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-11-03T18:25:21.606301] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-11-03T18:25:22.002195] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:25:22.334861] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-11-03T18:25:22.949398] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T18:25:23.134884] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-11-03T18:25:23.934868] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-11-03T18:25:24.238706] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-11-03T18:25:24.313930] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T18:25:24.734936] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-11-03T18:25:25.283129] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-11-03T18:25:25.528325] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-11-03T18:25:25.538306] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-11-03T18:25:26.334903] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-11-03T18:25:27.134862] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-11-03T18:25:27.430865] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T18:25:27.509270] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-11-03T18:25:27.790804] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T18:25:27.934872] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-11-03T18:25:28.734882] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-11-03T18:25:29.108732] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T18:25:29.534876] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-11-03T18:25:30.299118] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T18:25:30.334859] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-11-03T18:25:30.644936] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-11-03T18:25:31.134881] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-11. [2025-11-03T18:25:31.561074] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:25:31.934871] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-11-03T18:25:32.339681] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T18:25:32.340480] [INFO ] [REMOTE ] DHX: Full fetch complete (21421 records). [2025-11-03T18:25:32.340550] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-11-03T18:25:32.705177] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-11-03T18:25:32.705315] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-11-03T18:25:32.705771] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-11-03T18:25:32.705832] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-11-03T18:25:32.706381] [DEBUG] [LOCAL ] DHX: Trimmed 21421 records to 12882 (keeping 200 days of data) [2025-11-03T18:25:32.739714] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-11-03T18:25:32.778953] [DEBUG] [LOCAL ] DHX: Primary data saved (12882 records). [2025-11-03T18:25:32.779101] [INFO ] [MAIN ] DHX: Full history saved. [2025-11-03T18:25:32.779178] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DHX took 36.8s. Estimated remaining: 4h 1m 16s. Rate: 7.2 symbols/min [2025-11-03T18:25:32.947817] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:25:32.947985] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-11-03T18:25:32.948021] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-11-03T18:25:32.948127] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-11-03T18:25:32.948167] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-11-03T18:25:32.948207] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-11-03T18:25:32.948238] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-11-03T18:25:33.298391] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:25:33.534871] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-11-03T18:25:33.771700] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-11-03T18:25:33.917917] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:25:34.334887] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-11-03T18:25:34.898366] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T18:25:35.134839] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-11-03T18:25:35.189172] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T18:25:35.934851] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-11-03T18:25:36.605571] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T18:25:36.734887] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-11-03T18:25:37.155523] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:25:37.534862] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-11-03T18:25:37.939598] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-11-03T18:25:38.334878] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-11-03T18:25:38.645422] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-11-03T18:25:39.134856] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-11-03T18:25:39.615393] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T18:25:39.934869] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-11-03T18:25:40.734862] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-11-03T18:25:41.040396] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-11-03T18:25:41.123775] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T18:25:41.148768] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T18:25:41.534865] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-11-03T18:25:42.334906] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-11-03T18:25:42.656104] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:25:43.134946] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-11-03T18:25:43.934904] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-11. [2025-11-03T18:25:44.057738] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-11-03T18:25:44.627706] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:25:44.734931] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-11-03T18:25:45.534937] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-11-03T18:25:45.731154] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-11 (1.80 seconds). [2025-11-03T18:25:45.732359] [INFO ] [REMOTE ] DIN: Full fetch complete (54056 records). [2025-11-03T18:25:45.732447] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-11-03T18:25:45.843737] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-11-03T18:25:46.121797] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-11-03T18:25:46.121951] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-11-03T18:25:46.122737] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-11-03T18:25:46.122812] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-11-03T18:25:46.124071] [DEBUG] [LOCAL ] DIN: Trimmed 54056 records to 36123 (keeping 200 days of data) [2025-11-03T18:25:46.264094] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T18:25:46.354146] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-11-03T18:25:46.383703] [DEBUG] [LOCAL ] DIN: Primary data saved (36123 records). [2025-11-03T18:25:46.383985] [INFO ] [MAIN ] DIN: Full history saved. [2025-11-03T18:25:46.384947] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DIN took 40.7s. Estimated remaining: 4h 1m 22s. Rate: 7.2 symbols/min [2025-11-03T18:25:46.550877] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:25:46.594919] [DEBUG] [LOCAL ] DK: Loaded 49706 existing records from primary storage. [2025-11-03T18:25:46.595203] [INFO ] [MAIN ] DK: Loaded 49706 existing records. [2025-11-03T18:25:46.781528] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:25:46.781769] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-11-03T18:25:46.781844] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-11-03T18:25:46.782755] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-11-03T18:25:46.782818] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-11-03T18:25:47.132803] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:25:47.134818] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-11-03T18:25:47.776312] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T18:25:47.934873] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-11-03T18:25:48.330618] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T18:25:48.734859] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-11-03T18:25:49.534861] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-11-03T18:25:49.798086] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-11-03T18:25:49.885564] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T18:25:49.963011] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-11-03T18:25:50.334880] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-11-03T18:25:51.134854] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-11-03T18:25:51.630609] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:25:51.934842] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-11-03T18:25:52.476079] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-11-03T18:25:52.734836] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-11. [2025-11-03T18:25:53.534832] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-11-03T18:25:53.699048] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-11-03T18:25:53.796787] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-11-03T18:25:54.334853] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-11-03T18:25:54.609352] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-11 (1.87 seconds). [2025-11-03T18:25:54.611453] [INFO ] [REMOTE ] DINO: Full fetch complete (76673 records). [2025-11-03T18:25:54.611601] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-11-03T18:25:55.038778] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-11-03T18:25:55.038895] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-11-03T18:25:55.040039] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-11-03T18:25:55.040108] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-11-03T18:25:55.042038] [DEBUG] [LOCAL ] DINO: Trimmed 76673 records to 52748 (keeping 200 days of data) [2025-11-03T18:25:55.135181] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-11-03T18:25:55.386715] [DEBUG] [LOCAL ] DINO: Primary data saved (52748 records). [2025-11-03T18:25:55.386922] [INFO ] [MAIN ] DINO: Full history saved. [2025-11-03T18:25:55.387027] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DINO took 35.0s. Estimated remaining: 4h 1m 16s. Rate: 7.2 symbols/min [2025-11-03T18:25:55.579612] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:25:55.579895] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-11-03T18:25:55.579952] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-11-03T18:25:55.580110] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-11-03T18:25:55.580155] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-11-03T18:25:55.580200] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-11-03T18:25:55.580233] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-11-03T18:25:55.935398] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-11-03T18:25:55.960706] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:25:56.203768] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-11-03T18:25:56.263396] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-11-03T18:25:56.595712] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T18:25:56.734871] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-11-03T18:25:57.534933] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-11-03T18:25:57.811437] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-11-03T18:25:58.012229] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T18:25:58.334851] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-11-03T18:25:58.585441] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-11-03T18:25:59.134899] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-11-03T18:25:59.934896] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-11-03T18:26:00.707425] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-11-03T18:26:00.734820] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-11-03T18:26:00.861181] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:26:01.534915] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-11-03T18:26:02.094720] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T18:26:02.334888] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-11. [2025-11-03T18:26:02.369102] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T18:26:03.134861] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-11-03T18:26:03.934867] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-11-03T18:26:04.224585] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T18:26:04.226126] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-11-03T18:26:04.226216] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-11-03T18:26:04.310074] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-11-03T18:26:04.679742] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-11-03T18:26:04.679908] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-11-03T18:26:04.681098] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-11-03T18:26:04.681533] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-11-03T18:26:04.682753] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-11-03T18:26:04.694133] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-11-03T18:26:04.753248] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-11-03T18:26:05.027843] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-11-03T18:26:05.027972] [INFO ] [MAIN ] DIS: Full history saved. [2025-11-03T18:26:05.028059] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DIS took 43.9s. Estimated remaining: 4h 1m 11s. Rate: 7.2 symbols/min [2025-11-03T18:26:05.106620] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-11-03T18:26:05.199668] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:05.241338] [DEBUG] [LOCAL ] DKS: Loaded 49535 existing records from primary storage. [2025-11-03T18:26:05.241701] [INFO ] [MAIN ] DKS: Loaded 49535 existing records. [2025-11-03T18:26:05.413622] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:26:05.413838] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-11-03T18:26:05.413885] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-11-03T18:26:05.414736] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-11-03T18:26:05.414798] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-11-03T18:26:05.540147] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-11-03T18:26:05.790934] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:06.334822] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-11. [2025-11-03T18:26:06.437932] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-11-03T18:26:06.932317] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-11 (0.60 seconds). [2025-11-03T18:26:06.932957] [INFO ] [REMOTE ] DIVY: Full fetch complete (1643 records). [2025-11-03T18:26:06.933024] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-11-03T18:26:07.107039] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-11-03T18:26:07.107291] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:26:07.107362] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:26:07.107431] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-11-03T18:26:07.107500] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-11-03T18:26:07.107576] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-11-03T18:26:07.107628] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-11-03T18:26:07.107721] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIVY took 34.3s. Estimated remaining: 4h 0m 46s. Rate: 7.2 symbols/min [2025-11-03T18:26:07.139049] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-11-03T18:26:07.290431] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:07.319544] [DEBUG] [LOCAL ] DLB: Loaded 32616 existing records from primary storage. [2025-11-03T18:26:07.319847] [INFO ] [MAIN ] DLB: Loaded 32616 existing records. [2025-11-03T18:26:07.499073] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:26:07.499272] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-11-03T18:26:07.499321] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-11-03T18:26:07.499966] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-11-03T18:26:07.500024] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-11-03T18:26:07.878410] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:07.934894] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-11-03T18:26:08.554133] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T18:26:08.734853] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-11-03T18:26:08.882041] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:26:09.534863] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-11-03T18:26:10.127605] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T18:26:10.334861] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-11-03T18:26:10.738915] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-11-03T18:26:11.134914] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-11-03T18:26:11.676597] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-11-03T18:26:11.934924] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-11-03T18:26:12.213182] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T18:26:12.734939] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-11. [2025-11-03T18:26:12.884053] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T18:26:13.534893] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-11-03T18:26:14.334909] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-11-03T18:26:14.562693] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T18:26:14.624928] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T18:26:14.626397] [INFO ] [REMOTE ] DK: Full fetch complete (70775 records). [2025-11-03T18:26:14.626515] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-11-03T18:26:15.018709] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-11-03T18:26:15.018825] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-11-03T18:26:15.019918] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-11-03T18:26:15.020006] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-11-03T18:26:15.021828] [DEBUG] [LOCAL ] DK: Trimmed 70775 records to 49045 (keeping 200 days of data) [2025-11-03T18:26:15.139694] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-11-03T18:26:15.328455] [DEBUG] [LOCAL ] DK: Primary data saved (49045 records). [2025-11-03T18:26:15.328590] [INFO ] [MAIN ] DK: Full history saved. [2025-11-03T18:26:15.329611] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DK took 28.9s. Estimated remaining: 4h 0m 37s. Rate: 7.2 symbols/min [2025-11-03T18:26:15.494617] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:15.494839] [DEBUG] [LOCAL ] DLNG: No existing data file found in primary storage. [2025-11-03T18:26:15.494883] [WARN ] [MAIN ] DLNG: No existing data found, performing full refresh instead. [2025-11-03T18:26:15.494989] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-11-03T18:26:15.495029] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-11-03T18:26:15.495070] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-11-03T18:26:15.495103] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-11-03T18:26:15.847920] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:15.881281] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-11-03T18:26:15.934819] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-11-03T18:26:16.306964] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T18:26:16.734891] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-11-03T18:26:16.748420] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T18:26:17.534818] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-11-03T18:26:17.570903] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-11-03T18:26:18.334838] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-11-03T18:26:18.688873] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T18:26:19.134856] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-11-03T18:26:19.695592] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T18:26:19.934835] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-11-03T18:26:20.187584] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T18:26:20.734864] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-11-03T18:26:21.313899] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T18:26:21.314369] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T18:26:21.534971] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-11-03T18:26:22.032534] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-11-03T18:26:22.334891] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-11-03T18:26:23.134895] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-11-03T18:26:23.376875] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T18:26:23.666498] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-11-03T18:26:23.934854] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-11-03T18:26:24.485401] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-11-03T18:26:24.734920] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-11-03T18:26:25.534825] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-11-03T18:26:25.640345] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T18:26:25.959735] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-11-03T18:26:26.334859] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-11-03T18:26:27.134925] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-11-03T18:26:27.470366] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T18:26:27.934882] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-11-03T18:26:28.380249] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T18:26:28.449760] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T18:26:28.734908] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-11-03T18:26:29.534908] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-11-03T18:26:30.292032] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T18:26:30.334810] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-11-03T18:26:30.567212] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T18:26:31.134891] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-11-03T18:26:31.674865] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:26:31.934831] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-11-03T18:26:32.050169] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T18:26:32.734859] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-11-03T18:26:33.322817] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T18:26:33.383170] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T18:26:33.534850] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-11. [2025-11-03T18:26:34.334875] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-11-03T18:26:34.962307] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-11-03T18:26:35.076244] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-11 (1.54 seconds). [2025-11-03T18:26:35.077941] [INFO ] [REMOTE ] DLB: Full fetch complete (47482 records). [2025-11-03T18:26:35.078054] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-11-03T18:26:35.141777] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-11-03T18:26:35.453181] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-11-03T18:26:35.453258] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-11-03T18:26:35.453898] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-11-03T18:26:35.453961] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-11-03T18:26:35.454897] [DEBUG] [LOCAL ] DLB: Trimmed 47482 records to 32348 (keeping 200 days of data) [2025-11-03T18:26:35.647970] [DEBUG] [LOCAL ] DLB: Primary data saved (32348 records). [2025-11-03T18:26:35.648109] [INFO ] [MAIN ] DLB: Full history saved. [2025-11-03T18:26:35.648896] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DLB took 28.5s. Estimated remaining: 4h 1m 3s. Rate: 7.2 symbols/min [2025-11-03T18:26:35.820896] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:35.878909] [DEBUG] [LOCAL ] DLR: Loaded 51258 existing records from primary storage. [2025-11-03T18:26:35.879297] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T18:26:35.879868] [INFO ] [MAIN ] DLR: Loaded 51258 existing records. [2025-11-03T18:26:35.939934] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-11-03T18:26:36.073620] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:26:36.073872] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-11-03T18:26:36.073926] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-11-03T18:26:36.074883] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-11-03T18:26:36.074943] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-11-03T18:26:36.429106] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:36.734861] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-11-03T18:26:37.425637] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T18:26:37.534822] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-11-03T18:26:38.083697] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T18:26:38.121969] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T18:26:38.334837] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-11-03T18:26:39.134909] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-11. [2025-11-03T18:26:39.617628] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:26:39.934871] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-11-03T18:26:40.081982] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-11 (0.95 seconds). [2025-11-03T18:26:40.082862] [INFO ] [REMOTE ] DKL: Full fetch complete (27362 records). [2025-11-03T18:26:40.082930] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-11-03T18:26:40.452070] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-11-03T18:26:40.452166] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-11-03T18:26:40.452673] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-11-03T18:26:40.452733] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-11-03T18:26:40.453339] [DEBUG] [LOCAL ] DKL: Trimmed 27362 records to 15435 (keeping 200 days of data) [2025-11-03T18:26:40.543700] [DEBUG] [LOCAL ] DKL: Primary data saved (15435 records). [2025-11-03T18:26:40.543827] [INFO ] [MAIN ] DKL: Full history saved. [2025-11-03T18:26:40.543896] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DKL took 45.2s. Estimated remaining: 4h 0m 45s. Rate: 7.2 symbols/min [2025-11-03T18:26:40.709697] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:40.734883] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-11-03T18:26:40.736473] [DEBUG] [LOCAL ] DLX: Loaded 27950 existing records from primary storage. [2025-11-03T18:26:40.736704] [INFO ] [MAIN ] DLX: Loaded 27950 existing records. [2025-11-03T18:26:40.911533] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:26:40.911769] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-11-03T18:26:40.911818] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-11-03T18:26:40.912334] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-11-03T18:26:40.912390] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-11-03T18:26:41.292470] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:41.399007] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T18:26:41.506370] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-11-03T18:26:41.534831] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-11-03T18:26:41.926026] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T18:26:42.334842] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-11-03T18:26:43.134873] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-11. [2025-11-03T18:26:43.685365] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T18:26:43.934852] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-11-03T18:26:44.734907] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-11-03T18:26:45.191373] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-11 (2.06 seconds). [2025-11-03T18:26:45.192829] [INFO ] [REMOTE ] DKS: Full fetch complete (71163 records). [2025-11-03T18:26:45.192935] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-11-03T18:26:45.535537] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-11-03T18:26:45.547587] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-11-03T18:26:45.650006] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-11-03T18:26:45.650116] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-11-03T18:26:45.651092] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-11-03T18:26:45.651171] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-11-03T18:26:45.665446] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:26:45.671444] [DEBUG] [LOCAL ] DKS: Trimmed 71163 records to 48863 (keeping 200 days of data) [2025-11-03T18:26:45.967265] [DEBUG] [LOCAL ] DKS: Primary data saved (48863 records). [2025-11-03T18:26:45.967385] [INFO ] [MAIN ] DKS: Full history saved. [2025-11-03T18:26:45.967460] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DKS took 40.9s. Estimated remaining: 4h 0m 28s. Rate: 7.2 symbols/min [2025-11-03T18:26:46.090110] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T18:26:46.157910] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:46.178595] [DEBUG] [LOCAL ] DLY: Loaded 21013 existing records from primary storage. [2025-11-03T18:26:46.178905] [INFO ] [MAIN ] DLY: Loaded 21013 existing records. [2025-11-03T18:26:46.336716] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-11. [2025-11-03T18:26:46.364966] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:26:46.366409] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-11-03T18:26:46.366500] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-11-03T18:26:46.367078] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-11-03T18:26:46.367145] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-11-03T18:26:46.747608] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:47.046787] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-11 (0.71 seconds). [2025-11-03T18:26:47.047598] [INFO ] [REMOTE ] DLNG: Full fetch complete (10619 records). [2025-11-03T18:26:47.047693] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-11-03T18:26:47.143600] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-11-03T18:26:47.400967] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-11-03T18:26:47.401041] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-11-03T18:26:47.401284] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-11-03T18:26:47.401322] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-11-03T18:26:47.401767] [DEBUG] [LOCAL ] DLNG: Trimmed 10619 records to 5800 (keeping 200 days of data) [2025-11-03T18:26:47.433904] [DEBUG] [LOCAL ] DLNG: Primary data saved (5800 records). [2025-11-03T18:26:47.434010] [INFO ] [MAIN ] DLNG: Full history saved. [2025-11-03T18:26:47.434076] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DLNG took 32.1s. Estimated remaining: 4h 0m 1s. Rate: 7.2 symbols/min [2025-11-03T18:26:47.606048] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:26:47.612715] [DEBUG] [LOCAL ] DMA: Loaded 4722 existing records from primary storage. [2025-11-03T18:26:47.612956] [INFO ] [MAIN ] DMA: Loaded 4722 existing records. [2025-11-03T18:26:47.803804] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:26:47.804044] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-11-03T18:26:47.804094] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-11-03T18:26:47.804290] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-11-03T18:26:47.804349] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-11-03T18:26:47.948206] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-11-03T18:26:48.177112] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:26:48.521474] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T18:26:48.734862] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-11-03T18:26:48.901063] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T18:26:49.190278] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-11-03T18:26:49.534861] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-11-03T18:26:50.285818] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T18:26:50.334811] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-11-03T18:26:50.972062] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T18:26:51.134882] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-11-03T18:26:51.722997] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-11-03T18:26:51.934866] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-11-03T18:26:52.734862] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-11-03T18:26:52.861291] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T18:26:53.203136] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-11-03T18:26:53.534897] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-11-03T18:26:54.334843] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-11-03T18:26:54.837087] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:26:55.134820] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-11-03T18:26:55.321147] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T18:26:55.934903] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-11-03T18:26:56.484996] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T18:26:56.734891] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-11-03T18:26:56.765690] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T18:26:57.534923] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-11-03T18:26:58.111209] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T18:26:58.334858] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-11-03T18:26:58.469211] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T18:26:59.134851] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-11-03T18:26:59.860677] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T18:26:59.863258] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T18:26:59.934860] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-11. [2025-11-03T18:27:00.734932] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-11-03T18:27:01.037450] [DEBUG] [REMOTE ] DLR: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:27:01.037929] [WARN ] [REMOTE ] DLR: No data returned for month 2025-11 [2025-11-03T18:27:01.038063] [FATAL] [REMOTE ] DLR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:27:01.038162] [FATAL] [MAIN ] DLR: Failed to fetch primary data. [2025-11-03T18:27:01.038231] [WARN ] [MAIN ] DLR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:27:01.038309] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-11-03T18:27:01.038472] [DEBUG] [LOCAL ] DLR: No primary data file found to delete. [2025-11-03T18:27:01.038530] [INFO ] [LOCAL ] DLR: Starting deletion of derivative data. [2025-11-03T18:27:01.038746] [DEBUG] [LOCAL ] DLR: Deleted derivative data file. [2025-11-03T18:27:01.039266] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLR took 25.4s. Estimated remaining: 4h 0m 8s. Rate: 7.2 symbols/min [2025-11-03T18:27:01.207550] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:01.219817] [DEBUG] [LOCAL ] DMB: Loaded 10609 existing records from primary storage. [2025-11-03T18:27:01.220047] [INFO ] [MAIN ] DMB: Loaded 10609 existing records. [2025-11-03T18:27:01.395181] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:01.395397] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-11-03T18:27:01.395445] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-11-03T18:27:01.395751] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-11-03T18:27:01.395818] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-11-03T18:27:01.544205] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-11-03T18:27:01.694398] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T18:27:01.797112] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:02.334873] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-11-03T18:27:02.453036] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T18:27:03.005512] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-11-03T18:27:03.134892] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-11-03T18:27:03.696499] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T18:27:03.934861] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-11-03T18:27:04.734882] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-11-03T18:27:04.756615] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T18:27:05.089695] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T18:27:05.534855] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-11-03T18:27:06.224571] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T18:27:06.334837] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-11-03T18:27:06.781816] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-11-03T18:27:07.134850] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-11-03T18:27:07.934851] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-11-03T18:27:08.068825] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T18:27:08.734867] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-11-03T18:27:08.936279] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-11-03T18:27:09.044113] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-11-03T18:27:09.534864] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-11-03T18:27:10.334913] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-11-03T18:27:10.558731] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T18:27:10.718126] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-11-03T18:27:11.134858] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-11-03T18:27:11.934859] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-11-03T18:27:12.254144] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:27:12.408039] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-11-03T18:27:12.734855] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-11-03T18:27:13.128849] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T18:27:13.534862] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-11-03T18:27:14.117049] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T18:27:14.334884] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-11-03T18:27:15.134838] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-11. [2025-11-03T18:27:15.163406] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T18:27:15.902717] [DEBUG] [REMOTE ] DLY: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:27:15.903026] [WARN ] [REMOTE ] DLY: No data returned for month 2025-11 [2025-11-03T18:27:15.903116] [FATAL] [REMOTE ] DLY: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:27:15.903191] [FATAL] [MAIN ] DLY: Failed to fetch primary data. [2025-11-03T18:27:15.903252] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:27:15.903324] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-11-03T18:27:15.903388] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-11-03T18:27:15.903423] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-11-03T18:27:15.903579] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-11-03T18:27:15.903684] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DLY took 29.9s. Estimated remaining: 4h 0m 17s. Rate: 7.2 symbols/min [2025-11-03T18:27:15.939931] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-11-03T18:27:16.074515] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:16.084443] [DEBUG] [LOCAL ] DMO: Loaded 9466 existing records from primary storage. [2025-11-03T18:27:16.084663] [INFO ] [MAIN ] DMO: Loaded 9466 existing records. [2025-11-03T18:27:16.262431] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:16.262662] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-11-03T18:27:16.262724] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-11-03T18:27:16.263032] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-11-03T18:27:16.263088] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-11-03T18:27:16.619105] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-11-03T18:27:16.624471] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:16.734823] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-11-03T18:27:17.422600] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T18:27:17.534851] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-11-03T18:27:18.006731] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-11-03T18:27:18.334856] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-11. [2025-11-03T18:27:18.924701] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-11 (0.59 seconds). [2025-11-03T18:27:18.925347] [INFO ] [REMOTE ] DMA: Full fetch complete (6425 records). [2025-11-03T18:27:18.925413] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-11-03T18:27:19.139962] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-11-03T18:27:19.281677] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-11-03T18:27:19.281768] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-11-03T18:27:19.282011] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-11-03T18:27:19.282050] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-11-03T18:27:19.282426] [DEBUG] [LOCAL ] DMA: Trimmed 6425 records to 4675 (keeping 200 days of data) [2025-11-03T18:27:19.309977] [DEBUG] [LOCAL ] DMA: Primary data saved (4675 records). [2025-11-03T18:27:19.310090] [INFO ] [MAIN ] DMA: Full history saved. [2025-11-03T18:27:19.310165] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DMA took 31.9s. Estimated remaining: 3h 59m 56s. Rate: 7.2 symbols/min [2025-11-03T18:27:19.481530] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:19.525700] [DEBUG] [LOCAL ] DNA: Loaded 48923 existing records from primary storage. [2025-11-03T18:27:19.526058] [INFO ] [MAIN ] DNA: Loaded 48923 existing records. [2025-11-03T18:27:19.702410] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:19.702684] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-11-03T18:27:19.702743] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-11-03T18:27:19.703457] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-11-03T18:27:19.703514] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-11-03T18:27:19.938737] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-11-03T18:27:19.962260] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T18:27:20.073987] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:20.734866] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-11-03T18:27:20.940392] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T18:27:21.534863] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-11-03T18:27:22.026697] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T18:27:22.256517] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T18:27:22.334843] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-11-03T18:27:23.134854] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-11. [2025-11-03T18:27:23.939193] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-11-03T18:27:23.942374] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-11-03T18:27:24.334269] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T18:27:24.335761] [INFO ] [REMOTE ] DLX: Full fetch complete (41629 records). [2025-11-03T18:27:24.335891] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-11-03T18:27:24.671262] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T18:27:24.736982] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-11-03T18:27:24.748693] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-11-03T18:27:24.748821] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-11-03T18:27:24.749464] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-11-03T18:27:24.749627] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-11-03T18:27:24.750836] [DEBUG] [LOCAL ] DLX: Trimmed 41629 records to 27628 (keeping 200 days of data) [2025-11-03T18:27:24.917033] [DEBUG] [LOCAL ] DLX: Primary data saved (27628 records). [2025-11-03T18:27:24.917170] [INFO ] [MAIN ] DLX: Full history saved. [2025-11-03T18:27:24.917285] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DLX took 44.4s. Estimated remaining: 3h 59m 40s. Rate: 7.2 symbols/min [2025-11-03T18:27:25.099004] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:25.138772] [DEBUG] [LOCAL ] DNOW: Loaded 44276 existing records from primary storage. [2025-11-03T18:27:25.139090] [INFO ] [MAIN ] DNOW: Loaded 44276 existing records. [2025-11-03T18:27:25.333838] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:25.334144] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-11-03T18:27:25.334223] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-11-03T18:27:25.335189] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-11-03T18:27:25.335268] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-11-03T18:27:25.535362] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-11-03T18:27:25.736790] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:26.148776] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T18:27:26.334850] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-11-03T18:27:26.384696] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-11-03T18:27:26.879213] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-11-03T18:27:27.134897] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-11-03T18:27:27.934876] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-11-03T18:27:28.483668] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T18:27:28.647606] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T18:27:28.734826] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-11-03T18:27:29.534887] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-11-03T18:27:30.008827] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T18:27:30.334844] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-11-03T18:27:30.737938] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T18:27:31.134880] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-11-03T18:27:31.811951] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T18:27:31.934860] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-11-03T18:27:32.192023] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T18:27:32.734874] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-11-03T18:27:33.462279] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-11-03T18:27:33.534878] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-11-03T18:27:33.856952] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:27:34.104831] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T18:27:34.334879] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-11-03T18:27:34.916203] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-11-03T18:27:35.134921] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-11-03T18:27:35.837999] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T18:27:35.934894] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-11-03T18:27:36.734910] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-11-03T18:27:37.272548] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T18:27:37.317977] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T18:27:37.534909] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-11-03T18:27:38.334844] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-11-03T18:27:38.924185] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T18:27:39.134917] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-11-03T18:27:39.615117] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T18:27:39.718557] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T18:27:39.934869] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-11-03T18:27:40.513217] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-11-03T18:27:40.734828] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-11-03T18:27:41.534841] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-11. [2025-11-03T18:27:41.914862] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T18:27:42.252959] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T18:27:42.253739] [INFO ] [REMOTE ] DMB: Full fetch complete (14422 records). [2025-11-03T18:27:42.253810] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-11-03T18:27:42.339908] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-11-03T18:27:42.633507] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-11-03T18:27:42.633586] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-11-03T18:27:42.633940] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-11-03T18:27:42.634001] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-11-03T18:27:42.634596] [DEBUG] [LOCAL ] DMB: Trimmed 14422 records to 10357 (keeping 200 days of data) [2025-11-03T18:27:42.695040] [DEBUG] [LOCAL ] DMB: Primary data saved (10357 records). [2025-11-03T18:27:42.695164] [INFO ] [MAIN ] DMB: Full history saved. [2025-11-03T18:27:42.695240] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DMB took 41.7s. Estimated remaining: 3h 59m 58s. Rate: 7.2 symbols/min [2025-11-03T18:27:42.860834] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:42.890090] [DEBUG] [LOCAL ] DNP: Loaded 33222 existing records from primary storage. [2025-11-03T18:27:42.890361] [INFO ] [MAIN ] DNP: Loaded 33222 existing records. [2025-11-03T18:27:43.063965] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:43.064162] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-11-03T18:27:43.064208] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-11-03T18:27:43.064795] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-11-03T18:27:43.064857] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-11-03T18:27:43.139965] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-11-03T18:27:43.424732] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:43.445844] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T18:27:43.766618] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-11-03T18:27:43.934887] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-11-03T18:27:44.477068] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-11-03T18:27:44.734901] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-11-03T18:27:45.296664] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T18:27:45.534908] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-11-03T18:27:46.030240] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-11-03T18:27:46.334844] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-11-03T18:27:47.134854] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-11-03T18:27:47.934869] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-11. [2025-11-03T18:27:47.986347] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-11-03T18:27:48.286564] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T18:27:48.651255] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T18:27:48.652264] [INFO ] [REMOTE ] DMO: Full fetch complete (14169 records). [2025-11-03T18:27:48.652339] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-11-03T18:27:48.739961] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-11-03T18:27:49.043081] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-11-03T18:27:49.043189] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-11-03T18:27:49.043723] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-11-03T18:27:49.043852] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-11-03T18:27:49.044599] [DEBUG] [LOCAL ] DMO: Trimmed 14169 records to 9225 (keeping 200 days of data) [2025-11-03T18:27:49.103082] [DEBUG] [LOCAL ] DMO: Primary data saved (9225 records). [2025-11-03T18:27:49.103262] [INFO ] [MAIN ] DMO: Full history saved. [2025-11-03T18:27:49.103366] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DMO took 33.2s. Estimated remaining: 3h 59m 44s. Rate: 7.2 symbols/min [2025-11-03T18:27:49.291201] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:49.350147] [DEBUG] [LOCAL ] DOC: Loaded 54334 existing records from primary storage. [2025-11-03T18:27:49.350611] [INFO ] [MAIN ] DOC: Loaded 54334 existing records. [2025-11-03T18:27:49.535240] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-11. [2025-11-03T18:27:49.539260] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:49.541034] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-11-03T18:27:49.541176] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-11-03T18:27:49.542434] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-11-03T18:27:49.542505] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-11-03T18:27:49.931284] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:49.960276] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T18:27:50.334864] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-11-03T18:27:51.134984] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-11-03T18:27:51.344837] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-11-03T18:27:51.873857] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-11 (2.34 seconds). [2025-11-03T18:27:51.875942] [INFO ] [REMOTE ] DNA: Full fetch complete (70863 records). [2025-11-03T18:27:51.876052] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-11-03T18:27:51.941479] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-11-03T18:27:52.341217] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-11-03T18:27:52.341425] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-11-03T18:27:52.342383] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-11-03T18:27:52.342531] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-11-03T18:27:52.367783] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T18:27:52.367967] [DEBUG] [LOCAL ] DNA: Trimmed 70863 records to 48104 (keeping 200 days of data) [2025-11-03T18:27:52.651051] [DEBUG] [LOCAL ] DNA: Primary data saved (48104 records). [2025-11-03T18:27:52.651182] [INFO ] [MAIN ] DNA: Full history saved. [2025-11-03T18:27:52.651926] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DNA took 33.3s. Estimated remaining: 3h 59m 23s. Rate: 7.2 symbols/min [2025-11-03T18:27:52.741277] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-11-03T18:27:52.821142] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:52.868844] [DEBUG] [LOCAL ] DOCN: Loaded 51853 existing records from primary storage. [2025-11-03T18:27:52.869146] [INFO ] [MAIN ] DOCN: Loaded 51853 existing records. [2025-11-03T18:27:53.043320] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:53.043543] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-11-03T18:27:53.043589] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-11-03T18:27:53.044508] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-11-03T18:27:53.044566] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-11-03T18:27:53.399301] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:53.440284] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T18:27:53.534839] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-11-03T18:27:54.154501] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T18:27:54.334871] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-11. [2025-11-03T18:27:54.733794] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T18:27:55.134950] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-11-03T18:27:55.907788] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-11 (1.57 seconds). [2025-11-03T18:27:55.909484] [INFO ] [REMOTE ] DNOW: Full fetch complete (63917 records). [2025-11-03T18:27:55.909624] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-11-03T18:27:55.943063] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-11-03T18:27:56.333595] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-11-03T18:27:56.333871] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-11-03T18:27:56.335413] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-11-03T18:27:56.335507] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-11-03T18:27:56.337418] [DEBUG] [LOCAL ] DNOW: Trimmed 63917 records to 43552 (keeping 200 days of data) [2025-11-03T18:27:56.584492] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-11-03T18:27:56.652438] [DEBUG] [LOCAL ] DNOW: Primary data saved (43552 records). [2025-11-03T18:27:56.652616] [INFO ] [MAIN ] DNOW: Full history saved. [2025-11-03T18:27:56.652762] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DNOW took 31.7s. Estimated remaining: 3h 59m 3s. Rate: 7.2 symbols/min [2025-11-03T18:27:56.740058] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-11-03T18:27:56.844718] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:27:56.894690] [DEBUG] [LOCAL ] DOCS: Loaded 50728 existing records from primary storage. [2025-11-03T18:27:56.895144] [INFO ] [MAIN ] DOCS: Loaded 50728 existing records. [2025-11-03T18:27:57.087375] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:27:57.087819] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-11-03T18:27:57.087886] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-11-03T18:27:57.089073] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-11-03T18:27:57.089132] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-11-03T18:27:57.515273] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-11-03T18:27:57.522077] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:27:57.534823] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-11-03T18:27:57.564669] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T18:27:58.334890] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-11-03T18:27:58.808494] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T18:27:59.134914] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-11-03T18:27:59.755051] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T18:27:59.934895] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-11-03T18:28:00.098896] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-11-03T18:28:00.734901] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-11-03T18:28:01.319984] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T18:28:01.534838] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-11-03T18:28:01.933093] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:28:02.334900] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-11-03T18:28:02.860533] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T18:28:03.134856] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-11-03T18:28:03.727280] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T18:28:03.934880] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-11-03T18:28:04.502190] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T18:28:04.734890] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-11-03T18:28:05.534829] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-11-03T18:28:05.677107] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T18:28:05.774240] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-11-03T18:28:06.334915] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-11-03T18:28:06.846760] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T18:28:07.134872] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-11-03T18:28:07.758117] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T18:28:07.934840] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-11-03T18:28:08.611412] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:28:08.734851] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-11-03T18:28:09.288095] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:28:09.534900] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-11-03T18:28:09.658902] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T18:28:10.334859] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-11-03T18:28:10.934180] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T18:28:11.134880] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-11-03T18:28:11.739036] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T18:28:11.934874] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-11-03T18:28:12.078332] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T18:28:12.734851] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-11-03T18:28:13.430303] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T18:28:13.534827] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-11-03T18:28:13.668308] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T18:28:14.334848] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-11-03T18:28:14.766372] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T18:28:15.134855] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-11-03T18:28:15.526223] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T18:28:15.934962] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-11-03T18:28:16.689055] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-11-03T18:28:16.734883] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-11. [2025-11-03T18:28:17.197300] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T18:28:17.534917] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-11-03T18:28:18.153679] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-11 (1.42 seconds). [2025-11-03T18:28:18.154874] [INFO ] [REMOTE ] DNP: Full fetch complete (48314 records). [2025-11-03T18:28:18.154962] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-11-03T18:28:18.335261] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-11-03T18:28:18.541767] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-11-03T18:28:18.541856] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-11-03T18:28:18.542562] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-11-03T18:28:18.542669] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-11-03T18:28:18.543846] [DEBUG] [LOCAL ] DNP: Trimmed 48314 records to 32716 (keeping 200 days of data) [2025-11-03T18:28:18.736087] [DEBUG] [LOCAL ] DNP: Primary data saved (32716 records). [2025-11-03T18:28:18.736224] [INFO ] [MAIN ] DNP: Full history saved. [2025-11-03T18:28:18.737236] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNP took 36.0s. Estimated remaining: 3h 59m 32s. Rate: 7.2 symbols/min [2025-11-03T18:28:19.041012] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:28:19.134854] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-11. [2025-11-03T18:28:19.815741] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T18:28:19.934992] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-11-03T18:28:20.734825] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-11-03T18:28:21.322413] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T18:28:21.407859] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-11 (2.27 seconds). [2025-11-03T18:28:21.409342] [INFO ] [REMOTE ] DOC: Full fetch complete (77625 records). [2025-11-03T18:28:21.409442] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-11-03T18:28:21.549506] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-11-03T18:28:21.807259] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-11-03T18:28:21.807355] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-11-03T18:28:21.808249] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-11-03T18:28:21.808315] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-11-03T18:28:21.809819] [DEBUG] [LOCAL ] DOC: Trimmed 77625 records to 53554 (keeping 200 days of data) [2025-11-03T18:28:22.166173] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T18:28:22.184753] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-11-03T18:28:22.184872] [INFO ] [MAIN ] DOC: Full history saved. [2025-11-03T18:28:22.185493] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DOC took 33.1s. Estimated remaining: 3h 59m 11s. Rate: 7.2 symbols/min [2025-11-03T18:28:22.334835] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-11-03T18:28:22.969271] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T18:28:23.134828] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-11-03T18:28:23.650804] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T18:28:23.934865] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-11-03T18:28:24.426689] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:28:24.734847] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-11. [2025-11-03T18:28:25.379953] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T18:28:25.534843] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-11-03T18:28:26.483766] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-11 (1.75 seconds). [2025-11-03T18:28:26.485690] [INFO ] [REMOTE ] DOCS: Full fetch complete (73528 records). [2025-11-03T18:28:26.485820] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-11-03T18:28:26.891587] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-11-03T18:28:26.891816] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-11-03T18:28:26.892814] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-11-03T18:28:26.892894] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-11-03T18:28:26.894601] [DEBUG] [LOCAL ] DOCS: Trimmed 73528 records to 49914 (keeping 200 days of data) [2025-11-03T18:28:27.131292] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-11-03T18:28:27.145103] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-11-03T18:28:27.219849] [DEBUG] [LOCAL ] DOCS: Primary data saved (49914 records). [2025-11-03T18:28:27.219977] [INFO ] [MAIN ] DOCS: Full history saved. [2025-11-03T18:28:27.220050] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DOCS took 30.6s. Estimated remaining: 3h 58m 53s. Rate: 7.2 symbols/min [2025-11-03T18:28:28.711548] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T18:28:28.723544] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-11. [2025-11-03T18:28:31.234349] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-11 (2.51 seconds). [2025-11-03T18:28:31.235835] [INFO ] [REMOTE ] DOCN: Full fetch complete (73384 records). [2025-11-03T18:28:31.235926] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-11-03T18:28:31.630680] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-11-03T18:28:31.630809] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-11-03T18:28:31.631740] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-11-03T18:28:31.631805] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-11-03T18:28:31.633166] [DEBUG] [LOCAL ] DOCN: Trimmed 73384 records to 51164 (keeping 200 days of data) [2025-11-03T18:28:31.923898] [DEBUG] [LOCAL ] DOCN: Primary data saved (51164 records). [2025-11-03T18:28:31.924025] [INFO ] [MAIN ] DOCN: Full history saved. [2025-11-03T18:28:31.924099] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOCN took 39.3s. Estimated remaining: 3h 58m 35s. Rate: 7.2 symbols/min [2025-11-03T18:28:32.581460] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:28:32.580596] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:28:32.622967] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:28:32.619376] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:28:32.717891] [DEBUG] [LOCAL ] DOUG: Loaded 33919 existing records from primary storage. [2025-11-03T18:28:32.719005] [DEBUG] [LOCAL ] DOLE: Loaded 39661 existing records from primary storage. [2025-11-03T18:28:32.719678] [INFO ] [MAIN ] DOUG: Loaded 33919 existing records. [2025-11-03T18:28:32.719881] [INFO ] [MAIN ] DOLE: Loaded 39661 existing records. [2025-11-03T18:28:32.840214] [DEBUG] [LOCAL ] DOV: Loaded 46247 existing records from primary storage. [2025-11-03T18:28:32.943116] [INFO ] [MAIN ] DOV: Loaded 46247 existing records. [2025-11-03T18:28:32.949185] [DEBUG] [LOCAL ] DOW: Loaded 54513 existing records from primary storage. [2025-11-03T18:28:33.001159] [INFO ] [MAIN ] DOW: Loaded 54513 existing records. [2025-11-03T18:28:33.282178] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:28:33.324902] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-11-03T18:28:33.324818] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:28:33.335450] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-11-03T18:28:33.363207] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-11-03T18:28:33.368512] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-11-03T18:28:33.416463] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-11-03T18:28:33.416390] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-11-03T18:28:33.456142] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-11-03T18:28:33.498259] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:28:33.486736] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-11-03T18:28:33.550399] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:28:33.592274] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-11-03T18:28:33.592369] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-11-03T18:28:33.620954] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-11-03T18:28:33.621058] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-11-03T18:28:33.654925] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-11-03T18:28:33.655093] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-11-03T18:28:33.649716] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-11-03T18:28:33.715709] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-11-03T18:28:34.708607] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:28:34.784562] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:28:34.781109] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-11-03T18:28:34.818793] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-11-03T18:28:34.977130] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:28:34.993601] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-11-03T18:28:34.997672] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:28:34.998770] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-11-03T18:28:35.951385] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T18:28:35.959622] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-11-03T18:28:35.982470] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T18:28:35.990607] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-11-03T18:28:36.167819] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T18:28:36.181712] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-11-03T18:28:36.546400] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T18:28:36.557101] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-11-03T18:28:36.861953] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T18:28:36.870248] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-11-03T18:28:36.904027] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-11-03T18:28:36.911308] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-11-03T18:28:37.213712] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T18:28:37.222575] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-11-03T18:28:37.780335] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T18:28:37.788390] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-11-03T18:28:37.899509] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T18:28:37.907544] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-11-03T18:28:38.070010] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-11-03T18:28:38.301284] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T18:28:38.334814] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-11-03T18:28:38.699760] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-11-03T18:28:38.951902] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T18:28:39.134883] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-11-03T18:28:39.611299] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T18:28:39.934890] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-11-03T18:28:40.516742] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:28:40.734824] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-11-03T18:28:40.918922] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T18:28:41.534934] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-11-03T18:28:42.034590] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T18:28:42.334931] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-11-03T18:28:43.140062] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-11-03T18:28:43.155303] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T18:28:43.311254] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T18:28:43.934854] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-11-03T18:28:44.069075] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T18:28:44.734864] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-11-03T18:28:45.540952] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-11-03T18:28:45.578738] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-11-03T18:28:45.915330] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:28:46.334935] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-11-03T18:28:46.639369] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T18:28:47.134949] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-11-03T18:28:47.235023] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T18:28:47.934820] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-11-03T18:28:48.331131] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T18:28:48.734842] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-11-03T18:28:48.939146] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T18:28:49.534957] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-11-03T18:28:50.286798] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T18:28:50.334866] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-11-03T18:28:50.694744] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T18:28:51.134883] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-11-03T18:28:51.934895] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-11-03T18:28:51.992511] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-11-03T18:28:52.326459] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T18:28:52.734872] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-11-03T18:28:52.858581] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T18:28:53.534931] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-11-03T18:28:54.335085] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-11-03T18:28:54.413049] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-11-03T18:28:54.728553] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T18:28:55.134861] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-11-03T18:28:55.413601] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T18:28:55.934852] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-11-03T18:28:56.520128] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T18:28:56.734895] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-11-03T18:28:57.118559] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:28:57.534912] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-11-03T18:28:58.191895] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T18:28:58.334828] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-11-03T18:28:58.467336] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T18:28:59.134858] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-11-03T18:28:59.934876] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-11. [2025-11-03T18:29:00.022813] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T18:29:00.333559] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T18:29:00.734861] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-11. [2025-11-03T18:29:01.210749] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T18:29:01.211974] [INFO ] [REMOTE ] DOUG: Full fetch complete (49144 records). [2025-11-03T18:29:01.212057] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-11-03T18:29:01.539967] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-11. [2025-11-03T18:29:01.612621] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-11-03T18:29:01.612747] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-11-03T18:29:01.613555] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-11-03T18:29:01.613622] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-11-03T18:29:01.614997] [DEBUG] [LOCAL ] DOUG: Trimmed 49144 records to 33447 (keeping 200 days of data) [2025-11-03T18:29:01.809151] [DEBUG] [LOCAL ] DOUG: Primary data saved (33447 records). [2025-11-03T18:29:01.809292] [INFO ] [MAIN ] DOUG: Full history saved. [2025-11-03T18:29:01.809430] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOUG took 29.9s. Estimated remaining: 3h 59m 25s. Rate: 7.2 symbols/min [2025-11-03T18:29:02.009903] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:02.024623] [DEBUG] [LOCAL ] DPG: Loaded 13212 existing records from primary storage. [2025-11-03T18:29:02.024911] [INFO ] [MAIN ] DPG: Loaded 13212 existing records. [2025-11-03T18:29:02.240183] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:02.240402] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-11-03T18:29:02.240468] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-11-03T18:29:02.240902] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-11-03T18:29:02.240962] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-11-03T18:29:02.339933] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-11. [2025-11-03T18:29:02.566234] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T18:29:02.583984] [INFO ] [REMOTE ] DOLE: Full fetch complete (54867 records). [2025-11-03T18:29:02.594441] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-11-03T18:29:02.731310] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:03.043108] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-11-03T18:29:03.043178] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-11-03T18:29:03.044167] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-11-03T18:29:03.044234] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-11-03T18:29:03.045476] [DEBUG] [LOCAL ] DOLE: Trimmed 54867 records to 39218 (keeping 200 days of data) [2025-11-03T18:29:03.134824] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-11-03T18:29:03.277614] [DEBUG] [LOCAL ] DOLE: Primary data saved (39218 records). [2025-11-03T18:29:03.277774] [INFO ] [MAIN ] DOLE: Full history saved. [2025-11-03T18:29:03.277855] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOLE took 31.4s. Estimated remaining: 3h 58m 58s. Rate: 7.2 symbols/min [2025-11-03T18:29:03.442143] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:03.483074] [DEBUG] [LOCAL ] DQ: Loaded 44406 existing records from primary storage. [2025-11-03T18:29:03.483392] [INFO ] [MAIN ] DQ: Loaded 44406 existing records. [2025-11-03T18:29:03.644123] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-11 (2.10 seconds). [2025-11-03T18:29:03.667670] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:03.669377] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-11-03T18:29:03.669466] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-11-03T18:29:03.669665] [INFO ] [REMOTE ] DOV: Full fetch complete (66471 records). [2025-11-03T18:29:03.669761] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-11-03T18:29:03.702559] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-11-03T18:29:03.746386] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-11-03T18:29:04.205724] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T18:29:04.225172] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-11-03T18:29:04.463941] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:04.464175] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-11-03T18:29:04.464272] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-11-03T18:29:04.465386] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-11-03T18:29:04.465452] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-11-03T18:29:04.466582] [DEBUG] [LOCAL ] DOV: Trimmed 66471 records to 45492 (keeping 200 days of data) [2025-11-03T18:29:04.735570] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-11-03T18:29:04.753730] [DEBUG] [LOCAL ] DOV: Primary data saved (45492 records). [2025-11-03T18:29:04.753981] [INFO ] [MAIN ] DOV: Full history saved. [2025-11-03T18:29:04.754819] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-11-03T18:29:04.754545] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOV took 32.8s. Estimated remaining: 3h 58m 32s. Rate: 7.2 symbols/min [2025-11-03T18:29:04.925159] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:04.958545] [DEBUG] [LOCAL ] DRD: Loaded 38360 existing records from primary storage. [2025-11-03T18:29:04.958864] [INFO ] [MAIN ] DRD: Loaded 38360 existing records. [2025-11-03T18:29:05.134719] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:05.134904] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-11-03T18:29:05.134952] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-11-03T18:29:05.135610] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-11-03T18:29:05.135701] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-11-03T18:29:05.229598] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-11 (2.89 seconds). [2025-11-03T18:29:05.247046] [INFO ] [REMOTE ] DOW: Full fetch complete (77911 records). [2025-11-03T18:29:05.267586] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-11-03T18:29:05.557802] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-11-03T18:29:05.803852] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:05.899974] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-11-03T18:29:05.900082] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-11-03T18:29:05.901407] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-11-03T18:29:05.901499] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-11-03T18:29:05.903516] [DEBUG] [LOCAL ] DOW: Trimmed 77911 records to 53733 (keeping 200 days of data) [2025-11-03T18:29:06.156255] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-11-03T18:29:06.164189] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:29:06.277347] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-11-03T18:29:06.277475] [INFO ] [MAIN ] DOW: Full history saved. [2025-11-03T18:29:06.277555] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOW took 34.4s. Estimated remaining: 3h 58m 5s. Rate: 7.2 symbols/min [2025-11-03T18:29:06.341812] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-11-03T18:29:06.459159] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:06.504271] [DEBUG] [LOCAL ] DRH: Loaded 50806 existing records from primary storage. [2025-11-03T18:29:06.504565] [INFO ] [MAIN ] DRH: Loaded 50806 existing records. [2025-11-03T18:29:06.689556] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:06.689800] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-11-03T18:29:06.689860] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-11-03T18:29:06.690722] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-11-03T18:29:06.690791] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-11-03T18:29:07.050477] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:07.134855] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-11-03T18:29:07.517607] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:29:07.849540] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-11-03T18:29:07.934820] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-11-03T18:29:08.541154] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T18:29:08.734859] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-11-03T18:29:09.534859] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-11-03T18:29:09.764301] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T18:29:09.969695] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-11-03T18:29:10.334853] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-11-03T18:29:11.134840] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-11-03T18:29:11.256986] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T18:29:11.934863] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-11-03T18:29:12.363360] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T18:29:12.734858] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-11-03T18:29:12.929625] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T18:29:13.534858] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-11-03T18:29:13.802060] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T18:29:14.334875] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-11-03T18:29:14.762153] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:29:15.134852] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-11-03T18:29:15.491131] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T18:29:15.934847] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-11-03T18:29:16.599153] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T18:29:16.678072] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-11-03T18:29:16.734846] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-11-03T18:29:17.443307] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T18:29:17.534815] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-11-03T18:29:18.113575] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T18:29:18.334869] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-11-03T18:29:19.134863] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-11-03T18:29:19.302352] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-11-03T18:29:19.672668] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-11-03T18:29:19.934860] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-11-03T18:29:20.734954] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-11-03T18:29:21.115062] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:29:21.534884] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-11-03T18:29:21.757694] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T18:29:22.334911] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-11. [2025-11-03T18:29:22.587579] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T18:29:23.134956] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-11-03T18:29:23.242380] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T18:29:23.243221] [INFO ] [REMOTE ] DPG: Full fetch complete (18877 records). [2025-11-03T18:29:23.243294] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-11-03T18:29:23.612347] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-11-03T18:29:23.612439] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-11-03T18:29:23.612901] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-11-03T18:29:23.612965] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-11-03T18:29:23.613737] [DEBUG] [LOCAL ] DPG: Trimmed 18877 records to 12995 (keeping 200 days of data) [2025-11-03T18:29:23.692365] [DEBUG] [LOCAL ] DPG: Primary data saved (12995 records). [2025-11-03T18:29:23.692510] [INFO ] [MAIN ] DPG: Full history saved. [2025-11-03T18:29:23.692589] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 21.9s. Estimated remaining: 3h 58m 21s. Rate: 7.2 symbols/min [2025-11-03T18:29:23.895826] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:23.936357] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-11-03T18:29:23.938484] [DEBUG] [LOCAL ] DRI: Loaded 48056 existing records from primary storage. [2025-11-03T18:29:23.938781] [INFO ] [MAIN ] DRI: Loaded 48056 existing records. [2025-11-03T18:29:24.139373] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:24.139737] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-11-03T18:29:24.139899] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-11-03T18:29:24.140963] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-11-03T18:29:24.141028] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-11-03T18:29:24.464750] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:29:24.552487] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:24.734908] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-11-03T18:29:25.208764] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T18:29:25.534874] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-11-03T18:29:26.173056] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:29:26.334894] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-11-03T18:29:26.803681] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T18:29:27.134840] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-11-03T18:29:27.559095] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:29:27.934852] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-11-03T18:29:28.451619] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T18:29:28.734861] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-11-03T18:29:29.363153] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T18:29:29.534899] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-11-03T18:29:30.080819] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T18:29:30.334889] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-11-03T18:29:30.807264] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T18:29:31.134921] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-11. [2025-11-03T18:29:31.634290] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:29:31.934870] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-11-03T18:29:32.734926] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-11-03T18:29:33.030817] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-11 (1.90 seconds). [2025-11-03T18:29:33.031991] [INFO ] [REMOTE ] DRD: Full fetch complete (52885 records). [2025-11-03T18:29:33.032068] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-11-03T18:29:33.444301] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-11-03T18:29:33.470092] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-11-03T18:29:33.470268] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-11-03T18:29:33.470999] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-11-03T18:29:33.471080] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-11-03T18:29:33.472256] [DEBUG] [LOCAL ] DRD: Trimmed 52885 records to 37782 (keeping 200 days of data) [2025-11-03T18:29:33.560819] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-11-03T18:29:33.696998] [DEBUG] [LOCAL ] DRD: Primary data saved (37782 records). [2025-11-03T18:29:33.697127] [INFO ] [MAIN ] DRD: Full history saved. [2025-11-03T18:29:33.697227] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DRD took 28.9s. Estimated remaining: 3h 58m 18s. Rate: 7.2 symbols/min [2025-11-03T18:29:33.869730] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:33.878713] [DEBUG] [LOCAL ] DRLL: Loaded 8494 existing records from primary storage. [2025-11-03T18:29:33.878920] [INFO ] [MAIN ] DRLL: Loaded 8494 existing records. [2025-11-03T18:29:34.062557] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:34.062898] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-11-03T18:29:34.063064] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-11-03T18:29:34.063454] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-11-03T18:29:34.063516] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-11-03T18:29:34.198299] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T18:29:34.342635] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-11-03T18:29:34.467269] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:34.692342] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T18:29:35.134902] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-11-03T18:29:35.835429] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T18:29:35.934831] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-11-03T18:29:36.360231] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T18:29:36.734903] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-11-03T18:29:37.334769] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T18:29:37.389038] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-11-03T18:29:37.534839] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-11-03T18:29:38.050864] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T18:29:38.334867] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-11-03T18:29:39.134834] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-11-03T18:29:39.506289] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T18:29:39.790158] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T18:29:39.934891] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-11-03T18:29:40.734908] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-11-03T18:29:41.165767] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T18:29:41.534873] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-11-03T18:29:41.986779] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T18:29:42.334889] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-11-03T18:29:42.518804] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T18:29:43.134864] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-11-03T18:29:43.849574] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:29:43.934827] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-11. [2025-11-03T18:29:44.237061] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:29:44.734905] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-11-03T18:29:45.534913] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-11-03T18:29:45.874741] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-11 (1.94 seconds). [2025-11-03T18:29:45.876150] [INFO ] [REMOTE ] DQ: Full fetch complete (64112 records). [2025-11-03T18:29:45.876238] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-11-03T18:29:46.230573] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-11-03T18:29:46.329484] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-11-03T18:29:46.347903] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-11-03T18:29:46.364019] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-11-03T18:29:46.364126] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-11-03T18:29:46.365333] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-11-03T18:29:46.365508] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-11-03T18:29:46.366929] [DEBUG] [LOCAL ] DQ: Trimmed 64112 records to 43820 (keeping 200 days of data) [2025-11-03T18:29:46.620400] [DEBUG] [LOCAL ] DQ: Primary data saved (43820 records). [2025-11-03T18:29:46.620527] [INFO ] [MAIN ] DQ: Full history saved. [2025-11-03T18:29:46.621048] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DQ took 43.3s. Estimated remaining: 3h 58m 22s. Rate: 7.2 symbols/min [2025-11-03T18:29:46.792118] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:46.827322] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T18:29:46.831847] [DEBUG] [LOCAL ] DSL: Loaded 29177 existing records from primary storage. [2025-11-03T18:29:46.832149] [INFO ] [MAIN ] DSL: Loaded 29177 existing records. [2025-11-03T18:29:47.011329] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:47.011565] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-11-03T18:29:47.011612] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-11-03T18:29:47.012181] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-11-03T18:29:47.012239] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-11-03T18:29:47.140053] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-11-03T18:29:47.374141] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:47.934875] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-11-03T18:29:48.573467] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T18:29:48.734883] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-11-03T18:29:48.776005] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-11-03T18:29:49.150436] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-11-03T18:29:49.534892] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-11-03T18:29:50.334909] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-11-03T18:29:50.845558] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T18:29:51.134891] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-11-03T18:29:51.615554] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T18:29:51.934886] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-11. [2025-11-03T18:29:52.028327] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:29:52.734951] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-11. [2025-11-03T18:29:52.869178] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T18:29:52.871122] [INFO ] [REMOTE ] DRI: Full fetch complete (69502 records). [2025-11-03T18:29:52.871281] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-11-03T18:29:53.278118] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-11-03T18:29:53.278272] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-11-03T18:29:53.279167] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-11-03T18:29:53.279235] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-11-03T18:29:53.280732] [DEBUG] [LOCAL ] DRI: Trimmed 69502 records to 47343 (keeping 200 days of data) [2025-11-03T18:29:53.543988] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-11-03T18:29:53.573583] [DEBUG] [LOCAL ] DRI: Primary data saved (47343 records). [2025-11-03T18:29:53.573757] [INFO ] [MAIN ] DRI: Full history saved. [2025-11-03T18:29:53.574347] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DRI took 29.9s. Estimated remaining: 3h 58m 10s. Rate: 7.2 symbols/min [2025-11-03T18:29:53.756439] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:53.771360] [DEBUG] [LOCAL ] DSM: Loaded 14151 existing records from primary storage. [2025-11-03T18:29:53.771611] [INFO ] [MAIN ] DSM: Loaded 14151 existing records. [2025-11-03T18:29:53.966540] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:53.966993] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-11-03T18:29:53.967122] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-11-03T18:29:53.967541] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-11-03T18:29:53.967597] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-11-03T18:29:54.089078] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-11-03T18:29:54.332697] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:54.337174] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-11-03T18:29:54.337416] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-11 (1.60 seconds). [2025-11-03T18:29:54.339960] [INFO ] [REMOTE ] DRH: Full fetch complete (72060 records). [2025-11-03T18:29:54.340064] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-11-03T18:29:54.725860] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-11-03T18:29:54.725943] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-11-03T18:29:54.726799] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-11-03T18:29:54.726863] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-11-03T18:29:54.728272] [DEBUG] [LOCAL ] DRH: Trimmed 72060 records to 50035 (keeping 200 days of data) [2025-11-03T18:29:54.939308] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T18:29:55.027336] [DEBUG] [LOCAL ] DRH: Primary data saved (50035 records). [2025-11-03T18:29:55.027484] [INFO ] [MAIN ] DRH: Full history saved. [2025-11-03T18:29:55.028484] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRH took 48.8s. Estimated remaining: 3h 57m 43s. Rate: 7.2 symbols/min [2025-11-03T18:29:55.139913] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-11-03T18:29:55.195824] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:55.195953] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-11-03T18:29:55.195990] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-11-03T18:29:55.196094] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-11-03T18:29:55.196146] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-11-03T18:29:55.196222] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-11-03T18:29:55.196266] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-11-03T18:29:55.540024] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:55.934889] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-11-03T18:29:56.054088] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T18:29:56.622688] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T18:29:56.734846] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-11-03T18:29:57.208887] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-11-03T18:29:57.534890] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-11. [2025-11-03T18:29:58.251277] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T18:29:58.252047] [INFO ] [REMOTE ] DRLL: Full fetch complete (14287 records). [2025-11-03T18:29:58.252113] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-11-03T18:29:58.340112] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-11-03T18:29:58.614576] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-11-03T18:29:58.614673] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-11-03T18:29:58.615011] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-11-03T18:29:58.615054] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-11-03T18:29:58.615491] [DEBUG] [LOCAL ] DRLL: Trimmed 14287 records to 8351 (keeping 200 days of data) [2025-11-03T18:29:58.663401] [DEBUG] [LOCAL ] DRLL: Primary data saved (8351 records). [2025-11-03T18:29:58.663493] [INFO ] [MAIN ] DRLL: Full history saved. [2025-11-03T18:29:58.663565] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRLL took 25.0s. Estimated remaining: 3h 57m 23s. Rate: 7.2 symbols/min [2025-11-03T18:29:58.820061] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T18:29:58.838486] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:29:58.858697] [DEBUG] [LOCAL ] DSU: Loaded 22716 existing records from primary storage. [2025-11-03T18:29:58.858927] [INFO ] [MAIN ] DSU: Loaded 22716 existing records. [2025-11-03T18:29:59.032854] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:29:59.033056] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-11-03T18:29:59.033123] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-11-03T18:29:59.033606] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-11-03T18:29:59.033697] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-11-03T18:29:59.139994] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-11-03T18:29:59.399194] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:29:59.934883] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-11-03T18:30:00.054872] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T18:30:00.591621] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-11-03T18:30:00.734899] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-11-03T18:30:01.543938] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-11-03T18:30:01.545615] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T18:30:02.334863] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-11-03T18:30:03.089062] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-11-03T18:30:03.098497] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T18:30:03.134934] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-11-03T18:30:03.942317] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-11-03T18:30:03.946803] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-11-03T18:30:04.267025] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T18:30:04.734915] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-11-03T18:30:05.534901] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-11-03T18:30:05.641781] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T18:30:06.142455] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T18:30:06.334843] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-11-03T18:30:06.719840] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-11-03T18:30:07.134861] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-11-03T18:30:07.877092] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T18:30:07.934819] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-11-03T18:30:08.734837] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-11-03T18:30:08.825076] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T18:30:09.521043] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T18:30:09.534814] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-11-03T18:30:10.334846] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-11-03T18:30:10.522314] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T18:30:11.134891] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-11-03T18:30:11.180570] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T18:30:11.578731] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T18:30:11.934872] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-11-03T18:30:12.734844] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-11-03T18:30:13.058172] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T18:30:13.452466] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-11-03T18:30:13.534877] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-11-03T18:30:14.334891] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-11-03T18:30:15.134892] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-11-03T18:30:15.380450] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-11-03T18:30:15.412121] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-11-03T18:30:15.934832] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-11-03T18:30:16.068570] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-11-03T18:30:16.183070] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-11-03T18:30:16.734859] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-11-03T18:30:16.989901] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-11-03T18:30:17.534884] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-11-03T18:30:18.334895] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-11-03T18:30:19.134854] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-11-03T18:30:19.169459] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T18:30:19.934916] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-11-03T18:30:20.075843] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-11-03T18:30:20.512138] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T18:30:20.575194] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-11-03T18:30:20.734867] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-11-03T18:30:21.040381] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-11-03T18:30:21.534903] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-11-03T18:30:22.061242] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-11-03T18:30:22.334872] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-11-03T18:30:22.823474] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T18:30:23.134899] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-11-03T18:30:23.758928] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T18:30:23.934906] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-11-03T18:30:24.528796] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-11-03T18:30:24.734879] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-11-03T18:30:25.534825] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-11-03T18:30:25.574713] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T18:30:26.229950] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T18:30:26.334863] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-11. [2025-11-03T18:30:27.134951] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-11-03T18:30:27.247331] [DEBUG] [REMOTE ] DSL: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:30:27.247628] [WARN ] [REMOTE ] DSL: No data returned for month 2025-11 [2025-11-03T18:30:27.247765] [FATAL] [REMOTE ] DSL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:30:27.247863] [FATAL] [MAIN ] DSL: Failed to fetch primary data. [2025-11-03T18:30:27.247936] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:30:27.248010] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-11-03T18:30:27.248090] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-11-03T18:30:27.248144] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-11-03T18:30:27.248434] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-11-03T18:30:27.249025] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DSL took 40.6s. Estimated remaining: 3h 58m 8s. Rate: 7.2 symbols/min [2025-11-03T18:30:27.424678] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:30:27.447724] [DEBUG] [LOCAL ] DSX: Loaded 23243 existing records from primary storage. [2025-11-03T18:30:27.447993] [INFO ] [MAIN ] DSX: Loaded 23243 existing records. [2025-11-03T18:30:27.640430] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:30:27.640603] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-11-03T18:30:27.640678] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-11-03T18:30:27.641153] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-11-03T18:30:27.641210] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-11-03T18:30:27.936051] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-11-03T18:30:27.994935] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:30:28.012285] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T18:30:28.362214] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-11-03T18:30:28.734852] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-11-03T18:30:29.534796] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-11. [2025-11-03T18:30:29.682730] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:30:30.334871] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-11. [2025-11-03T18:30:30.675154] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T18:30:30.676089] [INFO ] [REMOTE ] DSU: Full fetch complete (32643 records). [2025-11-03T18:30:30.676159] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-11-03T18:30:31.038769] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-11-03T18:30:31.038853] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-11-03T18:30:31.039367] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-11-03T18:30:31.039406] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-11-03T18:30:31.040193] [DEBUG] [LOCAL ] DSU: Trimmed 32643 records to 22360 (keeping 200 days of data) [2025-11-03T18:30:31.139715] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-11-03T18:30:31.172614] [DEBUG] [LOCAL ] DSU: Primary data saved (22360 records). [2025-11-03T18:30:31.172779] [INFO ] [MAIN ] DSU: Full history saved. [2025-11-03T18:30:31.172863] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DSU took 32.5s. Estimated remaining: 3h 57m 48s. Rate: 7.2 symbols/min [2025-11-03T18:30:31.321478] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T18:30:31.345255] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:30:31.345876] [INFO ] [REMOTE ] DSM: Full fetch complete (24272 records). [2025-11-03T18:30:31.346081] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-11-03T18:30:31.737701] [DEBUG] [LOCAL ] DT: Loaded 53675 existing records from primary storage. [2025-11-03T18:30:31.766453] [INFO ] [MAIN ] DT: Loaded 53675 existing records. [2025-11-03T18:30:31.767260] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-11-03T18:30:31.772503] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-11-03T18:30:31.787749] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-11-03T18:30:31.836759] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-11-03T18:30:31.894232] [DEBUG] [LOCAL ] DSM: Trimmed 24272 records to 13679 (keeping 200 days of data) [2025-11-03T18:30:31.965412] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-11. [2025-11-03T18:30:32.040813] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:30:32.072694] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-11-03T18:30:32.073033] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-11-03T18:30:32.072881] [DEBUG] [LOCAL ] DSM: Primary data saved (13679 records). [2025-11-03T18:30:32.073364] [INFO ] [MAIN ] DSM: Full history saved. [2025-11-03T18:30:32.073776] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSM took 38.5s. Estimated remaining: 3h 57m 20s. Rate: 7.2 symbols/min [2025-11-03T18:30:32.086819] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-11-03T18:30:32.096984] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-11-03T18:30:32.199104] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T18:30:32.542350] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:30:32.564585] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-11 (0.60 seconds). [2025-11-03T18:30:32.597884] [INFO ] [REMOTE ] DSMC: Full fetch complete (2915 records). [2025-11-03T18:30:32.612789] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-11-03T18:30:32.715799] [DEBUG] [LOCAL ] DTB: Loaded 4870 existing records from primary storage. [2025-11-03T18:30:32.746135] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-11-03T18:30:32.776934] [INFO ] [MAIN ] DTB: Loaded 4870 existing records. [2025-11-03T18:30:32.828441] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:30:33.232132] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:30:33.245269] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-11-03T18:30:33.251319] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-11-03T18:30:33.267103] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-11-03T18:30:33.291964] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-11-03T18:30:33.408200] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-11-03T18:30:33.414855] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-11-03T18:30:33.422607] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-11-03T18:30:33.436902] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-11-03T18:30:33.455075] [DEBUG] [LOCAL ] DSMC: Trimmed 2915 records to 1735 (keeping 200 days of data) [2025-11-03T18:30:33.518884] [DEBUG] [LOCAL ] DSMC: Primary data saved (1735 records). [2025-11-03T18:30:33.525529] [INFO ] [MAIN ] DSMC: Full history saved. [2025-11-03T18:30:33.525689] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSMC took 38.5s. Estimated remaining: 3h 56m 54s. Rate: 7.2 symbols/min [2025-11-03T18:30:33.551716] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-11-03T18:30:34.020236] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:30:34.027425] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:30:34.046979] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:30:34.103674] [DEBUG] [LOCAL ] DTE: Loaded 47594 existing records from primary storage. [2025-11-03T18:30:34.104133] [INFO ] [MAIN ] DTE: Loaded 47594 existing records. [2025-11-03T18:30:34.295737] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:30:34.296074] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-11-03T18:30:34.296138] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-11-03T18:30:34.297219] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-11-03T18:30:34.297281] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-11-03T18:30:34.342720] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-11-03T18:30:34.674775] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:30:35.134923] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-11-03T18:30:35.243128] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T18:30:35.272238] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T18:30:35.700175] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-11-03T18:30:35.934903] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-11-03T18:30:36.734877] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-11-03T18:30:37.155334] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-11-03T18:30:37.260882] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T18:30:37.534888] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-11-03T18:30:38.334911] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-11-03T18:30:38.852098] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T18:30:39.134883] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-11-03T18:30:39.390084] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T18:30:39.934858] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-11-03T18:30:40.298884] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-11-03T18:30:40.723588] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-11-03T18:30:40.735019] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-11-03T18:30:41.130601] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-11-03T18:30:41.534922] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-11-03T18:30:42.334856] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-11-03T18:30:42.833158] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T18:30:43.134846] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-11-03T18:30:43.287724] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T18:30:43.934853] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-11-03T18:30:44.734823] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-11-03T18:30:44.801254] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-11-03T18:30:44.914041] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-11-03T18:30:45.139047] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T18:30:45.534870] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-11-03T18:30:46.334899] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-11-03T18:30:46.631081] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:30:47.134925] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-11-03T18:30:47.635051] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-11-03T18:30:47.749049] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T18:30:47.934894] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-11-03T18:30:48.734925] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-11-03T18:30:49.185306] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-11-03T18:30:49.306159] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T18:30:49.534944] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-11-03T18:30:50.020984] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-11-03T18:30:50.334946] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-11-03T18:30:51.134940] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-11-03T18:30:51.822011] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T18:30:51.934867] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-11-03T18:30:52.516146] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T18:30:52.734884] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-11-03T18:30:53.265063] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T18:30:53.534898] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-11-03T18:30:54.083587] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T18:30:54.334880] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-11-03T18:30:54.441262] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:30:54.731678] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T18:30:55.134883] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-11-03T18:30:55.497902] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T18:30:55.934911] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-11-03T18:30:56.734876] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-11-03T18:30:56.751527] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-11-03T18:30:57.534879] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-11. [2025-11-03T18:30:58.323365] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T18:30:58.339282] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-11-03T18:30:58.627042] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-11 (1.09 seconds). [2025-11-03T18:30:58.628474] [INFO ] [REMOTE ] DSX: Full fetch complete (34797 records). [2025-11-03T18:30:58.628901] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-11-03T18:30:59.009233] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-11-03T18:30:59.009330] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-11-03T18:30:59.009975] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-11-03T18:30:59.010044] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-11-03T18:30:59.011055] [DEBUG] [LOCAL ] DSX: Trimmed 34797 records to 22929 (keeping 200 days of data) [2025-11-03T18:30:59.136901] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-11. [2025-11-03T18:30:59.140571] [DEBUG] [LOCAL ] DSX: Primary data saved (22929 records). [2025-11-03T18:30:59.140747] [INFO ] [MAIN ] DSX: Full history saved. [2025-11-03T18:30:59.140841] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DSX took 31.9s. Estimated remaining: 3h 57m 31s. Rate: 7.2 symbols/min [2025-11-03T18:30:59.323574] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:30:59.323781] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-11-03T18:30:59.323839] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-11-03T18:30:59.323948] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-11-03T18:30:59.323992] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-11-03T18:30:59.324034] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-11-03T18:30:59.324065] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-11-03T18:30:59.691892] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:30:59.730213] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T18:30:59.934861] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-11-03T18:31:00.259817] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-11-03T18:31:00.262002] [DEBUG] [REMOTE ] DT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:31:00.262354] [WARN ] [REMOTE ] DT: No data returned for month 2025-11 [2025-11-03T18:31:00.262445] [FATAL] [REMOTE ] DT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:31:00.262527] [FATAL] [MAIN ] DT: Failed to fetch primary data. [2025-11-03T18:31:00.262589] [WARN ] [MAIN ] DT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:31:00.262688] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-11-03T18:31:00.262760] [DEBUG] [LOCAL ] DT: No primary data file found to delete. [2025-11-03T18:31:00.262796] [INFO ] [LOCAL ] DT: Starting deletion of derivative data. [2025-11-03T18:31:00.262977] [DEBUG] [LOCAL ] DT: Deleted derivative data file. [2025-11-03T18:31:00.263060] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DT took 29.1s. Estimated remaining: 3h 57m 3s. Rate: 7.2 symbols/min [2025-11-03T18:31:00.437051] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:00.444090] [DEBUG] [LOCAL ] DTG: Loaded 5617 existing records from primary storage. [2025-11-03T18:31:00.444300] [INFO ] [MAIN ] DTG: Loaded 5617 existing records. [2025-11-03T18:31:00.630835] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:31:00.631053] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-11-03T18:31:00.631100] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-11-03T18:31:00.631305] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-11-03T18:31:00.631360] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-11-03T18:31:00.736608] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-11-03T18:31:01.000439] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:01.058893] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T18:31:01.534866] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-11-03T18:31:02.272014] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T18:31:02.334852] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-11-03T18:31:02.736503] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T18:31:03.134907] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-11-03T18:31:03.488936] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T18:31:03.934863] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-11. [2025-11-03T18:31:04.590341] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T18:31:04.591030] [INFO ] [REMOTE ] DTB: Full fetch complete (6423 records). [2025-11-03T18:31:04.591097] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-11-03T18:31:04.741146] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-11-03T18:31:04.958830] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-11-03T18:31:04.958922] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-11-03T18:31:04.959139] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-11-03T18:31:04.959181] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-11-03T18:31:04.959705] [DEBUG] [LOCAL ] DTB: Trimmed 6423 records to 4815 (keeping 200 days of data) [2025-11-03T18:31:04.996427] [DEBUG] [LOCAL ] DTB: Primary data saved (4815 records). [2025-11-03T18:31:04.996605] [INFO ] [MAIN ] DTB: Full history saved. [2025-11-03T18:31:04.996753] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DTB took 32.9s. Estimated remaining: 3h 56m 46s. Rate: 7.2 symbols/min [2025-11-03T18:31:05.154479] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-11-03T18:31:05.175389] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:05.175559] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-11-03T18:31:05.175595] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-11-03T18:31:05.175728] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-11-03T18:31:05.175773] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-11-03T18:31:05.175821] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-11-03T18:31:05.175852] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-11-03T18:31:05.541604] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-11-03T18:31:05.565626] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:05.879468] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T18:31:06.334865] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-11-03T18:31:07.134891] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-11-03T18:31:07.280003] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:31:07.280348] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-11-03T18:31:07.280418] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:31:07.280461] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-11-03T18:31:07.280499] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:31:07.280539] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-11-03T18:31:07.280590] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-11-03T18:31:07.280624] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-11-03T18:31:07.280702] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-11-03T18:31:07.280761] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DTK took 2.3s. Estimated remaining: 3h 56m 22s. Rate: 7.2 symbols/min [2025-11-03T18:31:07.468180] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:07.468375] [DEBUG] [LOCAL ] DTM: No existing data file found in primary storage. [2025-11-03T18:31:07.468495] [WARN ] [MAIN ] DTM: No existing data found, performing full refresh instead. [2025-11-03T18:31:07.468610] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-11-03T18:31:07.468682] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-11-03T18:31:07.468746] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-11-03T18:31:07.468781] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-11-03T18:31:07.853261] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:07.883921] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-11-03T18:31:07.934887] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-11-03T18:31:08.345589] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T18:31:08.734951] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-11-03T18:31:09.068375] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-11-03T18:31:09.534881] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-11-03T18:31:10.334895] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-11-03T18:31:10.824519] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T18:31:10.823286] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-11-03T18:31:11.134862] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-11-03T18:31:11.394703] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-11-03T18:31:11.934894] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-11-03T18:31:12.734874] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-11-03T18:31:13.307005] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T18:31:13.534887] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-11-03T18:31:13.906705] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T18:31:13.952919] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-11-03T18:31:14.334871] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-11-03T18:31:15.134916] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-11-03T18:31:15.929342] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T18:31:15.939372] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-11-03T18:31:16.359638] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T18:31:16.734869] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-11-03T18:31:17.325223] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-11-03T18:31:17.534919] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-11-03T18:31:17.849674] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-11-03T18:31:18.162672] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T18:31:18.334889] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-11-03T18:31:19.134908] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-11-03T18:31:19.578425] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-11-03T18:31:19.741706] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T18:31:19.934945] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-11-03T18:31:20.320046] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T18:31:20.734903] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-11-03T18:31:21.534927] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-11-03T18:31:21.918737] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:31:22.334857] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-11-03T18:31:22.949240] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T18:31:23.134847] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-11-03T18:31:23.465070] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-11-03T18:31:23.934863] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-11-03T18:31:24.511059] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T18:31:24.734862] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-11. [2025-11-03T18:31:24.915014] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T18:31:25.379526] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T18:31:25.380158] [INFO ] [REMOTE ] DTF: Full fetch complete (1721 records). [2025-11-03T18:31:25.380228] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-11-03T18:31:25.534908] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-11-03T18:31:25.562480] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-11-03T18:31:25.562700] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:31:25.562769] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:31:25.562838] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-11-03T18:31:25.562897] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-11-03T18:31:25.562934] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-11-03T18:31:25.562973] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-11-03T18:31:25.563030] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DTF took 26.4s. Estimated remaining: 3h 56m 39s. Rate: 7.2 symbols/min [2025-11-03T18:31:25.737582] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:25.743085] [DEBUG] [LOCAL ] DTW: Loaded 4644 existing records from primary storage. [2025-11-03T18:31:25.743231] [INFO ] [MAIN ] DTW: Loaded 4644 existing records. [2025-11-03T18:31:25.922963] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:31:25.923163] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-11-03T18:31:25.923210] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-11-03T18:31:25.923431] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-11-03T18:31:25.923494] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-11-03T18:31:26.284882] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:26.334825] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-11-03T18:31:26.878070] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-11-03T18:31:26.983427] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T18:31:27.134846] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-11. [2025-11-03T18:31:27.934861] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-11-03T18:31:28.129088] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T18:31:28.131013] [INFO ] [REMOTE ] DTE: Full fetch complete (68880 records). [2025-11-03T18:31:28.131141] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-11-03T18:31:28.527050] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T18:31:28.551486] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-11-03T18:31:28.552945] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-11-03T18:31:28.554037] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-11-03T18:31:28.554106] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-11-03T18:31:28.555527] [DEBUG] [LOCAL ] DTE: Trimmed 68880 records to 46907 (keeping 200 days of data) [2025-11-03T18:31:28.739731] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-11-03T18:31:28.842084] [DEBUG] [LOCAL ] DTE: Primary data saved (46907 records). [2025-11-03T18:31:28.842218] [INFO ] [MAIN ] DTE: Full history saved. [2025-11-03T18:31:28.843014] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTE took 55.3s. Estimated remaining: 3h 56m 18s. Rate: 7.2 symbols/min [2025-11-03T18:31:29.011589] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:29.064584] [DEBUG] [LOCAL ] DUK: Loaded 54197 existing records from primary storage. [2025-11-03T18:31:29.064919] [INFO ] [MAIN ] DUK: Loaded 54197 existing records. [2025-11-03T18:31:29.246071] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:31:29.246302] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-11-03T18:31:29.246363] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-11-03T18:31:29.247307] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-11-03T18:31:29.247374] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-11-03T18:31:29.535387] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-11-03T18:31:29.615606] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:29.908609] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T18:31:30.004597] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:31:30.334877] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-11-03T18:31:30.765782] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T18:31:31.134878] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-11-03T18:31:31.530967] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-11-03T18:31:31.934905] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-11-03T18:31:32.734858] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-11-03T18:31:33.534852] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-11-03T18:31:33.606763] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T18:31:33.934609] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T18:31:34.170199] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:31:34.334882] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-11-03T18:31:35.134851] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-11-03T18:31:35.541962] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T18:31:35.618613] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:31:35.934901] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-11-03T18:31:36.419089] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T18:31:36.734892] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-11-03T18:31:37.188414] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T18:31:37.534901] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-11-03T18:31:37.958033] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-11-03T18:31:38.334900] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-11-03T18:31:39.134956] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-11. [2025-11-03T18:31:39.899294] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-11-03T18:31:39.934850] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-11-03T18:31:39.992164] [DEBUG] [REMOTE ] DTM: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:31:39.992489] [WARN ] [REMOTE ] DTM: No data returned for month 2025-11 [2025-11-03T18:31:39.992593] [FATAL] [REMOTE ] DTM: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:31:39.992727] [FATAL] [MAIN ] DTM: Failed to fetch primary data. [2025-11-03T18:31:39.992798] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:31:39.992855] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-11-03T18:31:39.992941] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-11-03T18:31:39.993002] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-11-03T18:31:39.993077] [DEBUG] [LOCAL ] DTM: No derivative data file found to delete. [2025-11-03T18:31:39.993131] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTM took 32.7s. Estimated remaining: 3h 56m 17s. Rate: 7.2 symbols/min [2025-11-03T18:31:40.194272] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:40.194451] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-11-03T18:31:40.194488] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-11-03T18:31:40.194600] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-11-03T18:31:40.194664] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-11-03T18:31:40.194754] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-11-03T18:31:40.194789] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-11-03T18:31:40.539713] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:40.734834] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-11-03T18:31:41.234733] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-11-03T18:31:41.363892] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T18:31:41.534871] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-11. [2025-11-03T18:31:42.112058] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-11 (0.58 seconds). [2025-11-03T18:31:42.113183] [INFO ] [REMOTE ] DTG: Full fetch complete (8321 records). [2025-11-03T18:31:42.113277] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-11-03T18:31:42.340086] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-11-03T18:31:42.520036] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-11-03T18:31:42.520207] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-11-03T18:31:42.520685] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-11-03T18:31:42.520769] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-11-03T18:31:42.521906] [DEBUG] [LOCAL ] DTG: Trimmed 8321 records to 5537 (keeping 200 days of data) [2025-11-03T18:31:42.576188] [DEBUG] [LOCAL ] DTG: Primary data saved (5537 records). [2025-11-03T18:31:42.576366] [INFO ] [MAIN ] DTG: Full history saved. [2025-11-03T18:31:42.576476] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTG took 42.3s. Estimated remaining: 3h 55m 54s. Rate: 7.2 symbols/min [2025-11-03T18:31:42.839199] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:42.845636] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T18:31:42.916452] [DEBUG] [LOCAL ] DV: Loaded 51913 existing records from primary storage. [2025-11-03T18:31:42.916961] [INFO ] [MAIN ] DV: Loaded 51913 existing records. [2025-11-03T18:31:43.147521] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-11-03T18:31:43.207828] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:31:43.208527] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-11-03T18:31:43.208580] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-11-03T18:31:43.209495] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-11-03T18:31:43.209558] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-11-03T18:31:43.609998] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:43.934848] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-11-03T18:31:44.734887] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-11-03T18:31:44.890002] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-11-03T18:31:45.260158] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T18:31:45.339052] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T18:31:45.534860] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-11-03T18:31:46.334876] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-11-03T18:31:47.090944] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-11-03T18:31:47.134911] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-11-03T18:31:47.602947] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T18:31:47.934941] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-11-03T18:31:48.268500] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T18:31:48.650559] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T18:31:48.734870] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-11-03T18:31:49.534883] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-11-03T18:31:49.934958] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T18:31:49.987167] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T18:31:50.334878] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-11. [2025-11-03T18:31:51.003118] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-11 (0.67 seconds). [2025-11-03T18:31:51.003808] [INFO ] [REMOTE ] DTW: Full fetch complete (6824 records). [2025-11-03T18:31:51.003880] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-11-03T18:31:51.145991] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-11-03T18:31:51.371539] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-11-03T18:31:51.371620] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-11-03T18:31:51.371841] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-11-03T18:31:51.371897] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-11-03T18:31:51.372315] [DEBUG] [LOCAL ] DTW: Trimmed 6824 records to 4549 (keeping 200 days of data) [2025-11-03T18:31:51.398767] [DEBUG] [LOCAL ] DTW: Primary data saved (4549 records). [2025-11-03T18:31:51.398887] [INFO ] [MAIN ] DTW: Full history saved. [2025-11-03T18:31:51.398965] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DTW took 25.8s. Estimated remaining: 3h 55m 47s. Rate: 7.2 symbols/min [2025-11-03T18:31:51.584572] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:31:51.584782] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-11-03T18:31:51.584825] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-11-03T18:31:51.584939] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-11-03T18:31:51.584979] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-11-03T18:31:51.585028] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-11-03T18:31:51.585059] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-11-03T18:31:51.938174] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-11-03T18:31:51.938094] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:31:52.406110] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T18:31:52.421316] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-11-03T18:31:52.734860] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-11-03T18:31:53.534871] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-11-03T18:31:53.967920] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T18:31:54.335579] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-11-03T18:31:54.341148] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-11-03T18:31:55.134855] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-11-03T18:31:55.496768] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T18:31:55.759147] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-11-03T18:31:55.934853] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-11-03T18:31:56.308165] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T18:31:56.734857] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-11-03T18:31:57.534866] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-11-03T18:31:57.864743] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T18:31:58.334825] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-11-03T18:31:59.035282] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T18:31:59.134850] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-11-03T18:31:59.562326] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:31:59.662820] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T18:31:59.934850] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-11-03T18:32:00.734846] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-11-03T18:32:01.534818] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-11-03T18:32:01.643564] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-11-03T18:32:02.331325] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-11-03T18:32:02.341745] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-11-03T18:32:02.778765] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T18:32:02.930093] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T18:32:03.134849] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-11-03T18:32:03.934863] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-11-03T18:32:04.376057] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T18:32:04.734901] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-11-03T18:32:05.477476] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T18:32:05.534845] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-11. [2025-11-03T18:32:06.029037] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:32:06.334890] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-11-03T18:32:06.833744] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T18:32:06.977007] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-11 (1.44 seconds). [2025-11-03T18:32:06.979119] [INFO ] [REMOTE ] DUK: Full fetch complete (77553 records). [2025-11-03T18:32:06.979358] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-11-03T18:32:07.144771] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-11-03T18:32:07.410673] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-11-03T18:32:07.410793] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-11-03T18:32:07.412209] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-11-03T18:32:07.412280] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-11-03T18:32:07.414329] [DEBUG] [LOCAL ] DUK: Trimmed 77553 records to 53416 (keeping 200 days of data) [2025-11-03T18:32:07.793342] [DEBUG] [LOCAL ] DUK: Primary data saved (53416 records). [2025-11-03T18:32:07.793548] [INFO ] [MAIN ] DUK: Full history saved. [2025-11-03T18:32:07.794744] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DUK took 39.0s. Estimated remaining: 3h 55m 59s. Rate: 7.2 symbols/min [2025-11-03T18:32:07.940059] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-11-03T18:32:07.976622] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:07.976920] [DEBUG] [LOCAL ] DVN: No existing data file found in primary storage. [2025-11-03T18:32:07.976999] [WARN ] [MAIN ] DVN: No existing data found, performing full refresh instead. [2025-11-03T18:32:07.977127] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-11-03T18:32:07.977172] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-11-03T18:32:07.977246] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-11-03T18:32:07.977300] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-11-03T18:32:08.353044] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:08.571932] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-11-03T18:32:08.734860] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-11-03T18:32:09.209707] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T18:32:09.534959] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-11-03T18:32:09.889822] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T18:32:09.938802] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T18:32:10.334872] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-11-03T18:32:11.134867] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-11-03T18:32:11.501003] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T18:32:11.934862] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-11-03T18:32:12.248274] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T18:32:12.734861] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-11-03T18:32:13.534867] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-11-03T18:32:13.702410] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-11-03T18:32:13.820395] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T18:32:13.934889] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T18:32:14.334865] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-11-03T18:32:15.134916] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-11-03T18:32:15.848537] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:32:15.934933] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-11. [2025-11-03T18:32:16.531320] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T18:32:16.734861] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-11-03T18:32:16.888532] [DEBUG] [REMOTE ] DV: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:32:16.888834] [WARN ] [REMOTE ] DV: No data returned for month 2025-11 [2025-11-03T18:32:16.888925] [FATAL] [REMOTE ] DV: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:32:16.889040] [FATAL] [MAIN ] DV: Failed to fetch primary data. [2025-11-03T18:32:16.889120] [WARN ] [MAIN ] DV: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:32:16.889202] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-11-03T18:32:16.889282] [DEBUG] [LOCAL ] DV: No primary data file found to delete. [2025-11-03T18:32:16.889331] [INFO ] [LOCAL ] DV: Starting deletion of derivative data. [2025-11-03T18:32:16.889528] [DEBUG] [LOCAL ] DV: Deleted derivative data file. [2025-11-03T18:32:16.889625] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DV took 34.3s. Estimated remaining: 3h 55m 53s. Rate: 7.2 symbols/min [2025-11-03T18:32:17.059131] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:17.059333] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-11-03T18:32:17.059371] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-11-03T18:32:17.059480] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-11-03T18:32:17.059551] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-11-03T18:32:17.059613] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-11-03T18:32:17.059692] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-11-03T18:32:17.436244] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:17.534870] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-11-03T18:32:18.024928] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:32:18.334867] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-11-03T18:32:19.073250] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T18:32:19.134916] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-11-03T18:32:19.934840] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-11. [2025-11-03T18:32:20.038121] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-11-03T18:32:20.597263] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T18:32:20.734887] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-11. [2025-11-03T18:32:20.874870] [DEBUG] [REMOTE ] DVA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:32:20.875152] [WARN ] [REMOTE ] DVA: No data returned for month 2025-11 [2025-11-03T18:32:20.875244] [FATAL] [REMOTE ] DVA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:32:20.875361] [FATAL] [MAIN ] DVA: Failed to fetch primary data. [2025-11-03T18:32:20.875439] [WARN ] [MAIN ] DVA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:32:20.875528] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-11-03T18:32:20.875607] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-11-03T18:32:20.875691] [INFO ] [LOCAL ] DVA: Starting deletion of derivative data. [2025-11-03T18:32:20.875769] [DEBUG] [LOCAL ] DVA: No derivative data file found to delete. [2025-11-03T18:32:20.875831] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DVA took 29.5s. Estimated remaining: 3h 55m 34s. Rate: 7.2 symbols/min [2025-11-03T18:32:21.042779] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:21.042932] [DEBUG] [LOCAL ] DXC: No existing data file found in primary storage. [2025-11-03T18:32:21.042970] [WARN ] [MAIN ] DXC: No existing data found, performing full refresh instead. [2025-11-03T18:32:21.043079] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-11-03T18:32:21.043143] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-11-03T18:32:21.043212] [DEBUG] [LOCAL ] DXC: No primary data file found to delete. [2025-11-03T18:32:21.043257] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-11-03T18:32:21.389362] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:21.534819] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-11-03T18:32:21.556967] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T18:32:21.557739] [INFO ] [REMOTE ] DUKB: Full fetch complete (8881 records). [2025-11-03T18:32:21.557811] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-11-03T18:32:21.909573] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-11-03T18:32:21.909669] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-11-03T18:32:21.909906] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-11-03T18:32:21.909945] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-11-03T18:32:21.910337] [DEBUG] [LOCAL ] DUKB: Trimmed 8881 records to 5898 (keeping 200 days of data) [2025-11-03T18:32:21.944877] [DEBUG] [LOCAL ] DUKB: Primary data saved (5898 records). [2025-11-03T18:32:21.944973] [INFO ] [MAIN ] DUKB: Full history saved. [2025-11-03T18:32:21.945039] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DUKB took 42.0s. Estimated remaining: 3h 55m 7s. Rate: 7.2 symbols/min [2025-11-03T18:32:22.108895] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:22.109048] [DEBUG] [LOCAL ] DXYZ: No existing data file found in primary storage. [2025-11-03T18:32:22.109084] [WARN ] [MAIN ] DXYZ: No existing data found, performing full refresh instead. [2025-11-03T18:32:22.109191] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-11-03T18:32:22.109231] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-11-03T18:32:22.109274] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-11-03T18:32:22.109305] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-11-03T18:32:22.341036] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-11-03T18:32:22.454498] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:22.675388] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T18:32:23.134858] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-11-03T18:32:23.934833] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-11-03T18:32:23.989705] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-11-03T18:32:24.734937] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-11-03T18:32:24.970197] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T18:32:25.012231] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-11-03T18:32:25.534837] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-11-03T18:32:26.334916] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-11-03T18:32:26.382307] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-11-03T18:32:26.670238] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T18:32:27.134848] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-11-03T18:32:27.534075] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-11-03T18:32:27.934879] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-11-03T18:32:28.734861] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-11-03T18:32:28.999128] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-11-03T18:32:29.067593] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T18:32:29.534878] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-11-03T18:32:30.335056] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-11-03T18:32:30.582553] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-11-03T18:32:31.134932] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-11-03T18:32:31.408085] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-11-03T18:32:31.934933] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-11-03T18:32:32.081880] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-11-03T18:32:32.293216] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T18:32:32.734894] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-11-03T18:32:33.370463] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T18:32:33.534864] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-11-03T18:32:34.340671] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-11-03T18:32:34.356183] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-11-03T18:32:34.822411] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T18:32:35.134862] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-11-03T18:32:35.939961] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-11-03T18:32:35.968991] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T18:32:36.731287] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-11-03T18:32:36.741551] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-11-03T18:32:37.534874] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-11-03T18:32:37.628883] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-11-03T18:32:37.989774] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T18:32:38.334903] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-11-03T18:32:39.134830] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-11-03T18:32:39.179560] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T18:32:39.530806] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T18:32:39.934873] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-11. [2025-11-03T18:32:40.191694] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T18:32:40.734873] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-11-03T18:32:41.261793] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-11 (1.33 seconds). [2025-11-03T18:32:41.263595] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-11-03T18:32:41.263741] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-11-03T18:32:41.540098] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-11-03T18:32:41.653537] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-11-03T18:32:41.653662] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-11-03T18:32:41.654620] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-11-03T18:32:41.654703] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-11-03T18:32:41.656172] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 53699 (keeping 200 days of data) [2025-11-03T18:32:41.974975] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-11-03T18:32:41.975097] [INFO ] [MAIN ] DVN: Full history saved. [2025-11-03T18:32:41.975165] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DVN took 34.2s. Estimated remaining: 3h 55m 28s. Rate: 7.2 symbols/min [2025-11-03T18:32:42.142914] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:42.167883] [DEBUG] [LOCAL ] DY: Loaded 27877 existing records from primary storage. [2025-11-03T18:32:42.168144] [INFO ] [MAIN ] DY: Loaded 27877 existing records. [2025-11-03T18:32:42.346109] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-11-03T18:32:42.349867] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:32:42.351163] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-11-03T18:32:42.351330] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-11-03T18:32:42.351971] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-11-03T18:32:42.352037] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-11-03T18:32:42.542117] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-11-03T18:32:42.765886] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:42.797481] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:32:43.134856] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-11-03T18:32:43.854262] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T18:32:43.934914] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-11-03T18:32:44.560340] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T18:32:44.734889] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-11-03T18:32:45.145065] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T18:32:45.534874] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-11-03T18:32:46.335013] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-11-03T18:32:46.370275] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-11-03T18:32:47.065423] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T18:32:47.134877] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-11-03T18:32:47.423920] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T18:32:47.934931] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-11-03T18:32:48.737602] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-11. [2025-11-03T18:32:48.744732] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-11-03T18:32:49.534863] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-11. [2025-11-03T18:32:49.779873] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-11-03T18:32:50.334925] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-11-03T18:32:50.604116] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-11 (1.87 seconds). [2025-11-03T18:32:50.605817] [INFO ] [REMOTE ] DXC: Full fetch complete (70720 records). [2025-11-03T18:32:50.605922] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-11-03T18:32:51.035869] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-11-03T18:32:51.035960] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-11-03T18:32:51.036867] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-11-03T18:32:51.036953] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-11-03T18:32:51.038428] [DEBUG] [LOCAL ] DXC: Trimmed 70720 records to 49895 (keeping 200 days of data) [2025-11-03T18:32:51.144915] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-11-03T18:32:51.337565] [DEBUG] [LOCAL ] DXC: Primary data saved (49895 records). [2025-11-03T18:32:51.337824] [INFO ] [MAIN ] DXC: Full history saved. [2025-11-03T18:32:51.337913] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DXC took 30.5s. Estimated remaining: 3h 55m 23s. Rate: 7.2 symbols/min [2025-11-03T18:32:51.521207] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:51.545140] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T18:32:51.585803] [DEBUG] [LOCAL ] E: Loaded 33048 existing records from primary storage. [2025-11-03T18:32:51.586181] [INFO ] [MAIN ] E: Loaded 33048 existing records. [2025-11-03T18:32:51.781758] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:32:51.782922] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-11-03T18:32:51.782974] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-11-03T18:32:51.783594] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-11-03T18:32:51.783681] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-11-03T18:32:51.891878] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-11 (2.36 seconds). [2025-11-03T18:32:51.900198] [INFO ] [REMOTE ] DX: Full fetch complete (75977 records). [2025-11-03T18:32:51.916316] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-11-03T18:32:51.934819] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-11-03T18:32:52.421406] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:52.582424] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-11-03T18:32:52.582527] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-11-03T18:32:52.583405] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-11-03T18:32:52.583487] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-11-03T18:32:52.585204] [DEBUG] [LOCAL ] DX: Trimmed 75977 records to 52476 (keeping 200 days of data) [2025-11-03T18:32:52.607772] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T18:32:52.735162] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-11-03T18:32:52.954149] [DEBUG] [LOCAL ] DX: Primary data saved (52476 records). [2025-11-03T18:32:52.954295] [INFO ] [MAIN ] DX: Full history saved. [2025-11-03T18:32:52.954387] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DX took 36.1s. Estimated remaining: 3h 54m 58s. Rate: 7.2 symbols/min [2025-11-03T18:32:53.141477] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:32:53.169537] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:32:53.208297] [DEBUG] [LOCAL ] EAF: Loaded 40801 existing records from primary storage. [2025-11-03T18:32:53.208625] [INFO ] [MAIN ] EAF: Loaded 40801 existing records. [2025-11-03T18:32:53.388627] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:32:53.388863] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-11-03T18:32:53.388911] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-11-03T18:32:53.389536] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-11-03T18:32:53.389594] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-11-03T18:32:53.541319] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-11-03T18:32:53.787627] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:32:54.165232] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-11-03T18:32:54.334909] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-11-03T18:32:54.903811] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:32:55.134857] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-11-03T18:32:55.934877] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-11-03T18:32:56.130736] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-11-03T18:32:56.161873] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T18:32:56.734868] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-11-03T18:32:56.991047] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T18:32:57.534899] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-11-03T18:32:58.105294] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T18:32:58.334895] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-11-03T18:32:58.617110] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T18:32:59.134851] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-11-03T18:32:59.490729] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T18:32:59.923943] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T18:32:59.934805] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-11-03T18:33:00.734861] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-11-03T18:33:00.813141] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-11-03T18:33:01.534905] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-11-03T18:33:02.206340] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T18:33:02.334894] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-11. [2025-11-03T18:33:02.850945] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T18:33:03.134908] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-11-03T18:33:03.709197] [DEBUG] [REMOTE ] DXYZ: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:33:03.709731] [WARN ] [REMOTE ] DXYZ: No data returned for month 2025-11 [2025-11-03T18:33:03.709831] [FATAL] [REMOTE ] DXYZ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:33:03.709930] [FATAL] [MAIN ] DXYZ: Failed to fetch primary data. [2025-11-03T18:33:03.709997] [WARN ] [MAIN ] DXYZ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:33:03.710072] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-11-03T18:33:03.710146] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-11-03T18:33:03.710185] [INFO ] [LOCAL ] DXYZ: Starting deletion of derivative data. [2025-11-03T18:33:03.710225] [DEBUG] [LOCAL ] DXYZ: No derivative data file found to delete. [2025-11-03T18:33:03.710280] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXYZ took 41.8s. Estimated remaining: 3h 54m 55s. Rate: 7.2 symbols/min [2025-11-03T18:33:03.923851] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:33:03.931287] [DEBUG] [LOCAL ] EAI: Loaded 3835 existing records from primary storage. [2025-11-03T18:33:03.931598] [INFO ] [MAIN ] EAI: Loaded 3835 existing records. [2025-11-03T18:33:03.944203] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-11-03T18:33:04.145465] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:33:04.145835] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-11-03T18:33:04.145938] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-11-03T18:33:04.146211] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-11-03T18:33:04.146282] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-11-03T18:33:04.541880] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:33:04.569279] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T18:33:04.734822] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-11-03T18:33:04.905584] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T18:33:05.534906] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-11-03T18:33:06.019026] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T18:33:06.334946] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-11-03T18:33:06.797840] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T18:33:07.134875] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-11-03T18:33:07.240580] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:33:07.601550] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-11-03T18:33:07.934878] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-11-03T18:33:08.734898] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-11-03T18:33:09.139033] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T18:33:09.334410] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T18:33:09.534891] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-11-03T18:33:10.334871] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-11-03T18:33:10.578069] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T18:33:10.650584] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-11-03T18:33:11.134877] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-11-03T18:33:11.934885] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-11-03T18:33:12.053534] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T18:33:12.734880] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-11-03T18:33:12.998044] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T18:33:13.154527] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-11-03T18:33:13.534885] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-11-03T18:33:13.989372] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-11-03T18:33:14.334903] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-11-03T18:33:14.746179] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T18:33:15.134893] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-11-03T18:33:15.934888] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-11-03T18:33:16.429880] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T18:33:16.734853] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-11-03T18:33:17.079314] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T18:33:17.078510] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-11-03T18:33:17.534917] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-11-03T18:33:17.986765] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T18:33:18.334867] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-11-03T18:33:18.730462] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T18:33:19.134870] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-11-03T18:33:19.934849] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-11-03T18:33:20.059419] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T18:33:20.734924] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-11. [2025-11-03T18:33:21.131297] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T18:33:21.534882] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-11-03T18:33:21.824553] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T18:33:22.231903] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-11 (1.50 seconds). [2025-11-03T18:33:22.233175] [INFO ] [REMOTE ] DY: Full fetch complete (43227 records). [2025-11-03T18:33:22.233255] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-11-03T18:33:22.339820] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-11. [2025-11-03T18:33:22.617576] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-11-03T18:33:22.617687] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-11-03T18:33:22.618407] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-11-03T18:33:22.618449] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-11-03T18:33:22.619459] [DEBUG] [LOCAL ] DY: Trimmed 43227 records to 27496 (keeping 200 days of data) [2025-11-03T18:33:22.782847] [DEBUG] [LOCAL ] DY: Primary data saved (27496 records). [2025-11-03T18:33:22.782995] [INFO ] [MAIN ] DY: Full history saved. [2025-11-03T18:33:22.783107] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. DY took 40.8s. Estimated remaining: 3h 55m 14s. Rate: 7.2 symbols/min [2025-11-03T18:33:22.952503] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:33:22.980075] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T18:33:22.979975] [DEBUG] [LOCAL ] EARN: Loaded 27446 existing records from primary storage. [2025-11-03T18:33:22.980874] [INFO ] [REMOTE ] EAI: Full fetch complete (5690 records). [2025-11-03T18:33:22.981082] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-11-03T18:33:22.981218] [INFO ] [MAIN ] EARN: Loaded 27446 existing records. [2025-11-03T18:33:23.140056] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-11-03T18:33:23.378008] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:33:23.452352] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-11-03T18:33:23.468793] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-11-03T18:33:23.477112] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-11-03T18:33:23.479759] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-11-03T18:33:23.690413] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-11-03T18:33:23.690933] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-11-03T18:33:23.696861] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-11-03T18:33:23.707280] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-11-03T18:33:23.737998] [DEBUG] [LOCAL ] EAI: Trimmed 5690 records to 3812 (keeping 200 days of data) [2025-11-03T18:33:23.868693] [DEBUG] [LOCAL ] EAI: Primary data saved (3812 records). [2025-11-03T18:33:23.909407] [INFO ] [MAIN ] EAI: Full history saved. [2025-11-03T18:33:23.921948] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. EAI took 20.2s. Estimated remaining: 3h 54m 48s. Rate: 7.2 symbols/min [2025-11-03T18:33:23.949467] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-11-03T18:33:24.126430] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:33:24.199864] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:33:24.222889] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T18:33:24.275302] [DEBUG] [LOCAL ] EAT: Loaded 50464 existing records from primary storage. [2025-11-03T18:33:24.275635] [INFO ] [MAIN ] EAT: Loaded 50464 existing records. [2025-11-03T18:33:24.450857] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:33:24.451126] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-11-03T18:33:24.451175] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-11-03T18:33:24.451977] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-11-03T18:33:24.452037] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-11-03T18:33:24.740114] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-11-03T18:33:24.814364] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:33:24.948694] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-11-03T18:33:25.534858] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-11-03T18:33:25.783184] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-11-03T18:33:26.334852] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-11-03T18:33:26.911099] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T18:33:27.134867] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-11-03T18:33:27.313164] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T18:33:27.934871] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-11. [2025-11-03T18:33:28.472792] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T18:33:28.661162] [DEBUG] [REMOTE ] EAF: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:33:28.661540] [WARN ] [REMOTE ] EAF: No data returned for month 2025-11 [2025-11-03T18:33:28.661633] [FATAL] [REMOTE ] EAF: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:33:28.661781] [FATAL] [MAIN ] EAF: Failed to fetch primary data. [2025-11-03T18:33:28.661853] [WARN ] [MAIN ] EAF: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:33:28.661965] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-11-03T18:33:28.662061] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-11-03T18:33:28.662112] [INFO ] [LOCAL ] EAF: Starting deletion of derivative data. [2025-11-03T18:33:28.662349] [DEBUG] [LOCAL ] EAF: Deleted derivative data file. [2025-11-03T18:33:28.662451] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. EAF took 35.7s. Estimated remaining: 3h 54m 30s. Rate: 7.2 symbols/min [2025-11-03T18:33:28.741878] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-11-03T18:33:28.853637] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:33:28.853828] [DEBUG] [LOCAL ] EB: No existing data file found in primary storage. [2025-11-03T18:33:28.853868] [WARN ] [MAIN ] EB: No existing data found, performing full refresh instead. [2025-11-03T18:33:28.853982] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-11-03T18:33:28.854025] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-11-03T18:33:28.854067] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-11-03T18:33:28.854099] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-11-03T18:33:29.206099] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:33:29.534887] [INFO ] [REMOTE ] E: Fetching primary data for 2025-11. [2025-11-03T18:33:30.149933] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T18:33:30.334861] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-11-03T18:33:31.134854] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-11-03T18:33:31.386886] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-11 (1.85 seconds). [2025-11-03T18:33:31.388154] [INFO ] [REMOTE ] E: Full fetch complete (47480 records). [2025-11-03T18:33:31.388241] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-11-03T18:33:31.778514] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-11-03T18:33:31.778627] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-11-03T18:33:31.779385] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-11-03T18:33:31.779465] [DEBUG] [LOCAL ] E: Saving primary data. [2025-11-03T18:33:31.780725] [DEBUG] [LOCAL ] E: Trimmed 47480 records to 32350 (keeping 200 days of data) [2025-11-03T18:33:31.897088] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T18:33:31.938060] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-11-03T18:33:32.013633] [DEBUG] [LOCAL ] E: Primary data saved (32350 records). [2025-11-03T18:33:32.013783] [INFO ] [MAIN ] E: Full history saved. [2025-11-03T18:33:32.014516] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. E took 40.7s. Estimated remaining: 3h 54m 10s. Rate: 7.2 symbols/min [2025-11-03T18:33:32.182570] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:33:32.202101] [DEBUG] [LOCAL ] EBF: Loaded 19668 existing records from primary storage. [2025-11-03T18:33:32.202328] [INFO ] [MAIN ] EBF: Loaded 19668 existing records. [2025-11-03T18:33:32.381799] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:33:32.382231] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-11-03T18:33:32.382335] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-11-03T18:33:32.382894] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-11-03T18:33:32.382966] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-11-03T18:33:32.739591] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-11-03T18:33:32.734364] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-11-03T18:33:32.787276] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:33:32.969617] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T18:33:33.534844] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-11-03T18:33:33.732613] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T18:33:34.334873] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-11-03T18:33:34.878516] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T18:33:35.134899] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-11-03T18:33:35.478802] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T18:33:35.934917] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-11-03T18:33:36.734894] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-11-03T18:33:36.800104] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-11-03T18:33:37.073121] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T18:33:37.534858] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-11-03T18:33:37.771877] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T18:33:38.334966] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-11-03T18:33:38.441697] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T18:33:39.134930] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-11-03T18:33:39.363750] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T18:33:39.934857] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-11-03T18:33:40.238858] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T18:33:40.654343] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T18:33:40.734822] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-11-03T18:33:41.498563] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T18:33:41.534847] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-11-03T18:33:42.336671] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-11-03T18:33:42.340178] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-11-03T18:33:43.134821] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-11-03T18:33:43.175634] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T18:33:43.832864] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T18:33:43.934932] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-11-03T18:33:44.734878] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-11-03T18:33:45.062409] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T18:33:45.534868] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-11-03T18:33:45.776142] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T18:33:46.334914] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-11-03T18:33:46.748277] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T18:33:47.134849] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-11-03T18:33:47.216137] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T18:33:47.934875] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-11-03T18:33:48.182134] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T18:33:48.726418] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:33:48.734805] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-11-03T18:33:49.535027] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-11-03T18:33:49.658105] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T18:33:50.334871] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-11-03T18:33:50.456621] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T18:33:51.134850] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-11-03T18:33:51.254688] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T18:33:51.874310] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T18:33:51.934854] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-11-03T18:33:52.700348] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-11-03T18:33:52.734823] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-11-03T18:33:53.534914] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-11-03T18:33:53.849726] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-11-03T18:33:54.334928] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-11. [2025-11-03T18:33:54.810533] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T18:33:55.134873] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-11-03T18:33:55.637780] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T18:33:55.638915] [INFO ] [REMOTE ] EBF: Full fetch complete (28853 records). [2025-11-03T18:33:55.638988] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-11-03T18:33:55.939978] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-11-03T18:33:56.013888] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-11-03T18:33:56.013969] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-11-03T18:33:56.014462] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-11-03T18:33:56.014502] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-11-03T18:33:56.015367] [DEBUG] [LOCAL ] EBF: Trimmed 28853 records to 19535 (keeping 200 days of data) [2025-11-03T18:33:56.130314] [DEBUG] [LOCAL ] EBF: Primary data saved (19535 records). [2025-11-03T18:33:56.130451] [INFO ] [MAIN ] EBF: Full history saved. [2025-11-03T18:33:56.130528] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. EBF took 24.1s. Estimated remaining: 3h 54m 41s. Rate: 7.2 symbols/min [2025-11-03T18:33:56.300313] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:33:56.337208] [DEBUG] [LOCAL ] EBR: Loaded 43814 existing records from primary storage. [2025-11-03T18:33:56.337521] [INFO ] [MAIN ] EBR: Loaded 43814 existing records. [2025-11-03T18:33:56.525967] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:33:56.526533] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-11-03T18:33:56.526611] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-11-03T18:33:56.527403] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-11-03T18:33:56.527463] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-11-03T18:33:56.742234] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-11-03T18:33:56.867000] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-11-03T18:33:56.956444] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:33:57.250224] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T18:33:57.534856] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-11-03T18:33:57.955712] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T18:33:58.334902] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-11. [2025-11-03T18:33:59.134945] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-11-03T18:33:59.183499] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-11-03T18:33:59.624323] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-11 (1.29 seconds). [2025-11-03T18:33:59.625486] [INFO ] [REMOTE ] EARN: Full fetch complete (44872 records). [2025-11-03T18:33:59.625561] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-11-03T18:33:59.939999] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-11-03T18:34:00.030529] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-11-03T18:34:00.030604] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-11-03T18:34:00.031225] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-11-03T18:34:00.031288] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-11-03T18:34:00.032256] [DEBUG] [LOCAL ] EARN: Trimmed 44872 records to 26878 (keeping 200 days of data) [2025-11-03T18:34:00.185480] [DEBUG] [LOCAL ] EARN: Primary data saved (26878 records). [2025-11-03T18:34:00.185612] [INFO ] [MAIN ] EARN: Full history saved. [2025-11-03T18:34:00.185721] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EARN took 37.4s. Estimated remaining: 3h 54m 22s. Rate: 7.2 symbols/min [2025-11-03T18:34:00.700742] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T18:34:00.734849] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-11-03T18:34:01.010436] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T18:34:01.534901] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-11-03T18:34:02.153026] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T18:34:02.334822] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-11-03T18:34:02.881467] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T18:34:03.134871] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-11. [2025-11-03T18:34:03.645785] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:34:03.934861] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-11-03T18:34:04.017280] [DEBUG] [REMOTE ] EB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:34:04.017538] [WARN ] [REMOTE ] EB: No data returned for month 2025-11 [2025-11-03T18:34:04.017625] [FATAL] [REMOTE ] EB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:34:04.017749] [FATAL] [MAIN ] EB: Failed to fetch primary data. [2025-11-03T18:34:04.017794] [WARN ] [MAIN ] EB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:34:04.017861] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-11-03T18:34:04.017920] [DEBUG] [LOCAL ] EB: No primary data file found to delete. [2025-11-03T18:34:04.017955] [INFO ] [LOCAL ] EB: Starting deletion of derivative data. [2025-11-03T18:34:04.017993] [DEBUG] [LOCAL ] EB: No derivative data file found to delete. [2025-11-03T18:34:04.018038] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EB took 35.4s. Estimated remaining: 3h 54m 2s. Rate: 7.2 symbols/min [2025-11-03T18:34:04.734981] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-11-03T18:34:05.136968] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:34:05.534894] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-11-03T18:34:06.432133] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T18:34:06.444095] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-11. [2025-11-03T18:34:06.689097] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T18:34:07.134886] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-11-03T18:34:08.354178] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T18:34:08.367323] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-11-03T18:34:08.402911] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-11 (1.96 seconds). [2025-11-03T18:34:08.404357] [INFO ] [REMOTE ] EAT: Full fetch complete (72605 records). [2025-11-03T18:34:08.404471] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-11-03T18:34:08.816514] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-11-03T18:34:08.816591] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-11-03T18:34:08.817489] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-11-03T18:34:08.817552] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-11-03T18:34:08.819007] [DEBUG] [LOCAL ] EAT: Trimmed 72605 records to 49723 (keeping 200 days of data) [2025-11-03T18:34:09.109540] [DEBUG] [LOCAL ] EAT: Primary data saved (49723 records). [2025-11-03T18:34:09.109689] [INFO ] [MAIN ] EAT: Full history saved. [2025-11-03T18:34:09.109778] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EAT took 45.2s. Estimated remaining: 3h 53m 46s. Rate: 7.2 symbols/min [2025-11-03T18:34:09.645928] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T18:34:09.656555] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-11-03T18:34:11.008215] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T18:34:11.019164] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-11-03T18:34:12.277783] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:34:12.287902] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-11-03T18:34:13.718624] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T18:34:13.729299] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-11. [2025-11-03T18:34:15.665017] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-11 (1.94 seconds). [2025-11-03T18:34:15.666436] [INFO ] [REMOTE ] EBR: Full fetch complete (62413 records). [2025-11-03T18:34:15.666546] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-11-03T18:34:16.045670] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-11-03T18:34:16.045761] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-11-03T18:34:16.046505] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-11-03T18:34:16.046546] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-11-03T18:34:16.047854] [DEBUG] [LOCAL ] EBR: Trimmed 62413 records to 43152 (keeping 200 days of data) [2025-11-03T18:34:16.286928] [DEBUG] [LOCAL ] EBR: Primary data saved (43152 records). [2025-11-03T18:34:16.287101] [INFO ] [MAIN ] EBR: Full history saved. [2025-11-03T18:34:16.288062] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EBR took 20.2s. Estimated remaining: 3h 53m 35s. Rate: 7.2 symbols/min [2025-11-03T18:34:16.879543] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:16.880773] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:16.931218] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:16.999690] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:17.046759] [DEBUG] [LOCAL ] ECAT: Loaded 29347 existing records from primary storage. [2025-11-03T18:34:17.047341] [INFO ] [MAIN ] ECAT: Loaded 29347 existing records. [2025-11-03T18:34:17.186867] [DEBUG] [LOCAL ] ECC: Loaded 43589 existing records from primary storage. [2025-11-03T18:34:17.198707] [INFO ] [MAIN ] ECC: Loaded 43589 existing records. [2025-11-03T18:34:17.198315] [DEBUG] [LOCAL ] EBS: Loaded 47249 existing records from primary storage. [2025-11-03T18:34:17.249263] [INFO ] [MAIN ] EBS: Loaded 47249 existing records. [2025-11-03T18:34:17.414882] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:34:17.415100] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-11-03T18:34:17.415144] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-11-03T18:34:17.422100] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-11-03T18:34:17.461321] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-11-03T18:34:17.461179] [DEBUG] [LOCAL ] EC: Loaded 49387 existing records from primary storage. [2025-11-03T18:34:17.530261] [INFO ] [MAIN ] EC: Loaded 49387 existing records. [2025-11-03T18:34:17.826632] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:34:17.840924] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:34:17.855195] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-11-03T18:34:17.920747] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-11-03T18:34:17.879526] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-11-03T18:34:17.946882] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-11-03T18:34:17.969729] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-11-03T18:34:17.979466] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-11-03T18:34:18.000372] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-11-03T18:34:18.082104] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-11-03T18:34:18.222612] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:34:18.329139] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-11-03T18:34:18.385756] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-11-03T18:34:18.553993] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:18.612539] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-11-03T18:34:18.619449] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-11-03T18:34:18.649097] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-11-03T18:34:18.992581] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:19.062440] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-11-03T18:34:19.176636] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:19.188570] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-11-03T18:34:19.284436] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:19.284766] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-11-03T18:34:19.956896] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T18:34:19.963104] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-11-03T18:34:20.559976] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-11-03T18:34:20.569247] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-11-03T18:34:20.647257] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T18:34:20.655015] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-11-03T18:34:20.915468] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T18:34:20.921881] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-11-03T18:34:20.951702] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-11-03T18:34:20.961604] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-11-03T18:34:21.670992] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T18:34:21.678840] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-11-03T18:34:21.724215] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T18:34:21.733114] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-11-03T18:34:22.044241] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:34:22.051374] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-11-03T18:34:22.170861] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T18:34:22.180548] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-11-03T18:34:22.798672] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:34:22.808229] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-11-03T18:34:23.007285] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T18:34:23.086895] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T18:34:23.134872] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-11-03T18:34:23.675873] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T18:34:23.934869] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-11-03T18:34:24.187326] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T18:34:24.395964] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T18:34:24.734904] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-11-03T18:34:24.829209] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T18:34:25.534935] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-11-03T18:34:25.965024] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T18:34:26.334940] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-11-03T18:34:27.140802] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-11-03T18:34:27.160943] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-11-03T18:34:27.590665] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T18:34:27.934941] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-11-03T18:34:28.322826] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:34:28.734862] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-11-03T18:34:29.136185] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T18:34:29.534829] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-11-03T18:34:30.229940] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T18:34:30.334862] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-11-03T18:34:31.012412] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T18:34:31.134834] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-11-03T18:34:31.285826] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T18:34:31.934854] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-11-03T18:34:32.607882] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T18:34:32.734849] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-11-03T18:34:33.308398] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T18:34:33.534845] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-11-03T18:34:33.885287] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:34:34.334852] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-11-03T18:34:34.788470] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T18:34:35.134871] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-11-03T18:34:35.295460] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-11-03T18:34:35.934857] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-11-03T18:34:36.333432] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T18:34:36.734894] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-11-03T18:34:37.140316] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T18:34:37.534860] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-11-03T18:34:38.174572] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T18:34:38.334895] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-11-03T18:34:38.844595] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T18:34:39.134870] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-11-03T18:34:39.625953] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:34:39.934909] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-11. [2025-11-03T18:34:40.293551] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:34:40.734864] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-11-03T18:34:41.534915] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-11-03T18:34:41.896888] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-11 (1.96 seconds). [2025-11-03T18:34:41.898674] [INFO ] [REMOTE ] ECC: Full fetch complete (61768 records). [2025-11-03T18:34:41.898789] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-11-03T18:34:42.333940] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-11-03T18:34:42.334094] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-11-03T18:34:42.335538] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-11-03T18:34:42.335965] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-11-03T18:34:42.335691] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-11-03T18:34:42.339675] [DEBUG] [LOCAL ] ECC: Trimmed 61768 records to 42872 (keeping 200 days of data) [2025-11-03T18:34:42.470683] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-11-03T18:34:42.696856] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T18:34:42.697885] [DEBUG] [LOCAL ] ECC: Primary data saved (42872 records). [2025-11-03T18:34:42.705155] [INFO ] [MAIN ] ECC: Full history saved. [2025-11-03T18:34:42.706469] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. ECC took 26.4s. Estimated remaining: 3h 54m 11s. Rate: 7.2 symbols/min [2025-11-03T18:34:42.889465] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:42.889818] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-11-03T18:34:42.889881] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-11-03T18:34:42.890017] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-11-03T18:34:42.890065] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-11-03T18:34:42.890110] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-11-03T18:34:42.890153] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-11-03T18:34:43.140071] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-11-03T18:34:43.291516] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:43.786562] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T18:34:43.934863] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-11-03T18:34:44.161370] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T18:34:44.440467] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T18:34:44.734889] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-11-03T18:34:45.534858] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-11. [2025-11-03T18:34:45.700127] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T18:34:46.334875] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-11. [2025-11-03T18:34:47.134912] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-11. [2025-11-03T18:34:47.166547] [DEBUG] [REMOTE ] ECAT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:34:47.167001] [WARN ] [REMOTE ] ECAT: No data returned for month 2025-11 [2025-11-03T18:34:47.167102] [FATAL] [REMOTE ] ECAT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:34:47.167197] [FATAL] [MAIN ] ECAT: Failed to fetch primary data. [2025-11-03T18:34:47.167405] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:34:47.167484] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-11-03T18:34:47.167557] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-11-03T18:34:47.167595] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-11-03T18:34:47.167795] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-11-03T18:34:47.167894] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. ECAT took 30.9s. Estimated remaining: 3h 53m 53s. Rate: 7.2 symbols/min [2025-11-03T18:34:47.354576] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:47.358709] [DEBUG] [LOCAL ] ECCU: Loaded 2087 existing records from primary storage. [2025-11-03T18:34:47.358876] [INFO ] [MAIN ] ECCU: Loaded 2087 existing records. [2025-11-03T18:34:47.548385] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:34:47.548725] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-11-03T18:34:47.548788] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-11-03T18:34:47.548973] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-11-03T18:34:47.549015] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-11-03T18:34:47.665925] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-11 (2.13 seconds). [2025-11-03T18:34:47.686395] [INFO ] [REMOTE ] EBS: Full fetch complete (67560 records). [2025-11-03T18:34:47.707277] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-11-03T18:34:47.942720] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-11-03T18:34:48.267839] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:48.264831] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T18:34:48.379034] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-11-03T18:34:48.379117] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-11-03T18:34:48.379940] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-11-03T18:34:48.380003] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-11-03T18:34:48.381319] [DEBUG] [LOCAL ] EBS: Trimmed 67560 records to 46638 (keeping 200 days of data) [2025-11-03T18:34:48.634418] [DEBUG] [LOCAL ] EBS: Primary data saved (46638 records). [2025-11-03T18:34:48.634546] [INFO ] [MAIN ] EBS: Full history saved. [2025-11-03T18:34:48.635497] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EBS took 32.3s. Estimated remaining: 3h 53m 28s. Rate: 7.2 symbols/min [2025-11-03T18:34:48.735527] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-11-03T18:34:48.808725] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:48.808877] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-11-03T18:34:48.808914] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-11-03T18:34:48.809019] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-11-03T18:34:48.809081] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-11-03T18:34:48.809125] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-11-03T18:34:48.809157] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-11-03T18:34:48.995757] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-11 (1.86 seconds). [2025-11-03T18:34:49.061630] [INFO ] [REMOTE ] EC: Full fetch complete (71707 records). [2025-11-03T18:34:49.075583] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-11-03T18:34:49.087091] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-11-03T18:34:49.288371] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:49.540774] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-11-03T18:34:49.564496] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-11-03T18:34:49.564577] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-11-03T18:34:49.565418] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-11-03T18:34:49.565481] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-11-03T18:34:49.566839] [DEBUG] [LOCAL ] EC: Trimmed 71707 records to 48591 (keeping 200 days of data) [2025-11-03T18:34:49.868974] [DEBUG] [LOCAL ] EC: Primary data saved (48591 records). [2025-11-03T18:34:49.869106] [INFO ] [MAIN ] EC: Full history saved. [2025-11-03T18:34:49.869184] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EC took 33.6s. Estimated remaining: 3h 53m 2s. Rate: 7.2 symbols/min [2025-11-03T18:34:50.037322] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:34:50.041747] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-11-03T18:34:50.041548] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-11-03T18:34:50.043466] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-11-03T18:34:50.043580] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-11-03T18:34:50.043627] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-11-03T18:34:50.043718] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-11-03T18:34:50.043761] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-11-03T18:34:50.339922] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-11-03T18:34:50.422639] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:34:50.855295] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T18:34:51.134880] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-11-03T18:34:51.359241] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-11-03T18:34:51.934870] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-11-03T18:34:52.277186] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T18:34:52.734892] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-11-03T18:34:52.965164] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-11-03T18:34:53.534869] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-11-03T18:34:53.953950] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T18:34:54.334921] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-11-03T18:34:54.773430] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T18:34:55.134852] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-11-03T18:34:55.377383] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-11-03T18:34:55.934880] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-11-03T18:34:56.236249] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-11-03T18:34:56.734828] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-11-03T18:34:56.935704] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.20 seconds). [2025-11-03T18:34:57.534882] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-11-03T18:34:57.987256] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-11-03T18:34:58.334892] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-11-03T18:34:58.851532] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T18:34:59.134891] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-11-03T18:34:59.461876] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-11-03T18:34:59.934859] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-11-03T18:35:00.187955] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-11-03T18:35:00.734856] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-11-03T18:35:01.163368] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T18:35:01.534913] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-11-03T18:35:01.817962] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-11-03T18:35:02.334874] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-11-03T18:35:02.613089] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-11-03T18:35:03.134899] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-11-03T18:35:03.421688] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-11-03T18:35:03.934900] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-11-03T18:35:04.209112] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-11-03T18:35:04.734893] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-11-03T18:35:05.196708] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-11-03T18:35:05.534862] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-11-03T18:35:05.788402] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-11-03T18:35:06.334869] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-11. [2025-11-03T18:35:06.769194] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-11 (0.43 seconds). [2025-11-03T18:35:06.769937] [INFO ] [REMOTE ] ECCW: Full fetch complete (1419 records). [2025-11-03T18:35:06.770006] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-11-03T18:35:06.944529] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-11-03T18:35:06.944769] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:35:06.944837] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:35:06.944886] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-11-03T18:35:06.944941] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-11-03T18:35:06.944985] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-11-03T18:35:06.945025] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-11-03T18:35:06.945078] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECCW took 18.3s. Estimated remaining: 3h 53m 16s. Rate: 7.2 symbols/min [2025-11-03T18:35:07.109371] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:35:07.139479] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-11-03T18:35:07.140919] [DEBUG] [LOCAL ] ECG: Loaded 32704 existing records from primary storage. [2025-11-03T18:35:07.141127] [INFO ] [MAIN ] ECG: Loaded 32704 existing records. [2025-11-03T18:35:07.317979] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:35:07.318213] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-11-03T18:35:07.318297] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-11-03T18:35:07.318878] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-11-03T18:35:07.318936] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-11-03T18:35:07.502749] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-11-03T18:35:07.738985] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:35:07.934844] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-11-03T18:35:08.734910] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-11-03T18:35:09.080135] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-11-03T18:35:09.101760] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T18:35:09.534916] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-11-03T18:35:09.924444] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T18:35:10.334857] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-11-03T18:35:10.640230] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-11-03T18:35:11.134853] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-11-03T18:35:11.416446] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-11-03T18:35:11.934870] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-11-03T18:35:12.164877] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-11-03T18:35:12.734851] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-11-03T18:35:13.008807] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-11-03T18:35:13.534884] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-11-03T18:35:13.837522] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-11-03T18:35:14.334885] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-11. [2025-11-03T18:35:14.845348] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T18:35:14.846009] [INFO ] [REMOTE ] ECCU: Full fetch complete (3920 records). [2025-11-03T18:35:14.846075] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-11-03T18:35:15.140020] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-11-03T18:35:15.200285] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-11-03T18:35:15.200372] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-11-03T18:35:15.200504] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-11-03T18:35:15.200544] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-11-03T18:35:15.200995] [DEBUG] [LOCAL ] ECCU: Trimmed 3920 records to 2030 (keeping 200 days of data) [2025-11-03T18:35:15.214153] [DEBUG] [LOCAL ] ECCU: Primary data saved (2030 records). [2025-11-03T18:35:15.214271] [INFO ] [MAIN ] ECCU: Full history saved. [2025-11-03T18:35:15.214353] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCU took 28.0s. Estimated remaining: 3h 53m 7s. Rate: 7.2 symbols/min [2025-11-03T18:35:15.393769] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:35:15.435799] [DEBUG] [LOCAL ] ECL: Loaded 47399 existing records from primary storage. [2025-11-03T18:35:15.436082] [INFO ] [MAIN ] ECL: Loaded 47399 existing records. [2025-11-03T18:35:15.629916] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:35:15.630170] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-11-03T18:35:15.630226] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-11-03T18:35:15.631077] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-11-03T18:35:15.631135] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-11-03T18:35:15.950543] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-11-03T18:35:15.991917] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:35:16.346284] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T18:35:16.442804] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T18:35:16.734873] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-11-03T18:35:17.019847] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-11-03T18:35:17.534845] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-11-03T18:35:17.794018] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-11-03T18:35:18.334948] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-11-03T18:35:19.134911] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-11-03T18:35:19.364035] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-11-03T18:35:19.581584] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T18:35:19.934894] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-11-03T18:35:20.734870] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-11. [2025-11-03T18:35:21.154438] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:35:21.357342] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T18:35:21.358021] [INFO ] [REMOTE ] ECCX: Full fetch complete (1428 records). [2025-11-03T18:35:21.358091] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-11-03T18:35:21.545314] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-11-03T18:35:21.551468] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-11-03T18:35:21.552438] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:35:21.552528] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:35:21.552622] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-11-03T18:35:21.552749] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-11-03T18:35:21.552820] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-11-03T18:35:21.552894] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-11-03T18:35:21.552971] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECCX took 31.7s. Estimated remaining: 3h 52m 54s. Rate: 7.2 symbols/min [2025-11-03T18:35:21.745180] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:35:21.745366] [DEBUG] [LOCAL ] ECO: No existing data file found in primary storage. [2025-11-03T18:35:21.745404] [WARN ] [MAIN ] ECO: No existing data found, performing full refresh instead. [2025-11-03T18:35:21.745518] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-11-03T18:35:21.745609] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-11-03T18:35:21.745716] [DEBUG] [LOCAL ] ECO: No primary data file found to delete. [2025-11-03T18:35:21.745771] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-11-03T18:35:21.864304] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-11-03T18:35:22.143062] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:35:22.334896] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-11-03T18:35:23.134916] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-11-03T18:35:23.340683] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T18:35:23.349083] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-11-03T18:35:23.934845] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-11-03T18:35:24.694821] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T18:35:24.734844] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-11-03T18:35:25.533769] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-11-03T18:35:25.540199] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-11-03T18:35:26.312464] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T18:35:26.334868] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-11-03T18:35:27.027350] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T18:35:27.134922] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-11-03T18:35:27.931065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T18:35:27.936220] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-11-03T18:35:28.734928] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-11-03T18:35:29.075673] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-11-03T18:35:29.294213] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T18:35:29.534853] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-11-03T18:35:29.790521] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.26 seconds). [2025-11-03T18:35:30.334932] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-11. [2025-11-03T18:35:30.786964] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-11 (0.45 seconds). [2025-11-03T18:35:30.787691] [INFO ] [REMOTE ] ECCC: Full fetch complete (1319 records). [2025-11-03T18:35:30.787761] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-11-03T18:35:30.965726] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-11-03T18:35:30.965914] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:35:30.965961] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:35:30.966001] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-11-03T18:35:30.966057] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-11-03T18:35:30.966092] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-11-03T18:35:30.966140] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-11-03T18:35:30.966194] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCC took 48.3s. Estimated remaining: 3h 52m 48s. Rate: 7.2 symbols/min [2025-11-03T18:35:31.133747] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:35:31.134877] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-11-03T18:35:31.171698] [DEBUG] [LOCAL ] ECVT: Loaded 43158 existing records from primary storage. [2025-11-03T18:35:31.172008] [INFO ] [MAIN ] ECVT: Loaded 43158 existing records. [2025-11-03T18:35:31.347841] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:35:31.348057] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-11-03T18:35:31.348104] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-11-03T18:35:31.348981] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-11-03T18:35:31.349040] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-11-03T18:35:31.696674] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:35:31.934823] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-11-03T18:35:32.581003] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T18:35:32.734894] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-11-03T18:35:33.155262] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T18:35:33.337377] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-11-03T18:35:33.534883] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-11-03T18:35:34.334906] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-11-03T18:35:34.733772] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T18:35:35.134865] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-11-03T18:35:35.497827] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T18:35:35.934823] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-11-03T18:35:36.351285] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T18:35:36.619696] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-11-03T18:35:36.734848] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-11-03T18:35:37.534829] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-11-03T18:35:37.649156] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T18:35:38.334873] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-11-03T18:35:38.810624] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T18:35:39.134860] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-11-03T18:35:39.581273] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T18:35:39.934874] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-11-03T18:35:40.224516] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T18:35:40.734940] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-11-03T18:35:41.078404] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T18:35:41.534861] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-11-03T18:35:41.779437] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T18:35:42.239632] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T18:35:42.334816] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-11-03T18:35:43.134822] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-11-03T18:35:43.166940] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T18:35:43.934902] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-11. [2025-11-03T18:35:44.449151] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T18:35:44.734915] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-11-03T18:35:45.309887] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-11 (1.37 seconds). [2025-11-03T18:35:45.310921] [INFO ] [REMOTE ] ECO: Full fetch complete (28361 records). [2025-11-03T18:35:45.310992] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-11-03T18:35:45.542113] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-11-03T18:35:45.676122] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-11-03T18:35:45.676252] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-11-03T18:35:45.676957] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-11-03T18:35:45.677035] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-11-03T18:35:45.678125] [DEBUG] [LOCAL ] ECO: Trimmed 28361 records to 18332 (keeping 200 days of data) [2025-11-03T18:35:45.787615] [DEBUG] [LOCAL ] ECO: Primary data saved (18332 records). [2025-11-03T18:35:45.787775] [INFO ] [MAIN ] ECO: Full history saved. [2025-11-03T18:35:45.787849] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECO took 24.2s. Estimated remaining: 3h 52m 56s. Rate: 7.2 symbols/min [2025-11-03T18:35:45.962620] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:35:45.989945] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T18:35:46.043416] [DEBUG] [LOCAL ] ED: Loaded 53237 existing records from primary storage. [2025-11-03T18:35:46.043750] [INFO ] [MAIN ] ED: Loaded 53237 existing records. [2025-11-03T18:35:46.214855] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:35:46.215088] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-11-03T18:35:46.215152] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-11-03T18:35:46.216026] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-11-03T18:35:46.216082] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-11-03T18:35:46.339983] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-11-03T18:35:46.568032] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:35:46.969679] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-11-03T18:35:47.134817] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-11-03T18:35:47.316168] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T18:35:47.934857] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-11-03T18:35:48.718335] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-11-03T18:35:48.734813] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-11-03T18:35:48.866841] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T18:35:49.534846] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-11-03T18:35:49.955475] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:35:50.334928] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-11-03T18:35:50.501115] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T18:35:51.134875] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-11-03T18:35:51.386854] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T18:35:51.934918] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-11-03T18:35:52.476998] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-11-03T18:35:52.734928] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-11-03T18:35:52.845909] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:35:53.534978] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-11. [2025-11-03T18:35:53.896724] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T18:35:54.334909] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-11-03T18:35:55.134943] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-11-03T18:35:55.419840] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-11 (1.88 seconds). [2025-11-03T18:35:55.421292] [INFO ] [REMOTE ] ECL: Full fetch complete (68501 records). [2025-11-03T18:35:55.421392] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-11-03T18:35:55.818193] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-11-03T18:35:55.818404] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-11-03T18:35:55.819501] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-11-03T18:35:55.819592] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-11-03T18:35:55.821272] [DEBUG] [LOCAL ] ECL: Trimmed 68501 records to 46700 (keeping 200 days of data) [2025-11-03T18:35:55.944401] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-11-03T18:35:56.054272] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-11-03T18:35:56.173532] [DEBUG] [LOCAL ] ECL: Primary data saved (46700 records). [2025-11-03T18:35:56.173855] [INFO ] [MAIN ] ECL: Full history saved. [2025-11-03T18:35:56.174941] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECL took 41.0s. Estimated remaining: 3h 52m 53s. Rate: 7.2 symbols/min [2025-11-03T18:35:56.345421] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T18:35:56.384078] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:35:56.409820] [DEBUG] [LOCAL ] EDD: Loaded 27148 existing records from primary storage. [2025-11-03T18:35:56.410075] [INFO ] [MAIN ] EDD: Loaded 27148 existing records. [2025-11-03T18:35:56.582433] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:35:56.582686] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-11-03T18:35:56.582744] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-11-03T18:35:56.583243] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-11-03T18:35:56.583299] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-11-03T18:35:56.752411] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-11-03T18:35:56.937110] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:35:57.294783] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T18:35:57.534905] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-11-03T18:35:58.248083] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T18:35:58.334879] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-11-03T18:35:58.774461] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:35:59.134907] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-11-03T18:35:59.728009] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T18:35:59.934268] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T18:35:59.939492] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-11. [2025-11-03T18:36:00.734850] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-11-03T18:36:01.400601] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T18:36:01.401808] [INFO ] [REMOTE ] ECG: Full fetch complete (50735 records). [2025-11-03T18:36:01.401897] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-11-03T18:36:01.539812] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-11-03T18:36:01.714582] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T18:36:01.808613] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-11-03T18:36:01.808721] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-11-03T18:36:01.809662] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-11-03T18:36:01.809724] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-11-03T18:36:01.810917] [DEBUG] [LOCAL ] ECG: Trimmed 50735 records to 32047 (keeping 200 days of data) [2025-11-03T18:36:01.996061] [DEBUG] [LOCAL ] ECG: Primary data saved (32047 records). [2025-11-03T18:36:01.996215] [INFO ] [MAIN ] ECG: Full history saved. [2025-11-03T18:36:01.996314] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECG took 55.1s. Estimated remaining: 3h 52m 38s. Rate: 7.2 symbols/min [2025-11-03T18:36:02.160686] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:02.160853] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-11-03T18:36:02.160908] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-11-03T18:36:02.161014] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-11-03T18:36:02.161055] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-11-03T18:36:02.161095] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-11-03T18:36:02.161126] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-11-03T18:36:02.342384] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-11-03T18:36:02.505108] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:02.922501] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T18:36:03.134832] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-11-03T18:36:03.364833] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T18:36:03.934862] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-11-03T18:36:04.114845] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T18:36:04.734855] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-11-03T18:36:05.388565] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T18:36:05.466155] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T18:36:05.534876] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-11-03T18:36:06.334924] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-11-03T18:36:06.740801] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T18:36:07.134950] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-11. [2025-11-03T18:36:07.814319] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T18:36:07.934889] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-11-03T18:36:08.734868] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-11-03T18:36:08.911498] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T18:36:08.957341] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-11 (1.82 seconds). [2025-11-03T18:36:08.958759] [INFO ] [REMOTE ] ECVT: Full fetch complete (60669 records). [2025-11-03T18:36:08.958838] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-11-03T18:36:09.298901] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T18:36:09.394439] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-11-03T18:36:09.394523] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-11-03T18:36:09.395286] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-11-03T18:36:09.395348] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-11-03T18:36:09.396513] [DEBUG] [LOCAL ] ECVT: Trimmed 60669 records to 42536 (keeping 200 days of data) [2025-11-03T18:36:09.552870] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-11-03T18:36:09.634559] [DEBUG] [LOCAL ] ECVT: Primary data saved (42536 records). [2025-11-03T18:36:09.634718] [INFO ] [MAIN ] ECVT: Full history saved. [2025-11-03T18:36:09.635716] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECVT took 38.7s. Estimated remaining: 3h 52m 28s. Rate: 7.2 symbols/min [2025-11-03T18:36:09.808890] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:09.829592] [DEBUG] [LOCAL ] EDN: Loaded 20347 existing records from primary storage. [2025-11-03T18:36:09.829858] [INFO ] [MAIN ] EDN: Loaded 20347 existing records. [2025-11-03T18:36:10.019036] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:36:10.019306] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-11-03T18:36:10.019388] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-11-03T18:36:10.019893] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-11-03T18:36:10.019966] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-11-03T18:36:10.339051] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-11-03T18:36:10.398233] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:10.478635] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T18:36:11.134914] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-11-03T18:36:11.934881] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-11-03T18:36:12.009566] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-11-03T18:36:12.129301] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T18:36:12.734868] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-11-03T18:36:13.314871] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T18:36:13.535147] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-11-03T18:36:13.537429] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T18:36:14.258983] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T18:36:14.334864] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-11-03T18:36:15.113746] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-11-03T18:36:15.134812] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-11-03T18:36:15.804927] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T18:36:15.934845] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-11-03T18:36:16.597887] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-11-03T18:36:16.734865] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-11-03T18:36:17.534874] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-11-03T18:36:18.149677] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T18:36:18.208590] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T18:36:18.334876] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-11-03T18:36:19.031788] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-11-03T18:36:19.134932] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-11-03T18:36:19.800219] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-11-03T18:36:19.934923] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-11-03T18:36:20.734843] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-11-03T18:36:20.866924] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T18:36:21.534868] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-11-03T18:36:22.145754] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T18:36:22.334836] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-11. [2025-11-03T18:36:22.414419] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-11-03T18:36:23.134876] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-11-03T18:36:23.365438] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T18:36:23.367440] [INFO ] [REMOTE ] ED: Full fetch complete (76299 records). [2025-11-03T18:36:23.367585] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-11-03T18:36:23.784700] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-11-03T18:36:23.784798] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-11-03T18:36:23.785699] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-11-03T18:36:23.785763] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-11-03T18:36:23.787167] [DEBUG] [LOCAL ] ED: Trimmed 76299 records to 52470 (keeping 200 days of data) [2025-11-03T18:36:23.960554] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-11-03T18:36:24.104115] [DEBUG] [LOCAL ] ED: Primary data saved (52470 records). [2025-11-03T18:36:24.104233] [INFO ] [MAIN ] ED: Full history saved. [2025-11-03T18:36:24.104762] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ED took 38.3s. Estimated remaining: 3h 52m 35s. Rate: 7.2 symbols/min [2025-11-03T18:36:24.222110] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T18:36:24.297528] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:24.337552] [DEBUG] [LOCAL ] EDU: Loaded 45310 existing records from primary storage. [2025-11-03T18:36:24.337866] [INFO ] [MAIN ] EDU: Loaded 45310 existing records. [2025-11-03T18:36:24.516882] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:36:24.517131] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-11-03T18:36:24.517184] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-11-03T18:36:24.517895] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-11-03T18:36:24.517952] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-11-03T18:36:24.702579] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T18:36:24.740172] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-11-03T18:36:24.903383] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:25.319932] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T18:36:25.534879] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-11-03T18:36:26.334881] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-11-03T18:36:26.478033] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T18:36:27.016734] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T18:36:27.134888] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-11-03T18:36:27.934892] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-11-03T18:36:28.554909] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T18:36:28.734845] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-11-03T18:36:28.965384] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:36:29.534844] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-11. [2025-11-03T18:36:30.104063] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T18:36:30.334826] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-11-03T18:36:31.062571] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T18:36:31.063708] [INFO ] [REMOTE ] EDN: Full fetch complete (29823 records). [2025-11-03T18:36:31.063785] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-11-03T18:36:31.140939] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-11-03T18:36:31.444494] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-11-03T18:36:31.444574] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-11-03T18:36:31.445096] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-11-03T18:36:31.445157] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-11-03T18:36:31.445857] [DEBUG] [LOCAL ] EDN: Trimmed 29823 records to 19958 (keeping 200 days of data) [2025-11-03T18:36:31.558983] [DEBUG] [LOCAL ] EDN: Primary data saved (19958 records). [2025-11-03T18:36:31.559151] [INFO ] [MAIN ] EDN: Full history saved. [2025-11-03T18:36:31.559330] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. EDN took 21.9s. Estimated remaining: 3h 52m 24s. Rate: 7.2 symbols/min [2025-11-03T18:36:31.733900] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:31.764128] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T18:36:31.800198] [DEBUG] [LOCAL ] EE: Loaded 32866 existing records from primary storage. [2025-11-03T18:36:31.800517] [INFO ] [MAIN ] EE: Loaded 32866 existing records. [2025-11-03T18:36:31.916002] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-11-03T18:36:31.939973] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-11. [2025-11-03T18:36:31.992861] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:36:31.993258] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-11-03T18:36:31.993314] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-11-03T18:36:31.993951] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-11-03T18:36:31.994009] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-11-03T18:36:32.342803] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:32.734864] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-11-03T18:36:33.291322] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T18:36:33.292599] [INFO ] [REMOTE ] EDD: Full fetch complete (38942 records). [2025-11-03T18:36:33.292722] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-11-03T18:36:33.540070] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-11-03T18:36:33.719161] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-11-03T18:36:33.719367] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-11-03T18:36:33.720214] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-11-03T18:36:33.720329] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-11-03T18:36:33.734418] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T18:36:33.740030] [DEBUG] [LOCAL ] EDD: Trimmed 38942 records to 26811 (keeping 200 days of data) [2025-11-03T18:36:33.893607] [DEBUG] [LOCAL ] EDD: Primary data saved (26811 records). [2025-11-03T18:36:33.893762] [INFO ] [MAIN ] EDD: Full history saved. [2025-11-03T18:36:33.893844] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. EDD took 37.7s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-11-03T18:36:34.059262] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:34.059453] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-11-03T18:36:34.059491] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-11-03T18:36:34.059601] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-11-03T18:36:34.059662] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-11-03T18:36:34.059730] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-11-03T18:36:34.059764] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-11-03T18:36:34.243844] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T18:36:34.339991] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-11-03T18:36:34.433305] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:35.134926] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-11-03T18:36:35.622073] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T18:36:35.941315] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-11-03T18:36:35.942366] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T18:36:36.734872] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-11-03T18:36:37.096324] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T18:36:37.534831] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-11-03T18:36:37.579074] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T18:36:38.318300] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-11-03T18:36:38.334819] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-11-03T18:36:39.134889] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-11-03T18:36:39.410292] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T18:36:39.748968] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T18:36:39.934869] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-11-03T18:36:40.734869] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-11-03T18:36:40.886206] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T18:36:41.026114] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T18:36:41.534866] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-11-03T18:36:42.334855] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-11-03T18:36:42.485364] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T18:36:43.134866] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-11. [2025-11-03T18:36:43.577504] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T18:36:43.934850] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-11-03T18:36:44.118084] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T18:36:44.119259] [INFO ] [REMOTE ] EDF: Full fetch complete (19838 records). [2025-11-03T18:36:44.119363] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-11-03T18:36:44.539206] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-11-03T18:36:44.539310] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-11-03T18:36:44.539816] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-11-03T18:36:44.539880] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-11-03T18:36:44.540615] [DEBUG] [LOCAL ] EDF: Trimmed 19838 records to 12652 (keeping 200 days of data) [2025-11-03T18:36:44.612985] [DEBUG] [LOCAL ] EDF: Primary data saved (12652 records). [2025-11-03T18:36:44.613121] [INFO ] [MAIN ] EDF: Full history saved. [2025-11-03T18:36:44.613191] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. EDF took 42.6s. Estimated remaining: 3h 51m 59s. Rate: 7.2 symbols/min [2025-11-03T18:36:44.740017] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-11-03T18:36:44.793989] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:44.804094] [DEBUG] [LOCAL ] EEX: Loaded 9377 existing records from primary storage. [2025-11-03T18:36:44.804338] [INFO ] [MAIN ] EEX: Loaded 9377 existing records. [2025-11-03T18:36:44.995873] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:36:44.996261] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-11-03T18:36:44.996330] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-11-03T18:36:44.996634] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-11-03T18:36:44.996779] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-11-03T18:36:45.292075] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T18:36:45.410959] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:45.534853] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-11-03T18:36:46.058903] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T18:36:46.334769] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-11-03T18:36:46.463908] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:36:47.134863] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-11-03T18:36:47.330597] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T18:36:47.505492] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-11-03T18:36:47.934852] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-11-03T18:36:48.734877] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-11-03T18:36:48.757725] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-11-03T18:36:49.214745] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-11-03T18:36:49.534853] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-11-03T18:36:49.857557] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-11-03T18:36:50.334869] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-11-03T18:36:51.134852] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-11-03T18:36:51.404231] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T18:36:51.801508] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T18:36:51.934860] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-11-03T18:36:52.646625] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T18:36:52.734812] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-11-03T18:36:53.466378] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-11-03T18:36:53.534934] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-11-03T18:36:54.156331] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-11-03T18:36:54.334854] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-11-03T18:36:54.997529] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T18:36:55.134855] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-11. [2025-11-03T18:36:55.934914] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-11-03T18:36:56.306569] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-11-03T18:36:56.663723] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T18:36:56.665152] [INFO ] [REMOTE ] EE: Full fetch complete (44937 records). [2025-11-03T18:36:56.665262] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-11-03T18:36:56.744936] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-11-03T18:36:57.076478] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-11-03T18:36:57.076566] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-11-03T18:36:57.077275] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-11-03T18:36:57.077341] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-11-03T18:36:57.078465] [DEBUG] [LOCAL ] EE: Trimmed 44937 records to 32493 (keeping 200 days of data) [2025-11-03T18:36:57.270993] [DEBUG] [LOCAL ] EE: Primary data saved (32493 records). [2025-11-03T18:36:57.271131] [INFO ] [MAIN ] EE: Full history saved. [2025-11-03T18:36:57.271972] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EE took 25.7s. Estimated remaining: 3h 52m 1s. Rate: 7.2 symbols/min [2025-11-03T18:36:57.344224] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-11-03T18:36:57.456999] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:36:57.457169] [DEBUG] [LOCAL ] EFC: No existing data file found in primary storage. [2025-11-03T18:36:57.457208] [WARN ] [MAIN ] EFC: No existing data found, performing full refresh instead. [2025-11-03T18:36:57.457353] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-11-03T18:36:57.457397] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-11-03T18:36:57.457442] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-11-03T18:36:57.457477] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-11-03T18:36:57.540133] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-11-03T18:36:57.824908] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:36:58.246412] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T18:36:58.334877] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-11-03T18:36:58.813677] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-11-03T18:36:59.134896] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-11-03T18:36:59.579664] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T18:36:59.934924] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-11-03T18:37:00.734949] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-11-03T18:37:01.190212] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-11-03T18:37:01.534958] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-11-03T18:37:01.569243] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-11-03T18:37:02.334920] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-11-03T18:37:02.835745] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T18:37:03.134885] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-11-03T18:37:03.553082] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:37:03.934888] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-11-03T18:37:04.239673] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T18:37:04.269627] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-11-03T18:37:04.734901] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-11. [2025-11-03T18:37:05.140595] [DEBUG] [REMOTE ] EEA: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:37:05.141115] [WARN ] [REMOTE ] EEA: No data returned for month 2025-11 [2025-11-03T18:37:05.141217] [FATAL] [REMOTE ] EEA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:37:05.141318] [FATAL] [MAIN ] EEA: Failed to fetch primary data. [2025-11-03T18:37:05.141381] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:37:05.141459] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-11-03T18:37:05.141535] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-11-03T18:37:05.141573] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-11-03T18:37:05.141614] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-11-03T18:37:05.141696] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EEA took 31.2s. Estimated remaining: 3h 51m 51s. Rate: 7.2 symbols/min [2025-11-03T18:37:05.326944] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:05.342980] [DEBUG] [LOCAL ] EFR: Loaded 14783 existing records from primary storage. [2025-11-03T18:37:05.343234] [INFO ] [MAIN ] EFR: Loaded 14783 existing records. [2025-11-03T18:37:05.529512] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:05.529772] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-11-03T18:37:05.529824] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-11-03T18:37:05.530178] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-11-03T18:37:05.530240] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-11-03T18:37:05.541382] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-11-03T18:37:05.891941] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:06.156603] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T18:37:06.334884] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-11-03T18:37:07.134911] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-11-03T18:37:07.573122] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T18:37:07.934885] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-11-03T18:37:08.398145] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T18:37:08.521322] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T18:37:08.734882] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-11. [2025-11-03T18:37:09.534878] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-11-03T18:37:10.334855] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-11-03T18:37:10.560437] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T18:37:10.561805] [INFO ] [REMOTE ] EDU: Full fetch complete (67109 records). [2025-11-03T18:37:10.561907] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-11-03T18:37:10.947471] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-11-03T18:37:10.947603] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-11-03T18:37:10.948555] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-11-03T18:37:10.948632] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-11-03T18:37:10.950155] [DEBUG] [LOCAL ] EDU: Trimmed 67109 records to 44578 (keeping 200 days of data) [2025-11-03T18:37:11.136489] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-11. [2025-11-03T18:37:11.175692] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-11-03T18:37:11.243010] [DEBUG] [LOCAL ] EDU: Primary data saved (44578 records). [2025-11-03T18:37:11.243127] [INFO ] [MAIN ] EDU: Full history saved. [2025-11-03T18:37:11.243205] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EDU took 47.1s. Estimated remaining: 3h 51m 38s. Rate: 7.2 symbols/min [2025-11-03T18:37:11.353588] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T18:37:11.425721] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:11.438762] [DEBUG] [LOCAL ] EFT: Loaded 12887 existing records from primary storage. [2025-11-03T18:37:11.438982] [INFO ] [MAIN ] EFT: Loaded 12887 existing records. [2025-11-03T18:37:11.614596] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:11.614806] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-11-03T18:37:11.614858] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-11-03T18:37:11.615170] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-11-03T18:37:11.615226] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-11-03T18:37:11.746268] [DEBUG] [REMOTE ] EEX: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:37:11.779633] [WARN ] [REMOTE ] EEX: No data returned for month 2025-11 [2025-11-03T18:37:11.795280] [FATAL] [REMOTE ] EEX: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:37:11.796156] [FATAL] [MAIN ] EEX: Failed to fetch primary data. [2025-11-03T18:37:11.831419] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:37:11.868911] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-11-03T18:37:11.890553] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-11-03T18:37:11.898718] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-11-03T18:37:11.901201] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-11-03T18:37:11.901297] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EEX took 27.3s. Estimated remaining: 3h 51m 11s. Rate: 7.2 symbols/min [2025-11-03T18:37:11.938903] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-11-03T18:37:12.101974] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:12.164848] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:12.202761] [DEBUG] [LOCAL ] EFX: Loaded 45125 existing records from primary storage. [2025-11-03T18:37:12.203071] [INFO ] [MAIN ] EFX: Loaded 45125 existing records. [2025-11-03T18:37:12.379061] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:12.379291] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-11-03T18:37:12.379339] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-11-03T18:37:12.380179] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-11-03T18:37:12.380237] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-11-03T18:37:12.679099] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T18:37:12.737969] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-11-03T18:37:12.765851] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:13.531126] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-11-03T18:37:13.534799] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-11-03T18:37:14.334925] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-11-03T18:37:14.550482] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T18:37:15.134878] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-11-03T18:37:15.297813] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T18:37:15.934875] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-11-03T18:37:16.477225] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-11-03T18:37:16.526179] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T18:37:16.734872] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-11-03T18:37:17.534888] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-11-03T18:37:18.087066] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T18:37:18.334889] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-11-03T18:37:18.697471] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-11-03T18:37:19.134910] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-11-03T18:37:19.513381] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:37:19.934858] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-11-03T18:37:20.381406] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T18:37:20.450911] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-11-03T18:37:20.734853] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-11-03T18:37:21.534850] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-11-03T18:37:22.110522] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:37:22.225418] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T18:37:22.334864] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-11-03T18:37:23.056573] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T18:37:23.134913] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-11-03T18:37:23.934918] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-11-03T18:37:24.552336] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T18:37:24.622064] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T18:37:24.734871] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-11-03T18:37:25.483232] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T18:37:25.534817] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-11-03T18:37:26.181633] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T18:37:26.334833] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-11-03T18:37:27.042482] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T18:37:27.134871] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-11-03T18:37:27.695406] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T18:37:27.934877] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-11-03T18:37:28.458713] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-11-03T18:37:28.734876] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-11-03T18:37:29.397065] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T18:37:29.534834] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-11-03T18:37:30.334849] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-11-03T18:37:30.914299] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T18:37:31.134909] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-11-03T18:37:31.673724] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:37:31.714544] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T18:37:31.934887] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-11-03T18:37:32.734877] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-11-03T18:37:33.365862] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T18:37:33.412094] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T18:37:33.534855] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-11. [2025-11-03T18:37:34.334852] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-11-03T18:37:34.444973] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T18:37:34.445917] [INFO ] [REMOTE ] EFT: Full fetch complete (18075 records). [2025-11-03T18:37:34.445986] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-11-03T18:37:34.809982] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-11-03T18:37:34.810122] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-11-03T18:37:34.810573] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-11-03T18:37:34.810636] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-11-03T18:37:34.811356] [DEBUG] [LOCAL ] EFT: Trimmed 18075 records to 12737 (keeping 200 days of data) [2025-11-03T18:37:34.890281] [DEBUG] [LOCAL ] EFT: Primary data saved (12737 records). [2025-11-03T18:37:34.890418] [INFO ] [MAIN ] EFT: Full history saved. [2025-11-03T18:37:34.890497] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EFT took 23.6s. Estimated remaining: 3h 51m 37s. Rate: 7.2 symbols/min [2025-11-03T18:37:35.077584] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:35.088589] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-11-03T18:37:35.118954] [DEBUG] [LOCAL ] EFXT: Loaded 29972 existing records from primary storage. [2025-11-03T18:37:35.119214] [INFO ] [MAIN ] EFXT: Loaded 29972 existing records. [2025-11-03T18:37:35.139923] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-11-03T18:37:35.300827] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:35.301118] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-11-03T18:37:35.301199] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-11-03T18:37:35.301955] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-11-03T18:37:35.302029] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-11-03T18:37:35.652770] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:35.934834] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-11. [2025-11-03T18:37:35.999051] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T18:37:36.734835] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-11-03T18:37:37.534873] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-11. [2025-11-03T18:37:37.839551] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T18:37:38.074338] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-11 (2.14 seconds). [2025-11-03T18:37:38.076318] [INFO ] [REMOTE ] EFC: Full fetch complete (66908 records). [2025-11-03T18:37:38.076426] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-11-03T18:37:38.344852] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-11-03T18:37:38.429719] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-11 (0.89 seconds). [2025-11-03T18:37:38.452116] [INFO ] [REMOTE ] EFR: Full fetch complete (19800 records). [2025-11-03T18:37:38.467868] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-11-03T18:37:38.638388] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-11-03T18:37:38.655540] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-11-03T18:37:38.672252] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-11-03T18:37:38.690780] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-11-03T18:37:38.810693] [DEBUG] [LOCAL ] EFC: Trimmed 66908 records to 46079 (keeping 200 days of data) [2025-11-03T18:37:39.048620] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-11-03T18:37:39.052729] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-11-03T18:37:39.054205] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-11-03T18:37:39.054287] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-11-03T18:37:39.070592] [DEBUG] [LOCAL ] EFR: Trimmed 19800 records to 14364 (keeping 200 days of data) [2025-11-03T18:37:39.166312] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-11-03T18:37:39.308409] [DEBUG] [LOCAL ] EFR: Primary data saved (14364 records). [2025-11-03T18:37:39.313741] [INFO ] [MAIN ] EFR: Full history saved. [2025-11-03T18:37:39.316298] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EFR took 34.2s. Estimated remaining: 3h 51m 20s. Rate: 7.2 symbols/min [2025-11-03T18:37:39.318615] [DEBUG] [LOCAL ] EFC: Primary data saved (46079 records). [2025-11-03T18:37:39.350587] [INFO ] [MAIN ] EFC: Full history saved. [2025-11-03T18:37:39.362672] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFC took 42.1s. Estimated remaining: 3h 50m 52s. Rate: 7.2 symbols/min [2025-11-03T18:37:39.598698] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:39.672384] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:39.706283] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T18:37:39.725117] [DEBUG] [LOCAL ] EG: Loaded 27940 existing records from primary storage. [2025-11-03T18:37:39.725472] [INFO ] [MAIN ] EG: Loaded 27940 existing records. [2025-11-03T18:37:39.944587] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-11-03T18:37:39.951547] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:39.952565] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-11-03T18:37:39.952739] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-11-03T18:37:39.953916] [DEBUG] [LOCAL ] EGO: Loaded 52452 existing records from primary storage. [2025-11-03T18:37:39.954329] [INFO ] [MAIN ] EGO: Loaded 52452 existing records. [2025-11-03T18:37:39.965796] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-11-03T18:37:39.991689] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-11-03T18:37:40.358815] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:40.409539] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-11-03T18:37:40.414885] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-11-03T18:37:40.440110] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-11-03T18:37:40.440208] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-11-03T18:37:40.627723] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:40.707286] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T18:37:40.741551] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-11-03T18:37:40.969121] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:41.295916] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:37:41.534873] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-11-03T18:37:41.857805] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T18:37:42.333790] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T18:37:42.339473] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-11-03T18:37:43.134866] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-11-03T18:37:43.453926] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T18:37:43.934869] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-11-03T18:37:44.284740] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:37:44.734885] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-11-03T18:37:45.249895] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T18:37:45.534860] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-11-03T18:37:45.784231] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T18:37:46.334864] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-11-03T18:37:46.427897] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T18:37:47.134866] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-11-03T18:37:47.610592] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T18:37:47.934850] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-11-03T18:37:48.083103] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T18:37:48.734863] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-11-03T18:37:49.193182] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T18:37:49.534834] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-11-03T18:37:49.669310] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T18:37:50.334905] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-11-03T18:37:51.045345] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:37:51.134890] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-11. [2025-11-03T18:37:51.677001] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T18:37:51.934825] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-11-03T18:37:52.734910] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-11-03T18:37:53.111002] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T18:37:53.172297] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-11 (2.04 seconds). [2025-11-03T18:37:53.174134] [INFO ] [REMOTE ] EFX: Full fetch complete (65156 records). [2025-11-03T18:37:53.174231] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-11-03T18:37:53.543887] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-11-03T18:37:53.588028] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-11-03T18:37:53.588157] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-11-03T18:37:53.589430] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-11-03T18:37:53.589501] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-11-03T18:37:53.591490] [DEBUG] [LOCAL ] EFX: Trimmed 65156 records to 44535 (keeping 200 days of data) [2025-11-03T18:37:53.896795] [DEBUG] [LOCAL ] EFX: Primary data saved (44535 records). [2025-11-03T18:37:53.897168] [INFO ] [MAIN ] EFX: Full history saved. [2025-11-03T18:37:53.897309] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EFX took 42.0s. Estimated remaining: 3h 50m 58s. Rate: 7.2 symbols/min [2025-11-03T18:37:54.099750] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:37:54.133944] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T18:37:54.179562] [DEBUG] [LOCAL ] EGP: Loaded 30241 existing records from primary storage. [2025-11-03T18:37:54.179968] [INFO ] [MAIN ] EGP: Loaded 30241 existing records. [2025-11-03T18:37:54.344413] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-11-03T18:37:54.382505] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:37:54.382790] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-11-03T18:37:54.382861] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-11-03T18:37:54.384000] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-11-03T18:37:54.384254] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-11-03T18:37:54.794559] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T18:37:54.793465] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:37:55.134909] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-11-03T18:37:55.359005] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T18:37:55.934885] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-11-03T18:37:56.204615] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T18:37:56.734875] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-11-03T18:37:56.948215] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T18:37:57.534863] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-11-03T18:37:57.565904] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T18:37:58.334894] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-11-03T18:37:58.425047] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T18:37:59.134894] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-11-03T18:37:59.571938] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T18:37:59.942079] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-11-03T18:37:59.945887] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T18:38:00.734906] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-11-03T18:38:01.536189] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-11-03T18:38:01.657362] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-11-03T18:38:01.707562] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T18:38:02.334942] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-11-03T18:38:02.508574] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T18:38:03.134873] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-10. [2025-11-03T18:38:03.722078] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T18:38:03.934863] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-11-03T18:38:04.126771] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T18:38:04.734934] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-11. [2025-11-03T18:38:04.793437] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T18:38:05.464695] [DEBUG] [REMOTE ] EG: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:38:05.465018] [WARN ] [REMOTE ] EG: No data returned for month 2025-11 [2025-11-03T18:38:05.465100] [FATAL] [REMOTE ] EG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:38:05.465176] [FATAL] [MAIN ] EG: Failed to fetch primary data. [2025-11-03T18:38:05.465238] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:38:05.465318] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-11-03T18:38:05.465396] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-11-03T18:38:05.465433] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-11-03T18:38:05.465596] [DEBUG] [LOCAL ] EG: Deleted derivative data file. [2025-11-03T18:38:05.465708] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EG took 26.1s. Estimated remaining: 3h 50m 57s. Rate: 7.2 symbols/min [2025-11-03T18:38:05.540048] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-11-03T18:38:05.641053] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:38:05.676675] [DEBUG] [LOCAL ] EGY: Loaded 41265 existing records from primary storage. [2025-11-03T18:38:05.676981] [INFO ] [MAIN ] EGY: Loaded 41265 existing records. [2025-11-03T18:38:05.853289] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:38:05.853561] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-11-03T18:38:05.853617] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-11-03T18:38:05.854267] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-11-03T18:38:05.854324] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-11-03T18:38:06.211832] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:38:06.334852] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-11-03T18:38:06.888720] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T18:38:07.134829] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-11-03T18:38:07.575879] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T18:38:07.934851] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-11-03T18:38:08.445944] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:38:08.734862] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-11-03T18:38:09.370020] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T18:38:09.534827] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-11-03T18:38:09.918115] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:38:10.334865] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-11-03T18:38:10.534987] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T18:38:11.134907] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-11. [2025-11-03T18:38:11.541676] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T18:38:11.934866] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-11-03T18:38:12.461906] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-11 (1.33 seconds). [2025-11-03T18:38:12.463444] [INFO ] [REMOTE ] EFXT: Full fetch complete (44321 records). [2025-11-03T18:38:12.463542] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-11-03T18:38:12.744079] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-11-03T18:38:12.958154] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-11-03T18:38:12.958305] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-11-03T18:38:12.959199] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-11-03T18:38:12.959291] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-11-03T18:38:12.960869] [DEBUG] [LOCAL ] EFXT: Trimmed 44321 records to 29633 (keeping 200 days of data) [2025-11-03T18:38:13.077200] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T18:38:13.178309] [DEBUG] [LOCAL ] EFXT: Primary data saved (29633 records). [2025-11-03T18:38:13.178478] [INFO ] [MAIN ] EFXT: Full history saved. [2025-11-03T18:38:13.178579] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFXT took 38.3s. Estimated remaining: 3h 50m 48s. Rate: 7.2 symbols/min [2025-11-03T18:38:13.346418] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:38:13.372562] [DEBUG] [LOCAL ] EHAB: Loaded 29287 existing records from primary storage. [2025-11-03T18:38:13.372870] [INFO ] [MAIN ] EHAB: Loaded 29287 existing records. [2025-11-03T18:38:13.546189] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-11-03T18:38:13.605526] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:38:13.605818] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-11-03T18:38:13.605891] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-11-03T18:38:13.606563] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-11-03T18:38:13.606631] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-11-03T18:38:14.023922] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:38:14.050520] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T18:38:14.334888] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-11-03T18:38:14.834564] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:38:15.134864] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-11-03T18:38:15.472163] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T18:38:15.934885] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-11-03T18:38:16.744571] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-11-03T18:38:16.750758] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T18:38:16.785531] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T18:38:17.534926] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-11-03T18:38:18.022463] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T18:38:18.124602] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T18:38:18.334910] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-11-03T18:38:19.073462] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T18:38:19.134843] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-11-03T18:38:19.934861] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-11-03T18:38:20.435032] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:38:20.734941] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-11-03T18:38:20.999381] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T18:38:21.534969] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-11-03T18:38:21.738835] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T18:38:22.334889] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-11-03T18:38:22.681496] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:38:23.134839] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-11-03T18:38:23.307282] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T18:38:23.934878] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-11-03T18:38:24.034636] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T18:38:24.734868] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-11-03T18:38:24.993939] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T18:38:25.534851] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-11-03T18:38:25.700278] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T18:38:26.334836] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-11. [2025-11-03T18:38:26.466712] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T18:38:27.134904] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-11-03T18:38:27.934857] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-11-03T18:38:27.995725] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T18:38:28.512885] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-11 (2.18 seconds). [2025-11-03T18:38:28.514894] [INFO ] [REMOTE ] EGO: Full fetch complete (74808 records). [2025-11-03T18:38:28.515020] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-11-03T18:38:28.744823] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-11-03T18:38:28.913113] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-11-03T18:38:28.913194] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-11-03T18:38:28.914100] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-11-03T18:38:28.914164] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-11-03T18:38:28.915514] [DEBUG] [LOCAL ] EGO: Trimmed 74808 records to 51693 (keeping 200 days of data) [2025-11-03T18:38:29.050930] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:38:29.263587] [DEBUG] [LOCAL ] EGO: Primary data saved (51693 records). [2025-11-03T18:38:29.263749] [INFO ] [MAIN ] EGO: Full history saved. [2025-11-03T18:38:29.263835] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EGO took 49.9s. Estimated remaining: 3h 50m 57s. Rate: 7.2 symbols/min [2025-11-03T18:38:29.430047] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:38:29.430222] [DEBUG] [LOCAL ] EHC: No existing data file found in primary storage. [2025-11-03T18:38:29.430290] [WARN ] [MAIN ] EHC: No existing data found, performing full refresh instead. [2025-11-03T18:38:29.430398] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-11-03T18:38:29.430439] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-11-03T18:38:29.430480] [DEBUG] [LOCAL ] EHC: No primary data file found to delete. [2025-11-03T18:38:29.430511] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-11-03T18:38:29.539972] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-11. [2025-11-03T18:38:29.788933] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:38:29.809218] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T18:38:30.334932] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-11-03T18:38:31.134907] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-11-03T18:38:31.203755] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-11 (1.66 seconds). [2025-11-03T18:38:31.205058] [INFO ] [REMOTE ] EGY: Full fetch complete (60278 records). [2025-11-03T18:38:31.205168] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-11-03T18:38:31.608001] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T18:38:31.634948] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-11-03T18:38:31.635200] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-11-03T18:38:31.636063] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-11-03T18:38:31.636144] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-11-03T18:38:31.638006] [DEBUG] [LOCAL ] EGY: Trimmed 60278 records to 40542 (keeping 200 days of data) [2025-11-03T18:38:31.866329] [DEBUG] [LOCAL ] EGY: Primary data saved (40542 records). [2025-11-03T18:38:31.866452] [INFO ] [MAIN ] EGY: Full history saved. [2025-11-03T18:38:31.866968] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EGY took 26.4s. Estimated remaining: 3h 50m 36s. Rate: 7.2 symbols/min [2025-11-03T18:38:31.941864] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-11-03T18:38:32.040992] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:38:32.052731] [DEBUG] [LOCAL ] EHI: Loaded 10849 existing records from primary storage. [2025-11-03T18:38:32.052968] [INFO ] [MAIN ] EHI: Loaded 10849 existing records. [2025-11-03T18:38:32.232553] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:38:32.232815] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-11-03T18:38:32.232910] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-11-03T18:38:32.233201] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-11-03T18:38:32.233261] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-11-03T18:38:32.608887] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:38:32.636094] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T18:38:32.734814] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-11-03T18:38:32.912883] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T18:38:33.534832] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-11. [2025-11-03T18:38:33.622367] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:38:34.334828] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-11-03T18:38:34.916484] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-11 (1.38 seconds). [2025-11-03T18:38:34.917630] [INFO ] [REMOTE ] EGP: Full fetch complete (45558 records). [2025-11-03T18:38:34.917730] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-11-03T18:38:35.140027] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-11-03T18:38:35.299009] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-11-03T18:38:35.299206] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-11-03T18:38:35.299902] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-11-03T18:38:35.299977] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-11-03T18:38:35.301160] [DEBUG] [LOCAL ] EGP: Trimmed 45558 records to 29691 (keeping 200 days of data) [2025-11-03T18:38:35.432991] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T18:38:35.514691] [DEBUG] [LOCAL ] EGP: Primary data saved (29691 records). [2025-11-03T18:38:35.514854] [INFO ] [MAIN ] EGP: Full history saved. [2025-11-03T18:38:35.514976] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGP took 41.6s. Estimated remaining: 3h 50m 16s. Rate: 7.2 symbols/min [2025-11-03T18:38:35.685811] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:38:35.705470] [DEBUG] [LOCAL ] EIC: Loaded 22038 existing records from primary storage. [2025-11-03T18:38:35.705747] [INFO ] [MAIN ] EIC: Loaded 22038 existing records. [2025-11-03T18:38:35.887607] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:38:35.887952] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-11-03T18:38:35.888006] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-11-03T18:38:35.888430] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-11-03T18:38:35.888487] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-11-03T18:38:35.943040] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-11-03T18:38:36.233971] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T18:38:36.280164] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:38:36.734855] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-11-03T18:38:37.234831] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T18:38:37.534822] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-11-03T18:38:37.674886] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T18:38:38.334854] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-11-03T18:38:38.660849] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T18:38:38.938058] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-11-03T18:38:39.134863] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-11-03T18:38:39.831919] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T18:38:39.934812] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-11-03T18:38:40.739991] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-11-03T18:38:40.749216] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T18:38:41.534910] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-11-03T18:38:41.970364] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T18:38:41.971064] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-11-03T18:38:42.334896] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-11-03T18:38:42.833060] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T18:38:43.134822] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-11. [2025-11-03T18:38:43.934868] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-11-03T18:38:44.734879] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-11-03T18:38:44.777102] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T18:38:44.820008] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-11 (1.69 seconds). [2025-11-03T18:38:44.821000] [INFO ] [REMOTE ] EHAB: Full fetch complete (41135 records). [2025-11-03T18:38:44.821069] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-11-03T18:38:45.185839] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-11-03T18:38:45.185911] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-11-03T18:38:45.186487] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-11-03T18:38:45.186525] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-11-03T18:38:45.187390] [DEBUG] [LOCAL ] EHAB: Trimmed 41135 records to 28900 (keeping 200 days of data) [2025-11-03T18:38:45.344817] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T18:38:45.355040] [DEBUG] [LOCAL ] EHAB: Primary data saved (28900 records). [2025-11-03T18:38:45.355112] [INFO ] [MAIN ] EHAB: Full history saved. [2025-11-03T18:38:45.355177] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EHAB took 32.2s. Estimated remaining: 3h 50m 11s. Rate: 7.2 symbols/min [2025-11-03T18:38:45.520693] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:38:45.520867] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-11-03T18:38:45.520904] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-11-03T18:38:45.521009] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-11-03T18:38:45.521048] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-11-03T18:38:45.521088] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-11-03T18:38:45.521119] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-11-03T18:38:45.541243] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-11-03T18:38:45.905665] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:38:46.334832] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-11-03T18:38:46.707550] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-11-03T18:38:46.708799] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T18:38:47.134959] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-11-03T18:38:47.934870] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-11-03T18:38:48.185811] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-11-03T18:38:48.405342] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T18:38:48.734851] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-11-03T18:38:49.534823] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-11-03T18:38:49.679639] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T18:38:49.754511] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-11-03T18:38:50.334923] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-11-03T18:38:50.874739] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T18:38:51.134865] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-11-03T18:38:51.934866] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-11-03T18:38:52.121606] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T18:38:52.172043] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-11-03T18:38:52.734859] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-11-03T18:38:52.982138] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-11-03T18:38:53.534866] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-11-03T18:38:54.334914] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-11-03T18:38:54.575378] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-11-03T18:38:54.924798] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T18:38:55.134970] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-11-03T18:38:55.934942] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-11-03T18:38:56.085045] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T18:38:56.181467] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-11-03T18:38:56.734875] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-11-03T18:38:57.470520] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T18:38:57.534817] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-11-03T18:38:58.334847] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-11-03T18:38:58.401662] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T18:38:58.677994] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-11-03T18:38:59.134859] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-11-03T18:38:59.934861] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-11-03T18:39:00.249793] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-11-03T18:39:00.734858] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-11. [2025-11-03T18:39:00.967870] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T18:39:01.534854] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-11-03T18:39:02.299225] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-11 (1.56 seconds). [2025-11-03T18:39:02.300683] [INFO ] [REMOTE ] EHC: Full fetch complete (59164 records). [2025-11-03T18:39:02.300768] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-11-03T18:39:02.345232] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-11-03T18:39:02.674951] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T18:39:02.706944] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-11-03T18:39:02.778135] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-11-03T18:39:02.778217] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-11-03T18:39:02.779011] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-11-03T18:39:02.779075] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-11-03T18:39:02.780239] [DEBUG] [LOCAL ] EHC: Trimmed 59164 records to 40593 (keeping 200 days of data) [2025-11-03T18:39:03.038733] [DEBUG] [LOCAL ] EHC: Primary data saved (40593 records). [2025-11-03T18:39:03.038856] [INFO ] [MAIN ] EHC: Full history saved. [2025-11-03T18:39:03.038928] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EHC took 33.8s. Estimated remaining: 3h 50m 25s. Rate: 7.2 symbols/min [2025-11-03T18:39:03.139964] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-11-03T18:39:03.219192] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:39:03.219373] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-11-03T18:39:03.219412] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-11-03T18:39:03.219525] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-11-03T18:39:03.219567] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-11-03T18:39:03.219610] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-11-03T18:39:03.219663] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-11-03T18:39:03.573897] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:39:03.901865] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T18:39:03.934814] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-11-03T18:39:04.433027] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T18:39:04.734924] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-11-03T18:39:05.446748] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T18:39:05.534916] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-11-03T18:39:05.813972] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-11-03T18:39:06.334886] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-11-03T18:39:06.934712] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T18:39:07.134848] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-11. [2025-11-03T18:39:07.572951] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-11 (0.44 seconds). [2025-11-03T18:39:07.573546] [INFO ] [REMOTE ] EICA: Full fetch complete (1178 records). [2025-11-03T18:39:07.573611] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-11-03T18:39:07.751380] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-11-03T18:39:07.751584] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:39:07.751688] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:39:07.751740] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-11-03T18:39:07.751796] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-11-03T18:39:07.751873] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-11-03T18:39:07.751924] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-11-03T18:39:07.751978] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EICA took 22.4s. Estimated remaining: 3h 50m 8s. Rate: 7.2 symbols/min [2025-11-03T18:39:07.939217] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-11-03T18:39:07.939149] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:39:07.940304] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-11-03T18:39:07.940357] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-11-03T18:39:07.940465] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-11-03T18:39:07.940507] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-11-03T18:39:07.940551] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-11-03T18:39:07.940584] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-11-03T18:39:08.299772] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:39:08.611827] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T18:39:08.734862] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-11-03T18:39:09.500589] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T18:39:09.534824] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-11. [2025-11-03T18:39:10.334829] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-11-03T18:39:10.473670] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T18:39:10.474586] [INFO ] [REMOTE ] EIC: Full fetch complete (33634 records). [2025-11-03T18:39:10.474694] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-11-03T18:39:10.863994] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T18:39:10.864144] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-11-03T18:39:10.865772] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-11-03T18:39:10.866372] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-11-03T18:39:10.866414] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-11-03T18:39:10.867215] [DEBUG] [LOCAL ] EIC: Trimmed 33634 records to 21764 (keeping 200 days of data) [2025-11-03T18:39:10.995112] [DEBUG] [LOCAL ] EIC: Primary data saved (21764 records). [2025-11-03T18:39:10.995234] [INFO ] [MAIN ] EIC: Full history saved. [2025-11-03T18:39:10.995308] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EIC took 35.5s. Estimated remaining: 3h 49m 48s. Rate: 7.2 symbols/min [2025-11-03T18:39:11.143924] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-11-03T18:39:11.177122] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:39:11.195713] [DEBUG] [LOCAL ] EIG: Loaded 20069 existing records from primary storage. [2025-11-03T18:39:11.195953] [INFO ] [MAIN ] EIG: Loaded 20069 existing records. [2025-11-03T18:39:11.369701] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:39:11.369933] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-11-03T18:39:11.369980] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-11-03T18:39:11.370423] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-11-03T18:39:11.370480] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-11-03T18:39:11.711811] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-11-03T18:39:11.815513] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:39:11.934852] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-11-03T18:39:12.196186] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-11-03T18:39:12.734860] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-11. [2025-11-03T18:39:13.534834] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-11-03T18:39:13.666205] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T18:39:13.667085] [INFO ] [REMOTE ] EHI: Full fetch complete (15843 records). [2025-11-03T18:39:13.667154] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-11-03T18:39:13.852111] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-11-03T18:39:14.043241] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-11-03T18:39:14.043334] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-11-03T18:39:14.043708] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-11-03T18:39:14.043768] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-11-03T18:39:14.044243] [DEBUG] [LOCAL ] EHI: Trimmed 15843 records to 10847 (keeping 200 days of data) [2025-11-03T18:39:14.107386] [DEBUG] [LOCAL ] EHI: Primary data saved (10847 records). [2025-11-03T18:39:14.107524] [INFO ] [MAIN ] EHI: Full history saved. [2025-11-03T18:39:14.107601] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EHI took 42.2s. Estimated remaining: 3h 49m 27s. Rate: 7.2 symbols/min [2025-11-03T18:39:14.291899] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:39:14.339626] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-11-03T18:39:14.341916] [DEBUG] [LOCAL ] EIX: Loaded 54113 existing records from primary storage. [2025-11-03T18:39:14.342286] [INFO ] [MAIN ] EIX: Loaded 54113 existing records. [2025-11-03T18:39:14.529574] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:39:14.529825] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-11-03T18:39:14.529876] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-11-03T18:39:14.530796] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-11-03T18:39:14.530853] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-11-03T18:39:14.784993] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-11-03T18:39:14.888068] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:39:15.134857] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-11-03T18:39:15.427772] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T18:39:15.934905] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-11-03T18:39:16.294475] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-11-03T18:39:16.734853] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-11-03T18:39:17.134434] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T18:39:17.534884] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-11-03T18:39:17.796343] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-11-03T18:39:18.334862] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-11-03T18:39:18.775075] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T18:39:19.134911] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-11-03T18:39:19.934862] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-11-03T18:39:20.720688] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T18:39:20.739939] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-11-03T18:39:20.762032] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-11-03T18:39:21.164104] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T18:39:21.534884] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-11-03T18:39:22.278614] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T18:39:22.334835] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-11-03T18:39:22.981864] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-11-03T18:39:23.134859] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-11-03T18:39:23.934821] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-11-03T18:39:23.966486] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T18:39:24.344048] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-11-03T18:39:24.734880] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-11-03T18:39:25.467209] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T18:39:25.534896] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-11-03T18:39:26.004740] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-11-03T18:39:26.334853] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-11-03T18:39:27.071769] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T18:39:27.134894] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-11-03T18:39:27.934889] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-11-03T18:39:27.974083] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-11-03T18:39:28.239354] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-11-03T18:39:28.734868] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-11-03T18:39:29.267473] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-11-03T18:39:29.534839] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-11-03T18:39:29.986257] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T18:39:30.334853] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-11-03T18:39:31.134855] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-11-03T18:39:31.403344] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T18:39:31.421837] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-11-03T18:39:31.934848] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-11-03T18:39:32.289249] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-11-03T18:39:32.734847] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-11-03T18:39:33.202784] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T18:39:33.534870] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-11. [2025-11-03T18:39:33.986158] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-11 (0.45 seconds). [2025-11-03T18:39:33.986967] [INFO ] [REMOTE ] EICB: Full fetch complete (2625 records). [2025-11-03T18:39:33.987050] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-11-03T18:39:34.181825] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-11-03T18:39:34.182046] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:39:34.182121] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:39:34.182196] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-11-03T18:39:34.182261] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-11-03T18:39:34.182299] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-11-03T18:39:34.182341] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-11-03T18:39:34.182397] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EICB took 31.1s. Estimated remaining: 3h 49m 46s. Rate: 7.2 symbols/min [2025-11-03T18:39:34.346700] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-11-03T18:39:34.349948] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:39:34.397406] [DEBUG] [LOCAL ] EL: Loaded 54147 existing records from primary storage. [2025-11-03T18:39:34.397748] [INFO ] [MAIN ] EL: Loaded 54147 existing records. [2025-11-03T18:39:34.573339] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:39:34.573570] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-11-03T18:39:34.573621] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-11-03T18:39:34.574703] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-11-03T18:39:34.574767] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-11-03T18:39:34.923388] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:39:35.134859] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-11-03T18:39:35.624347] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T18:39:35.787020] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-11-03T18:39:35.934856] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-11-03T18:39:36.734879] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-11-03T18:39:37.390051] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T18:39:37.534836] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-11-03T18:39:38.277881] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T18:39:38.322091] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-11-03T18:39:38.334799] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-11-03T18:39:39.134899] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-11-03T18:39:39.861764] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T18:39:39.934817] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-11. [2025-11-03T18:39:40.092523] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-11-03T18:39:40.225707] [DEBUG] [REMOTE ] EICC: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:39:40.226158] [WARN ] [REMOTE ] EICC: No data returned for month 2025-11 [2025-11-03T18:39:40.226304] [FATAL] [REMOTE ] EICC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:39:40.226412] [FATAL] [MAIN ] EICC: Failed to fetch primary data. [2025-11-03T18:39:40.226484] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:39:40.226538] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-11-03T18:39:40.226603] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-11-03T18:39:40.226667] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-11-03T18:39:40.226741] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-11-03T18:39:40.226885] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EICC took 32.5s. Estimated remaining: 3h 49m 33s. Rate: 7.2 symbols/min [2025-11-03T18:39:40.400707] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:39:40.450041] [DEBUG] [LOCAL ] ELAN: Loaded 54079 existing records from primary storage. [2025-11-03T18:39:40.450386] [INFO ] [MAIN ] ELAN: Loaded 54079 existing records. [2025-11-03T18:39:40.633931] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:39:40.634165] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-11-03T18:39:40.634214] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-11-03T18:39:40.635125] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-11-03T18:39:40.635184] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-11-03T18:39:40.740350] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-11-03T18:39:40.997634] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:39:41.534915] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-11. [2025-11-03T18:39:42.337026] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-11-03T18:39:42.340774] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-11-03T18:39:42.812983] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T18:39:42.814314] [INFO ] [REMOTE ] EIG: Full fetch complete (27612 records). [2025-11-03T18:39:42.814403] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-11-03T18:39:43.135870] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-11-03T18:39:43.231498] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-11-03T18:39:43.231709] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-11-03T18:39:43.232494] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-11-03T18:39:43.232552] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-11-03T18:39:43.233943] [DEBUG] [LOCAL ] EIG: Trimmed 27612 records to 19931 (keeping 200 days of data) [2025-11-03T18:39:43.362974] [DEBUG] [LOCAL ] EIG: Primary data saved (19931 records). [2025-11-03T18:39:43.363186] [INFO ] [MAIN ] EIG: Full history saved. [2025-11-03T18:39:43.363291] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EIG took 32.4s. Estimated remaining: 3h 49m 12s. Rate: 7.2 symbols/min [2025-11-03T18:39:43.878510] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T18:39:43.934820] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-11-03T18:39:44.530262] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T18:39:44.734874] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-11-03T18:39:45.534861] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-11-03T18:39:45.635912] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-11-03T18:39:46.087156] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T18:39:46.334934] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-11-03T18:39:47.114610] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-11-03T18:39:47.134818] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-11-03T18:39:47.876224] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T18:39:47.934816] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-11-03T18:39:48.684718] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-11-03T18:39:48.734821] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-11-03T18:39:49.269733] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:39:49.534956] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-11-03T18:39:50.334832] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-11-03T18:39:50.376151] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T18:39:50.791854] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T18:39:51.134858] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-11-03T18:39:51.934822] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-11-03T18:39:52.109395] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-11-03T18:39:52.407943] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T18:39:52.734876] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-11-03T18:39:53.535147] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-11-03T18:39:53.540709] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-11-03T18:39:54.063573] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T18:39:54.334904] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-11-03T18:39:55.147323] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-11-03T18:39:55.151950] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-11-03T18:39:55.880960] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-11-03T18:39:55.934827] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-11-03T18:39:56.629082] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T18:39:56.734881] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-11-03T18:39:57.220529] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:39:57.534879] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-11-03T18:39:58.342883] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-11-03T18:39:58.373367] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-11-03T18:39:58.821539] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:39:59.134881] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-11. [2025-11-03T18:39:59.934838] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-11-03T18:39:59.989307] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-11-03T18:40:00.734952] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-11. [2025-11-03T18:40:01.407400] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-11 (2.27 seconds). [2025-11-03T18:40:01.408951] [INFO ] [REMOTE ] ELAN: Full fetch complete (77106 records). [2025-11-03T18:40:01.409084] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-11-03T18:40:01.924374] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-11-03T18:40:01.924531] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-11-03T18:40:01.926352] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-11-03T18:40:01.926726] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-11-03T18:40:01.929123] [DEBUG] [LOCAL ] ELAN: Trimmed 77106 records to 53302 (keeping 200 days of data) [2025-11-03T18:40:02.124094] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-11-03T18:40:02.143362] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T18:40:02.148474] [INFO ] [REMOTE ] EIX: Full fetch complete (77443 records). [2025-11-03T18:40:02.153979] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-11-03T18:40:02.157531] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-11-03T18:40:02.771214] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-11-03T18:40:02.777786] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-11-03T18:40:02.778763] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-11-03T18:40:02.796184] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-11-03T18:40:02.819898] [DEBUG] [LOCAL ] ELAN: Primary data saved (53302 records). [2025-11-03T18:40:02.820166] [INFO ] [MAIN ] ELAN: Full history saved. [2025-11-03T18:40:02.820403] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. ELAN took 22.6s. Estimated remaining: 3h 49m 29s. Rate: 7.2 symbols/min [2025-11-03T18:40:02.821075] [DEBUG] [LOCAL ] EIX: Trimmed 77443 records to 53346 (keeping 200 days of data) [2025-11-03T18:40:03.153321] [DEBUG] [LOCAL ] EIX: Primary data saved (53346 records). [2025-11-03T18:40:03.153452] [INFO ] [MAIN ] EIX: Full history saved. [2025-11-03T18:40:03.154114] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. EIX took 49.0s. Estimated remaining: 3h 49m 3s. Rate: 7.2 symbols/min [2025-11-03T18:40:03.703633] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-11-03T18:40:03.714962] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-11-03T18:40:05.709192] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-11-03T18:40:05.721543] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-11. [2025-11-03T18:40:07.072150] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T18:40:07.073634] [INFO ] [REMOTE ] EL: Full fetch complete (77452 records). [2025-11-03T18:40:07.073755] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-11-03T18:40:07.456334] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-11-03T18:40:07.456414] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-11-03T18:40:07.457325] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-11-03T18:40:07.457388] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-11-03T18:40:07.458831] [DEBUG] [LOCAL ] EL: Trimmed 77452 records to 53369 (keeping 200 days of data) [2025-11-03T18:40:07.781926] [DEBUG] [LOCAL ] EL: Primary data saved (53369 records). [2025-11-03T18:40:07.782068] [INFO ] [MAIN ] EL: Full history saved. [2025-11-03T18:40:07.782532] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EL took 33.6s. Estimated remaining: 3h 48m 46s. Rate: 7.2 symbols/min [2025-11-03T18:40:08.503182] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:08.506251] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:08.506439] [DEBUG] [LOCAL ] ELF: No existing data file found in primary storage. [2025-11-03T18:40:08.500067] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:08.506615] [WARN ] [MAIN ] ELF: No existing data found, performing full refresh instead. [2025-11-03T18:40:08.479950] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:08.507467] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-11-03T18:40:08.507683] [DEBUG] [LOCAL ] ELC: No existing data file found in primary storage. [2025-11-03T18:40:08.507784] [WARN ] [MAIN ] ELC: No existing data found, performing full refresh instead. [2025-11-03T18:40:08.507866] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-11-03T18:40:08.509505] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-11-03T18:40:08.509918] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-11-03T18:40:08.509986] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-11-03T18:40:08.510122] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-11-03T18:40:08.510177] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-11-03T18:40:08.510286] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-11-03T18:40:08.933603] [DEBUG] [LOCAL ] ELP: Loaded 25521 existing records from primary storage. [2025-11-03T18:40:09.009209] [DEBUG] [LOCAL ] ELME: Loaded 39972 existing records from primary storage. [2025-11-03T18:40:09.069713] [INFO ] [MAIN ] ELME: Loaded 39972 existing records. [2025-11-03T18:40:09.069885] [INFO ] [MAIN ] ELP: Loaded 25521 existing records. [2025-11-03T18:40:09.389544] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:09.481065] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:09.494999] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-11-03T18:40:09.494778] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-11-03T18:40:09.631489] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:40:09.654419] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:40:09.655051] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-11-03T18:40:09.654904] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-11-03T18:40:09.655218] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-11-03T18:40:09.655305] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-11-03T18:40:09.655755] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-11-03T18:40:09.655812] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-11-03T18:40:09.689221] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-11-03T18:40:09.701050] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-11-03T18:40:10.315363] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:10.375152] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:10.376059] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T18:40:10.375866] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-11-03T18:40:10.378566] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-11-03T18:40:10.377683] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-11-03T18:40:10.702139] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T18:40:10.703392] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-11-03T18:40:11.071896] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-11-03T18:40:11.073274] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-11-03T18:40:11.366628] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T18:40:11.373791] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-11-03T18:40:11.403228] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-11-03T18:40:11.413293] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-11-03T18:40:11.470726] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-11-03T18:40:11.472163] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-11-03T18:40:11.799966] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T18:40:11.841281] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T18:40:11.934879] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-11-03T18:40:12.402392] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T18:40:12.678390] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T18:40:12.734813] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-11-03T18:40:13.084989] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-11-03T18:40:13.465128] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T18:40:13.534905] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-11-03T18:40:14.334884] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-11-03T18:40:14.639782] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T18:40:15.134907] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-11-03T18:40:15.262922] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T18:40:15.934866] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-11-03T18:40:16.286439] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-11-03T18:40:16.734843] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-11-03T18:40:16.817867] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T18:40:17.534894] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-11-03T18:40:17.997998] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T18:40:18.334879] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-11-03T18:40:19.134839] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-11-03T18:40:19.205862] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T18:40:19.330684] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-11-03T18:40:19.934833] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-11-03T18:40:20.153158] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T18:40:20.205108] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-11-03T18:40:20.734873] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-11-03T18:40:21.534903] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-11-03T18:40:22.334886] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-11-03T18:40:22.395060] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-11-03T18:40:22.467182] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T18:40:23.134913] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-11-03T18:40:23.447315] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T18:40:23.643741] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T18:40:23.934895] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-11-03T18:40:24.734866] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-11-03T18:40:25.140794] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:40:25.534909] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-11-03T18:40:26.334913] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-11-03T18:40:26.372534] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-11-03T18:40:26.688585] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:40:27.108597] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T18:40:27.134850] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-11-03T18:40:27.941905] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-11-03T18:40:27.945535] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-11-03T18:40:28.734849] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-11-03T18:40:29.464103] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-11-03T18:40:29.534839] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-11-03T18:40:29.607138] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T18:40:30.334866] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-11. [2025-11-03T18:40:31.134865] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-11-03T18:40:31.262767] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-11-03T18:40:31.391541] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-11-03T18:40:31.470486] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T18:40:31.471543] [INFO ] [REMOTE ] ELP: Full fetch complete (36722 records). [2025-11-03T18:40:31.471612] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-11-03T18:40:31.885102] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-11-03T18:40:31.885190] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-11-03T18:40:31.885774] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-11-03T18:40:31.885855] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-11-03T18:40:31.886912] [DEBUG] [LOCAL ] ELP: Trimmed 36722 records to 25135 (keeping 200 days of data) [2025-11-03T18:40:31.942498] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-11-03T18:40:32.034675] [DEBUG] [LOCAL ] ELP: Primary data saved (25135 records). [2025-11-03T18:40:32.034816] [INFO ] [MAIN ] ELP: Full history saved. [2025-11-03T18:40:32.034900] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELP took 24.2s. Estimated remaining: 3h 49m 14s. Rate: 7.2 symbols/min [2025-11-03T18:40:32.210287] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:32.210475] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-11-03T18:40:32.210530] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-11-03T18:40:32.210692] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-11-03T18:40:32.210746] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-11-03T18:40:32.210790] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-11-03T18:40:32.210823] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-11-03T18:40:32.572024] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:32.734821] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-11-03T18:40:33.107737] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-11-03T18:40:33.534839] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-11-03T18:40:33.726913] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-11-03T18:40:34.146869] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T18:40:34.334847] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-11. [2025-11-03T18:40:34.779250] [DEBUG] [REMOTE ] ELC: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:40:34.779549] [WARN ] [REMOTE ] ELC: No data returned for month 2025-11 [2025-11-03T18:40:34.779678] [FATAL] [REMOTE ] ELC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:40:34.779766] [FATAL] [MAIN ] ELC: Failed to fetch primary data. [2025-11-03T18:40:34.779830] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:40:34.779903] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-11-03T18:40:34.779969] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-11-03T18:40:34.780006] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-11-03T18:40:34.780047] [DEBUG] [LOCAL ] ELC: No derivative data file found to delete. [2025-11-03T18:40:34.780094] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELC took 27.0s. Estimated remaining: 3h 48m 53s. Rate: 7.2 symbols/min [2025-11-03T18:40:34.973345] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:34.973521] [DEBUG] [LOCAL ] ELS: No existing data file found in primary storage. [2025-11-03T18:40:34.973558] [WARN ] [MAIN ] ELS: No existing data found, performing full refresh instead. [2025-11-03T18:40:34.973695] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-11-03T18:40:34.973747] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-11-03T18:40:34.973810] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-11-03T18:40:34.973842] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-11-03T18:40:35.145770] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-11-03T18:40:35.324916] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:35.934845] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-11-03T18:40:36.613554] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T18:40:36.734796] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-11-03T18:40:37.100509] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T18:40:37.534894] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-11-03T18:40:37.754686] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-11-03T18:40:38.243726] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:40:38.334863] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-11-03T18:40:39.134873] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-11-03T18:40:39.384094] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-11-03T18:40:39.588205] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T18:40:39.934857] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-11-03T18:40:40.734909] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-11-03T18:40:41.168685] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T18:40:41.534859] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-11-03T18:40:41.891572] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T18:40:42.334880] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-11-03T18:40:42.634011] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-11-03T18:40:42.714334] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T18:40:43.134867] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-11. [2025-11-03T18:40:43.934865] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-11-03T18:40:44.231880] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-11-03T18:40:44.734896] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-11-03T18:40:45.499165] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-11 (2.36 seconds). [2025-11-03T18:40:45.500636] [INFO ] [REMOTE ] ELF: Full fetch complete (75403 records). [2025-11-03T18:40:45.500802] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-11-03T18:40:45.544220] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-11-03T18:40:45.883007] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-11-03T18:40:45.908487] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-11-03T18:40:45.908583] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-11-03T18:40:45.909526] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-11-03T18:40:45.909583] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-11-03T18:40:45.910961] [DEBUG] [LOCAL ] ELF: Trimmed 75403 records to 51553 (keeping 200 days of data) [2025-11-03T18:40:46.245875] [DEBUG] [LOCAL ] ELF: Primary data saved (51553 records). [2025-11-03T18:40:46.249076] [INFO ] [MAIN ] ELF: Full history saved. [2025-11-03T18:40:46.249215] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. ELF took 38.5s. Estimated remaining: 3h 48m 51s. Rate: 7.2 symbols/min [2025-11-03T18:40:46.313936] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-11-03T18:40:46.339919] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-11. [2025-11-03T18:40:46.435886] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:46.436120] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-11-03T18:40:46.436171] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-11-03T18:40:46.436308] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-11-03T18:40:46.436359] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-11-03T18:40:46.436401] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-11-03T18:40:46.436432] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-11-03T18:40:46.780027] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:47.134817] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-11-03T18:40:47.934858] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-11-03T18:40:48.144403] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-11 (1.80 seconds). [2025-11-03T18:40:48.145761] [INFO ] [REMOTE ] ELME: Full fetch complete (56650 records). [2025-11-03T18:40:48.145850] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-11-03T18:40:48.522058] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-11-03T18:40:48.522175] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-11-03T18:40:48.523103] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-11-03T18:40:48.523168] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-11-03T18:40:48.524360] [DEBUG] [LOCAL ] ELME: Trimmed 56650 records to 39541 (keeping 200 days of data) [2025-11-03T18:40:48.735697] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-11-03T18:40:48.766082] [DEBUG] [LOCAL ] ELME: Primary data saved (39541 records). [2025-11-03T18:40:48.766582] [INFO ] [MAIN ] ELME: Full history saved. [2025-11-03T18:40:48.766785] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELME took 41.0s. Estimated remaining: 3h 48m 30s. Rate: 7.2 symbols/min [2025-11-03T18:40:48.973870] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-11-03T18:40:48.978304] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:48.988685] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-11-03T18:40:48.988767] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-11-03T18:40:48.988888] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-11-03T18:40:48.988951] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-11-03T18:40:48.989021] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-11-03T18:40:48.989080] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-11-03T18:40:49.257839] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-11-03T18:40:49.383197] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:49.494275] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-11-03T18:40:49.534810] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-11-03T18:40:50.334923] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-11-03T18:40:50.490101] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:40:50.490498] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-11-03T18:40:50.490703] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:40:50.490778] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-11-03T18:40:50.490833] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:40:50.490894] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-11-03T18:40:50.490978] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-11-03T18:40:50.491037] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-11-03T18:40:50.491124] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-11-03T18:40:50.491212] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. EMA took 1.7s. Estimated remaining: 3h 48m 6s. Rate: 7.2 symbols/min [2025-11-03T18:40:50.717218] [INFO ] [MAIN ] EMBJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:50.717621] [DEBUG] [LOCAL ] EMBJ: No existing data file found in primary storage. [2025-11-03T18:40:50.717725] [WARN ] [MAIN ] EMBJ: No existing data found, performing full refresh instead. [2025-11-03T18:40:50.717873] [INFO ] [MAIN ] EMBJ: Wiping existing primary data before full refresh. [2025-11-03T18:40:50.717937] [INFO ] [LOCAL ] EMBJ: Starting deletion of primary data. [2025-11-03T18:40:50.718003] [DEBUG] [LOCAL ] EMBJ: No primary data file found to delete. [2025-11-03T18:40:50.718057] [INFO ] [MAIN ] EMBJ: Starting full primary refresh. [2025-11-03T18:40:51.137948] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-11-03T18:40:51.160299] [INFO ] [REMOTE ] EMBJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:51.165623] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-11-03T18:40:51.934852] [INFO ] [REMOTE ] EMBJ: Fetching primary data for 2025-01. [2025-11-03T18:40:52.083027] [DEBUG] [REMOTE ] EMBJ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:40:52.083315] [WARN ] [REMOTE ] EMBJ: No data returned for month 2025-01 [2025-11-03T18:40:52.083399] [FATAL] [REMOTE ] EMBJ: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:40:52.083454] [FATAL] [MAIN ] EMBJ: Failed to fetch primary data. [2025-11-03T18:40:52.083510] [WARN ] [MAIN ] EMBJ: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:40:52.083586] [INFO ] [LOCAL ] EMBJ: Starting deletion of primary data. [2025-11-03T18:40:52.083670] [DEBUG] [LOCAL ] EMBJ: No primary data file found to delete. [2025-11-03T18:40:52.083727] [INFO ] [LOCAL ] EMBJ: Starting deletion of derivative data. [2025-11-03T18:40:52.083787] [DEBUG] [LOCAL ] EMBJ: No derivative data file found to delete. [2025-11-03T18:40:52.083834] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. EMBJ took 1.6s. Estimated remaining: 3h 47m 43s. Rate: 7.2 symbols/min [2025-11-03T18:40:52.250772] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:52.250926] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-11-03T18:40:52.250963] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-11-03T18:40:52.251065] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-11-03T18:40:52.251105] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-11-03T18:40:52.251145] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-11-03T18:40:52.251176] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-11-03T18:40:52.606934] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:52.632625] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T18:40:52.734890] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-11-03T18:40:53.534892] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-11-03T18:40:53.765973] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-11-03T18:40:54.099809] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T18:40:54.334820] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-11-03T18:40:54.649704] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-11-03T18:40:55.134858] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-11-03T18:40:55.452446] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-11-03T18:40:55.934863] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-11. [2025-11-03T18:40:56.419817] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-11 (0.48 seconds). [2025-11-03T18:40:56.420438] [INFO ] [REMOTE ] ELPC: Full fetch complete (1242 records). [2025-11-03T18:40:56.420505] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-11-03T18:40:56.597755] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-11-03T18:40:56.597929] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:40:56.597999] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:40:56.598091] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-11-03T18:40:56.598190] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-11-03T18:40:56.598241] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-11-03T18:40:56.598285] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-11-03T18:40:56.598342] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. ELPC took 24.6s. Estimated remaining: 3h 47m 26s. Rate: 7.2 symbols/min [2025-11-03T18:40:56.744489] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-11-03T18:40:56.777979] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:40:56.778262] [DEBUG] [LOCAL ] EME: No existing data file found in primary storage. [2025-11-03T18:40:56.778308] [WARN ] [MAIN ] EME: No existing data found, performing full refresh instead. [2025-11-03T18:40:56.778418] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-11-03T18:40:56.778459] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-11-03T18:40:56.778501] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-11-03T18:40:56.778533] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-11-03T18:40:57.139202] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:40:57.534855] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-11-03T18:40:58.135845] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T18:40:58.334859] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-11-03T18:40:58.862351] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T18:40:59.134932] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-11-03T18:40:59.474494] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T18:40:59.934971] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-11-03T18:41:00.458552] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T18:41:00.734893] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-11-03T18:41:01.301372] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T18:41:01.534860] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-11-03T18:41:02.231253] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T18:41:02.334883] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-11-03T18:41:02.628166] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T18:41:03.134938] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-11-03T18:41:03.799669] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T18:41:03.934862] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-11-03T18:41:04.734843] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-11-03T18:41:04.951227] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-11-03T18:41:05.236320] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T18:41:05.534867] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-11-03T18:41:05.741691] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T18:41:06.334914] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-11-03T18:41:06.428713] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-11-03T18:41:07.134931] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-11-03T18:41:07.829478] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T18:41:07.934858] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-11-03T18:41:08.155744] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T18:41:08.734878] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-11. [2025-11-03T18:41:09.540128] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-11-03T18:41:09.560245] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-11-03T18:41:09.609994] [DEBUG] [REMOTE ] ELS: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:41:09.610300] [WARN ] [REMOTE ] ELS: No data returned for month 2025-11 [2025-11-03T18:41:09.610388] [FATAL] [REMOTE ] ELS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:41:09.610482] [FATAL] [MAIN ] ELS: Failed to fetch primary data. [2025-11-03T18:41:09.610549] [WARN ] [MAIN ] ELS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:41:09.610618] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-11-03T18:41:09.610714] [DEBUG] [LOCAL ] ELS: No primary data file found to delete. [2025-11-03T18:41:09.610760] [INFO ] [LOCAL ] ELS: Starting deletion of derivative data. [2025-11-03T18:41:09.610801] [DEBUG] [LOCAL ] ELS: No derivative data file found to delete. [2025-11-03T18:41:09.610846] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELS took 34.8s. Estimated remaining: 3h 47m 28s. Rate: 7.2 symbols/min [2025-11-03T18:41:09.777023] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:09.781326] [DEBUG] [LOCAL ] EMF: Loaded 3088 existing records from primary storage. [2025-11-03T18:41:09.781485] [INFO ] [MAIN ] EMF: Loaded 3088 existing records. [2025-11-03T18:41:09.954510] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:41:09.954725] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-11-03T18:41:09.954782] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-11-03T18:41:09.954991] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-11-03T18:41:09.955048] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-11-03T18:41:10.307554] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:10.334830] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-11-03T18:41:11.025420] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T18:41:11.134857] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-11-03T18:41:11.273532] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T18:41:11.934931] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-11-03T18:41:12.165215] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T18:41:12.704432] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T18:41:12.734813] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-11-03T18:41:13.451434] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-11-03T18:41:13.534835] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-11-03T18:41:14.303904] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T18:41:14.334854] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-11-03T18:41:15.134889] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-11-03T18:41:15.580209] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T18:41:15.934922] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-11-03T18:41:16.705454] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T18:41:16.729423] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T18:41:16.734904] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-11-03T18:41:17.506833] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T18:41:17.534812] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-11-03T18:41:18.293125] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T18:41:18.334812] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-11-03T18:41:19.054367] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-11-03T18:41:19.134822] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-11. [2025-11-03T18:41:19.717220] [DEBUG] [REMOTE ] EMD: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:41:19.717562] [WARN ] [REMOTE ] EMD: No data returned for month 2025-11 [2025-11-03T18:41:19.717671] [FATAL] [REMOTE ] EMD: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:41:19.717763] [FATAL] [MAIN ] EMD: Failed to fetch primary data. [2025-11-03T18:41:19.717825] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:41:19.717915] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-11-03T18:41:19.718019] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-11-03T18:41:19.718062] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-11-03T18:41:19.718102] [DEBUG] [LOCAL ] EMD: No derivative data file found to delete. [2025-11-03T18:41:19.718148] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. EMD took 27.6s. Estimated remaining: 3h 47m 24s. Rate: 7.2 symbols/min [2025-11-03T18:41:19.885226] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:19.929782] [DEBUG] [LOCAL ] EMN: Loaded 51576 existing records from primary storage. [2025-11-03T18:41:19.930134] [INFO ] [MAIN ] EMN: Loaded 51576 existing records. [2025-11-03T18:41:19.941023] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-11-03T18:41:20.109857] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:41:20.110055] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-11-03T18:41:20.110103] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-11-03T18:41:20.110950] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-11-03T18:41:20.111008] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-11-03T18:41:20.468447] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:20.734859] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-11-03T18:41:21.177349] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T18:41:21.534891] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-11-03T18:41:22.122480] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T18:41:22.334913] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-11-03T18:41:22.394700] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T18:41:23.134851] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-11-03T18:41:23.411058] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T18:41:23.934828] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-11. [2025-11-03T18:41:23.973319] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-11-03T18:41:24.734898] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-11-03T18:41:25.321904] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T18:41:25.534875] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-11-03T18:41:25.954256] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T18:41:26.334835] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-11-03T18:41:26.726770] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-11 (2.79 seconds). [2025-11-03T18:41:26.729040] [INFO ] [REMOTE ] ELV: Full fetch complete (73293 records). [2025-11-03T18:41:26.729215] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-11-03T18:41:27.140003] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-11-03T18:41:27.186119] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-11-03T18:41:27.186199] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-11-03T18:41:27.187122] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-11-03T18:41:27.187188] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-11-03T18:41:27.188624] [DEBUG] [LOCAL ] ELV: Trimmed 73293 records to 50726 (keeping 200 days of data) [2025-11-03T18:41:27.493192] [DEBUG] [LOCAL ] ELV: Primary data saved (50726 records). [2025-11-03T18:41:27.493326] [INFO ] [MAIN ] ELV: Full history saved. [2025-11-03T18:41:27.493394] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. ELV took 41.2s. Estimated remaining: 3h 47m 14s. Rate: 7.2 symbols/min [2025-11-03T18:41:27.649205] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T18:41:27.668342] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:27.683681] [DEBUG] [LOCAL ] EMO: Loaded 13516 existing records from primary storage. [2025-11-03T18:41:27.683902] [INFO ] [MAIN ] EMO: Loaded 13516 existing records. [2025-11-03T18:41:27.867369] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:41:27.867727] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-11-03T18:41:27.867808] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-11-03T18:41:27.868199] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-11-03T18:41:27.868271] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-11-03T18:41:27.938941] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-11-03T18:41:28.190602] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-11-03T18:41:28.280737] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:28.734900] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-11-03T18:41:29.206561] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-11-03T18:41:29.229260] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:41:29.534842] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-11-03T18:41:30.328352] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T18:41:30.334800] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-11-03T18:41:30.864849] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-11-03T18:41:31.134853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-11-03T18:41:31.654473] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-11-03T18:41:31.934853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-11-03T18:41:32.610861] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-11-03T18:41:32.734920] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-11-03T18:41:33.534867] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-11-03T18:41:33.873604] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-11-03T18:41:34.207605] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T18:41:34.334853] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-11-03T18:41:34.879249] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T18:41:35.134932] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-11-03T18:41:35.680928] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-11-03T18:41:35.934894] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-11-03T18:41:36.439548] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-11-03T18:41:36.734901] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-11-03T18:41:37.534939] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-11-03T18:41:37.973806] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T18:41:38.334839] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-11-03T18:41:38.719132] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:41:38.859017] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-11-03T18:41:39.134931] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-11-03T18:41:39.934879] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-11-03T18:41:40.331570] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T18:41:40.551277] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T18:41:40.734871] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-11-03T18:41:41.534828] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-11. [2025-11-03T18:41:41.971526] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T18:41:42.334870] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-11-03T18:41:42.677374] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-11-03T18:41:43.134866] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-11-03T18:41:43.310474] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-11 (1.78 seconds). [2025-11-03T18:41:43.311740] [INFO ] [REMOTE ] EME: Full fetch complete (47316 records). [2025-11-03T18:41:43.311814] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-11-03T18:41:43.642737] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T18:41:43.693929] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-11-03T18:41:43.694010] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-11-03T18:41:43.694687] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-11-03T18:41:43.694750] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-11-03T18:41:43.695793] [DEBUG] [LOCAL ] EME: Trimmed 47316 records to 30672 (keeping 200 days of data) [2025-11-03T18:41:43.883578] [DEBUG] [LOCAL ] EME: Primary data saved (30672 records). [2025-11-03T18:41:43.883744] [INFO ] [MAIN ] EME: Full history saved. [2025-11-03T18:41:43.883826] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EME took 47.3s. Estimated remaining: 3h 47m 24s. Rate: 7.2 symbols/min [2025-11-03T18:41:43.940127] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-11-03T18:41:44.058612] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:44.062664] [DEBUG] [LOCAL ] EMP: Loaded 2856 existing records from primary storage. [2025-11-03T18:41:44.062832] [INFO ] [MAIN ] EMP: Loaded 2856 existing records. [2025-11-03T18:41:44.261178] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:41:44.261410] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-11-03T18:41:44.261455] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-11-03T18:41:44.261622] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-11-03T18:41:44.261707] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-11-03T18:41:44.438974] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-11-03T18:41:44.619752] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:44.734862] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-11-03T18:41:45.195497] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-11-03T18:41:45.534870] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-11-03T18:41:46.285696] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-11-03T18:41:46.334813] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-11-03T18:41:47.008885] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T18:41:47.134847] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-11-03T18:41:47.934902] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-11. [2025-11-03T18:41:48.526326] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T18:41:48.635762] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T18:41:48.636440] [INFO ] [REMOTE ] EMF: Full fetch complete (5856 records). [2025-11-03T18:41:48.636511] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-11-03T18:41:48.740116] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-11. [2025-11-03T18:41:49.047339] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-11-03T18:41:49.047425] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-11-03T18:41:49.047581] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-11-03T18:41:49.047619] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-11-03T18:41:49.048019] [DEBUG] [LOCAL ] EMF: Trimmed 5856 records to 3058 (keeping 200 days of data) [2025-11-03T18:41:49.066457] [DEBUG] [LOCAL ] EMF: Primary data saved (3058 records). [2025-11-03T18:41:49.066586] [INFO ] [MAIN ] EMF: Full history saved. [2025-11-03T18:41:49.066703] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMF took 39.5s. Estimated remaining: 3h 47m 8s. Rate: 7.2 symbols/min [2025-11-03T18:41:49.235209] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:49.285972] [DEBUG] [LOCAL ] EMR: Loaded 53898 existing records from primary storage. [2025-11-03T18:41:49.286277] [INFO ] [MAIN ] EMR: Loaded 53898 existing records. [2025-11-03T18:41:49.456983] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:41:49.457208] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-11-03T18:41:49.460393] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-11-03T18:41:49.461368] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-11-03T18:41:49.461425] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-11-03T18:41:49.539949] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-11-03T18:41:49.810174] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:49.870751] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T18:41:49.897103] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T18:41:49.898020] [INFO ] [REMOTE ] EMO: Full fetch complete (17896 records). [2025-11-03T18:41:49.898089] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-11-03T18:41:50.252340] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-11-03T18:41:50.252457] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-11-03T18:41:50.252884] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-11-03T18:41:50.252944] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-11-03T18:41:50.253719] [DEBUG] [LOCAL ] EMO: Trimmed 17896 records to 13436 (keeping 200 days of data) [2025-11-03T18:41:50.333803] [DEBUG] [LOCAL ] EMO: Primary data saved (13436 records). [2025-11-03T18:41:50.333932] [INFO ] [MAIN ] EMO: Full history saved. [2025-11-03T18:41:50.334065] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EMO took 22.8s. Estimated remaining: 3h 46m 44s. Rate: 7.2 symbols/min [2025-11-03T18:41:50.339927] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-11-03T18:41:50.513416] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:50.560037] [DEBUG] [LOCAL ] ENB: Loaded 54291 existing records from primary storage. [2025-11-03T18:41:50.560351] [INFO ] [MAIN ] ENB: Loaded 54291 existing records. [2025-11-03T18:41:50.742274] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:41:50.742486] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-11-03T18:41:50.742552] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-11-03T18:41:50.743627] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-11-03T18:41:50.743728] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-11-03T18:41:51.086272] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:51.134827] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-11-03T18:41:51.785914] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T18:41:51.934867] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-11-03T18:41:52.660669] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-11-03T18:41:52.734883] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-11-03T18:41:53.535419] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-11-03T18:41:53.535342] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-11-03T18:41:54.235429] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-11-03T18:41:54.334919] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-11-03T18:41:54.934530] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T18:41:55.134881] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-11. [2025-11-03T18:41:55.602243] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T18:41:55.934882] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-11-03T18:41:56.734852] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-11-03T18:41:57.082447] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-11 (1.95 seconds). [2025-11-03T18:41:57.083972] [INFO ] [REMOTE ] EMN: Full fetch complete (72638 records). [2025-11-03T18:41:57.084082] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-11-03T18:41:57.159818] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T18:41:57.491400] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-11-03T18:41:57.491532] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-11-03T18:41:57.492610] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-11-03T18:41:57.492711] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-11-03T18:41:57.526341] [DEBUG] [LOCAL ] EMN: Trimmed 72638 records to 50866 (keeping 200 days of data) [2025-11-03T18:41:57.528450] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T18:41:57.539238] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-11-03T18:41:57.846167] [DEBUG] [LOCAL ] EMN: Primary data saved (50866 records). [2025-11-03T18:41:57.846306] [INFO ] [MAIN ] EMN: Full history saved. [2025-11-03T18:41:57.847101] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EMN took 38.1s. Estimated remaining: 3h 46m 34s. Rate: 7.2 symbols/min [2025-11-03T18:41:58.021272] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:41:58.021454] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-11-03T18:41:58.021510] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-11-03T18:41:58.021623] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-11-03T18:41:58.021700] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-11-03T18:41:58.021757] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-11-03T18:41:58.021790] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-11-03T18:41:58.346471] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-11-03T18:41:58.388102] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:41:58.781977] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T18:41:59.008819] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T18:41:59.134861] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-11-03T18:41:59.934870] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-11-03T18:42:00.734860] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-11-03T18:42:01.534829] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-11-03T18:42:01.653725] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-11-03T18:42:01.896860] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-11-03T18:42:02.098516] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:42:02.334912] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-11-03T18:42:02.495557] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T18:42:03.134885] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-11-03T18:42:03.170286] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T18:42:03.719867] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T18:42:03.934899] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-11-03T18:42:04.734912] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-11-03T18:42:05.478975] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T18:42:05.534859] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-11-03T18:42:05.790450] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T18:42:06.334901] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-11-03T18:42:06.777187] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T18:42:07.054371] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T18:42:07.134823] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-11-03T18:42:07.522993] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T18:42:07.934896] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-11-03T18:42:08.299508] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-11-03T18:42:08.734845] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-11-03T18:42:09.534817] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-11-03T18:42:09.744445] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-11-03T18:42:10.334851] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-11-03T18:42:10.661168] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-11-03T18:42:10.836993] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T18:42:11.134947] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-11-03T18:42:11.934909] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-11-03T18:42:12.648973] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T18:42:12.734877] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-11. [2025-11-03T18:42:13.224573] [DEBUG] [REMOTE ] EMP: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:42:13.224922] [WARN ] [REMOTE ] EMP: No data returned for month 2025-11 [2025-11-03T18:42:13.225013] [FATAL] [REMOTE ] EMP: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:42:13.225113] [FATAL] [MAIN ] EMP: Failed to fetch primary data. [2025-11-03T18:42:13.225193] [WARN ] [MAIN ] EMP: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:42:13.225279] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-11-03T18:42:13.225380] [DEBUG] [LOCAL ] EMP: No primary data file found to delete. [2025-11-03T18:42:13.225433] [INFO ] [LOCAL ] EMP: Starting deletion of derivative data. [2025-11-03T18:42:13.225634] [DEBUG] [LOCAL ] EMP: Deleted derivative data file. [2025-11-03T18:42:13.225772] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. EMP took 29.3s. Estimated remaining: 3h 46m 42s. Rate: 7.2 symbols/min [2025-11-03T18:42:13.412205] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:42:13.416002] [DEBUG] [LOCAL ] ENO: Loaded 1575 existing records from primary storage. [2025-11-03T18:42:13.416244] [INFO ] [MAIN ] ENO: Loaded 1575 existing records. [2025-11-03T18:42:13.537567] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-11-03T18:42:13.611885] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:42:13.612236] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-11-03T18:42:13.612315] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-11-03T18:42:13.612686] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-11-03T18:42:13.612804] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-11-03T18:42:13.756213] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-11-03T18:42:14.024846] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:42:14.334854] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-11-03T18:42:15.026036] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T18:42:15.134861] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-11-03T18:42:15.797380] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T18:42:15.934857] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-11-03T18:42:16.465557] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T18:42:16.734887] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-11-03T18:42:17.312846] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-11-03T18:42:17.348415] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T18:42:17.534870] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-11-03T18:42:18.334847] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-11-03T18:42:19.052554] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T18:42:19.134898] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-11-03T18:42:19.512816] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-11-03T18:42:19.651813] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-11-03T18:42:19.934930] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-11-03T18:42:20.241135] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-11-03T18:42:20.734928] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-11-03T18:42:21.534936] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-11-03T18:42:22.181994] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T18:42:22.335023] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-11-03T18:42:22.335091] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-11-03T18:42:23.134857] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-11-03T18:42:23.934823] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-11-03T18:42:24.222412] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T18:42:24.265388] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-11-03T18:42:24.280935] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T18:42:24.734845] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-11-03T18:42:25.534840] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-11. [2025-11-03T18:42:25.668328] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T18:42:26.334856] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-11-03T18:42:26.615394] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-11-03T18:42:26.619525] [DEBUG] [REMOTE ] ENB: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:42:26.619896] [WARN ] [REMOTE ] ENB: No data returned for month 2025-11 [2025-11-03T18:42:26.620003] [FATAL] [REMOTE ] ENB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:42:26.620123] [FATAL] [MAIN ] ENB: Failed to fetch primary data. [2025-11-03T18:42:26.620204] [WARN ] [MAIN ] ENB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:42:26.620292] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-11-03T18:42:26.620368] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-11-03T18:42:26.620408] [INFO ] [LOCAL ] ENB: Starting deletion of derivative data. [2025-11-03T18:42:26.620551] [DEBUG] [LOCAL ] ENB: Deleted derivative data file. [2025-11-03T18:42:26.620618] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. ENB took 36.3s. Estimated remaining: 3h 46m 44s. Rate: 7.2 symbols/min [2025-11-03T18:42:26.807975] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:42:26.808170] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-11-03T18:42:26.808212] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-11-03T18:42:26.808353] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-11-03T18:42:26.808417] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-11-03T18:42:26.808468] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-11-03T18:42:26.808501] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-11-03T18:42:27.148083] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-11-03T18:42:27.187794] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:42:27.559721] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T18:42:27.934906] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-11-03T18:42:28.234354] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-11-03T18:42:28.734859] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-11-03T18:42:28.954762] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-11-03T18:42:29.534875] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-11-03T18:42:29.817033] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-11-03T18:42:30.334875] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-11-03T18:42:31.134874] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-11-03T18:42:31.448947] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T18:42:31.449093] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-11-03T18:42:31.934876] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-11-03T18:42:32.734905] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-11. [2025-11-03T18:42:33.249125] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:42:33.534906] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-11-03T18:42:33.937832] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T18:42:33.939328] [INFO ] [REMOTE ] EMR: Full fetch complete (77180 records). [2025-11-03T18:42:33.939425] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-11-03T18:42:34.333182] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-11-03T18:42:34.333287] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-11-03T18:42:34.334255] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-11-03T18:42:34.334318] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-11-03T18:42:34.335048] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-11. [2025-11-03T18:42:34.337147] [DEBUG] [LOCAL ] EMR: Trimmed 77180 records to 53117 (keeping 200 days of data) [2025-11-03T18:42:34.674291] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T18:42:34.707626] [DEBUG] [LOCAL ] EMR: Primary data saved (53117 records). [2025-11-03T18:42:34.707802] [INFO ] [MAIN ] EMR: Full history saved. [2025-11-03T18:42:34.708565] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. EMR took 45.6s. Estimated remaining: 3h 46m 36s. Rate: 7.2 symbols/min [2025-11-03T18:42:34.733162] [DEBUG] [REMOTE ] ENO: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:42:34.760586] [WARN ] [REMOTE ] ENO: No data returned for month 2025-11 [2025-11-03T18:42:34.800797] [FATAL] [REMOTE ] ENO: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:42:34.816244] [FATAL] [MAIN ] ENO: Failed to fetch primary data. [2025-11-03T18:42:34.833716] [WARN ] [MAIN ] ENO: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:42:34.837471] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-11-03T18:42:34.843498] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-11-03T18:42:34.853949] [INFO ] [LOCAL ] ENO: Starting deletion of derivative data. [2025-11-03T18:42:34.869592] [DEBUG] [LOCAL ] ENO: Deleted derivative data file. [2025-11-03T18:42:34.915241] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. ENO took 21.7s. Estimated remaining: 3h 46m 9s. Rate: 7.2 symbols/min [2025-11-03T18:42:34.917940] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:42:35.094494] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:42:35.124870] [DEBUG] [LOCAL ] ENR: Loaded 44187 existing records from primary storage. [2025-11-03T18:42:35.133873] [INFO ] [MAIN ] ENR: Loaded 44187 existing records. [2025-11-03T18:42:35.144859] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-11-03T18:42:35.277586] [DEBUG] [LOCAL ] ENS: Loaded 29944 existing records from primary storage. [2025-11-03T18:42:35.300761] [INFO ] [MAIN ] ENS: Loaded 29944 existing records. [2025-11-03T18:42:35.409946] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:42:35.436464] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-11-03T18:42:35.436590] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-11-03T18:42:35.442523] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-11-03T18:42:35.442605] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-11-03T18:42:35.626108] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:42:35.641720] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-11-03T18:42:35.662775] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-11-03T18:42:35.714417] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-11-03T18:42:35.734701] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-11-03T18:42:35.944578] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-11. [2025-11-03T18:42:36.077996] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:42:36.278956] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:42:36.300080] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T18:42:36.734915] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-11-03T18:42:37.496567] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-11 (1.55 seconds). [2025-11-03T18:42:37.497868] [INFO ] [REMOTE ] ENIC: Full fetch complete (50981 records). [2025-11-03T18:42:37.497955] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-11-03T18:42:37.540963] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-11-03T18:42:37.887312] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-11-03T18:42:37.887427] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-11-03T18:42:37.888284] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-11-03T18:42:37.888388] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-11-03T18:42:37.889710] [DEBUG] [LOCAL ] ENIC: Trimmed 50981 records to 35929 (keeping 200 days of data) [2025-11-03T18:42:37.967175] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:42:38.121934] [DEBUG] [LOCAL ] ENIC: Primary data saved (35929 records). [2025-11-03T18:42:38.122133] [INFO ] [MAIN ] ENIC: Full history saved. [2025-11-03T18:42:38.122252] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENIC took 40.3s. Estimated remaining: 3h 45m 50s. Rate: 7.2 symbols/min [2025-11-03T18:42:38.294154] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:42:38.294335] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-11-03T18:42:38.294373] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-11-03T18:42:38.294499] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-11-03T18:42:38.294540] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-11-03T18:42:38.294581] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-11-03T18:42:38.294614] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-11-03T18:42:38.340085] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-11-03T18:42:38.655411] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:42:38.746305] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T18:42:39.134908] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-11-03T18:42:39.603194] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T18:42:39.934919] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-11-03T18:42:40.174856] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T18:42:40.734901] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-11-03T18:42:41.160278] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T18:42:41.534876] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-11-03T18:42:41.775142] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T18:42:42.334876] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-11-03T18:42:42.772401] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T18:42:43.085135] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T18:42:43.134875] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-11-03T18:42:43.934924] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-11-03T18:42:44.053524] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-11-03T18:42:44.734929] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-11-03T18:42:45.254296] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:42:45.534922] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-11-03T18:42:45.691377] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T18:42:46.334908] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-11-03T18:42:46.363232] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T18:42:47.134827] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-11-03T18:42:47.258231] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T18:42:47.934906] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-11-03T18:42:48.351037] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T18:42:48.734883] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-11-03T18:42:49.304334] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:42:49.534958] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-11-03T18:42:49.726485] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T18:42:50.334910] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-11-03T18:42:50.415150] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T18:42:51.134929] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-11-03T18:42:51.434629] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:42:51.904558] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T18:42:51.934886] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-11-03T18:42:52.734874] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-11-03T18:42:52.929751] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T18:42:53.534890] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-11-03T18:42:53.701609] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T18:42:54.334949] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-11-03T18:42:54.638723] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:42:55.134945] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-11-03T18:42:55.402760] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T18:42:55.934970] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-11-03T18:42:56.291161] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:42:56.734963] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-11-03T18:42:57.119558] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T18:42:57.534958] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-11-03T18:42:57.755364] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T18:42:58.334918] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-11. [2025-11-03T18:42:58.574872] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-11-03T18:42:59.134914] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-11. [2025-11-03T18:42:59.909576] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-11 (1.57 seconds). [2025-11-03T18:42:59.910628] [INFO ] [REMOTE ] ENS: Full fetch complete (43030 records). [2025-11-03T18:42:59.910728] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-11-03T18:42:59.941691] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-11-03T18:43:00.285031] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-11-03T18:43:00.285109] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-11-03T18:43:00.285748] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-11-03T18:43:00.285808] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-11-03T18:43:00.286811] [DEBUG] [LOCAL ] ENS: Trimmed 43030 records to 29584 (keeping 200 days of data) [2025-11-03T18:43:00.464818] [DEBUG] [LOCAL ] ENS: Primary data saved (29584 records). [2025-11-03T18:43:00.464954] [INFO ] [MAIN ] ENS: Full history saved. [2025-11-03T18:43:00.465551] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENS took 25.5s. Estimated remaining: 3h 46m 12s. Rate: 7.2 symbols/min [2025-11-03T18:43:00.636745] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:00.652675] [DEBUG] [LOCAL ] EOD: Loaded 15024 existing records from primary storage. [2025-11-03T18:43:00.652944] [INFO ] [MAIN ] EOD: Loaded 15024 existing records. [2025-11-03T18:43:00.746070] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-11-03T18:43:00.834752] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:00.834963] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-11-03T18:43:00.835009] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-11-03T18:43:00.835410] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-11-03T18:43:00.835467] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-11-03T18:43:01.044400] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-11 (1.91 seconds). [2025-11-03T18:43:01.076759] [INFO ] [REMOTE ] ENOV: Full fetch complete (63191 records). [2025-11-03T18:43:01.098880] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-11-03T18:43:01.376382] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:01.547453] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-11-03T18:43:01.548603] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-11-03T18:43:01.700242] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-11-03T18:43:01.700339] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-11-03T18:43:01.701257] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-11-03T18:43:01.701322] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-11-03T18:43:01.702788] [DEBUG] [LOCAL ] ENOV: Trimmed 63191 records to 44489 (keeping 200 days of data) [2025-11-03T18:43:01.972709] [DEBUG] [LOCAL ] ENOV: Primary data saved (44489 records). [2025-11-03T18:43:01.972842] [INFO ] [MAIN ] ENOV: Full history saved. [2025-11-03T18:43:01.972915] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENOV took 35.4s. Estimated remaining: 3h 45m 49s. Rate: 7.2 symbols/min [2025-11-03T18:43:02.143894] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:02.193953] [DEBUG] [LOCAL ] EOG: Loaded 54166 existing records from primary storage. [2025-11-03T18:43:02.194328] [INFO ] [MAIN ] EOG: Loaded 54166 existing records. [2025-11-03T18:43:02.339240] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-11-03T18:43:02.383219] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:02.383941] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-11-03T18:43:02.384115] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-11-03T18:43:02.385396] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-11-03T18:43:02.385475] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-11-03T18:43:02.532219] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T18:43:02.794781] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:02.821112] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-11-03T18:43:03.134821] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-11-03T18:43:03.153693] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T18:43:03.934871] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-11-03T18:43:04.486309] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:43:04.735007] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-11-03T18:43:05.534930] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-11-03T18:43:05.722475] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-11-03T18:43:06.028043] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T18:43:06.203146] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T18:43:06.334904] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-11-03T18:43:06.893281] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T18:43:07.134848] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-11-03T18:43:07.934865] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-11-03T18:43:08.734824] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-11-03T18:43:08.788431] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T18:43:08.961995] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-11-03T18:43:09.534874] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-11-03T18:43:09.817638] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T18:43:10.334945] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-11-03T18:43:10.408223] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T18:43:10.931789] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-11-03T18:43:11.134927] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-10. [2025-11-03T18:43:11.934830] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-11-03T18:43:12.387037] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-11-03T18:43:12.586185] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T18:43:12.734910] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-11-03T18:43:13.367871] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T18:43:13.534826] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-11-03T18:43:14.334855] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-11. [2025-11-03T18:43:15.134851] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-11-03T18:43:15.435539] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-11-03T18:43:15.934913] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-11-03T18:43:16.134410] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-11 (1.80 seconds). [2025-11-03T18:43:16.135850] [INFO ] [REMOTE ] ENR: Full fetch complete (60150 records). [2025-11-03T18:43:16.135927] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-11-03T18:43:16.274037] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T18:43:16.539509] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-11-03T18:43:16.539589] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-11-03T18:43:16.540368] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-11-03T18:43:16.540430] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-11-03T18:43:16.541714] [DEBUG] [LOCAL ] ENR: Trimmed 60150 records to 43704 (keeping 200 days of data) [2025-11-03T18:43:16.747292] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-11-03T18:43:16.812421] [DEBUG] [LOCAL ] ENR: Primary data saved (43704 records). [2025-11-03T18:43:16.812555] [INFO ] [MAIN ] ENR: Full history saved. [2025-11-03T18:43:16.813436] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENR took 42.1s. Estimated remaining: 3h 45m 55s. Rate: 7.2 symbols/min [2025-11-03T18:43:17.018391] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:17.036533] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T18:43:17.051441] [DEBUG] [LOCAL ] EOI: Loaded 10071 existing records from primary storage. [2025-11-03T18:43:17.051717] [INFO ] [MAIN ] EOI: Loaded 10071 existing records. [2025-11-03T18:43:17.325761] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:17.326779] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-11-03T18:43:17.326889] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-11-03T18:43:17.327247] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-11-03T18:43:17.327346] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-11-03T18:43:17.553374] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-11-03T18:43:17.916273] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:17.910252] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T18:43:18.334841] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-11-03T18:43:19.096571] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-11-03T18:43:19.134874] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-11-03T18:43:19.238625] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-11-03T18:43:19.934859] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-11-03T18:43:20.732207] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-11-03T18:43:20.735152] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-11-03T18:43:21.366597] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T18:43:21.534875] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-11-03T18:43:22.334885] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-11-03T18:43:22.396574] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-11-03T18:43:22.444049] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T18:43:23.123506] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T18:43:23.134797] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-11. [2025-11-03T18:43:23.934856] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-11-03T18:43:24.189273] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T18:43:24.190291] [INFO ] [REMOTE ] EOD: Full fetch complete (21028 records). [2025-11-03T18:43:24.190360] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-11-03T18:43:24.557414] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-11-03T18:43:24.557516] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-11-03T18:43:24.557985] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-11-03T18:43:24.558044] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-11-03T18:43:24.558593] [DEBUG] [LOCAL ] EOD: Trimmed 21028 records to 14876 (keeping 200 days of data) [2025-11-03T18:43:24.641621] [DEBUG] [LOCAL ] EOD: Primary data saved (14876 records). [2025-11-03T18:43:24.641808] [INFO ] [MAIN ] EOD: Full history saved. [2025-11-03T18:43:24.641914] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. EOD took 24.2s. Estimated remaining: 3h 45m 45s. Rate: 7.2 symbols/min [2025-11-03T18:43:24.740783] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-11-03T18:43:24.822171] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:24.822563] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-11-03T18:43:24.822635] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-11-03T18:43:24.822845] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-11-03T18:43:24.822984] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-11-03T18:43:24.823170] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-11-03T18:43:24.823284] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-11-03T18:43:24.981200] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-11-03T18:43:25.200483] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:25.534846] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-11. [2025-11-03T18:43:25.860052] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-11-03T18:43:26.334864] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-11-03T18:43:26.830360] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T18:43:26.831409] [INFO ] [REMOTE ] ENVA: Full fetch complete (36777 records). [2025-11-03T18:43:26.831494] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-11-03T18:43:27.139092] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-11-03T18:43:27.179915] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T18:43:27.234321] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-11-03T18:43:27.234395] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-11-03T18:43:27.235028] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-11-03T18:43:27.235088] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-11-03T18:43:27.235879] [DEBUG] [LOCAL ] ENVA: Trimmed 36777 records to 24880 (keeping 200 days of data) [2025-11-03T18:43:27.379388] [DEBUG] [LOCAL ] ENVA: Primary data saved (24880 records). [2025-11-03T18:43:27.379514] [INFO ] [MAIN ] ENVA: Full history saved. [2025-11-03T18:43:27.379582] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. ENVA took 49.3s. Estimated remaining: 3h 45m 25s. Rate: 7.2 symbols/min [2025-11-03T18:43:27.562578] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:27.572298] [DEBUG] [LOCAL ] EOT: Loaded 7072 existing records from primary storage. [2025-11-03T18:43:27.572529] [INFO ] [MAIN ] EOT: Loaded 7072 existing records. [2025-11-03T18:43:27.762940] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:27.763249] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-11-03T18:43:27.763326] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-11-03T18:43:27.769573] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-11-03T18:43:27.770411] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T18:43:27.770178] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-11-03T18:43:27.945378] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-11-03T18:43:28.133721] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:28.516886] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-11-03T18:43:28.734865] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-11-03T18:43:29.497715] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-11-03T18:43:29.534855] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-11-03T18:43:30.056599] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T18:43:30.334835] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-11-03T18:43:30.779751] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-11-03T18:43:31.134988] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-11-03T18:43:31.703122] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T18:43:31.934904] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-11-03T18:43:32.701948] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T18:43:32.734888] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-11-03T18:43:33.261932] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T18:43:33.534914] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-11-03T18:43:34.334882] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-11-03T18:43:34.997399] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-11-03T18:43:35.134897] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-11-03T18:43:35.298826] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-11-03T18:43:35.934933] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-11-03T18:43:36.221242] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T18:43:36.734917] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-11-03T18:43:37.401502] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T18:43:37.418637] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T18:43:37.534857] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-11-03T18:43:37.999223] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-11-03T18:43:38.334913] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-11-03T18:43:38.885273] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-11-03T18:43:39.134872] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-11-03T18:43:39.835579] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T18:43:39.934874] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-11-03T18:43:40.642277] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T18:43:40.734875] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-11-03T18:43:41.348397] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T18:43:41.534846] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-11. [2025-11-03T18:43:42.334899] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-11-03T18:43:42.400378] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T18:43:42.401223] [INFO ] [REMOTE ] EOI: Full fetch complete (15839 records). [2025-11-03T18:43:42.401290] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-11-03T18:43:42.758688] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-11-03T18:43:42.758761] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-11-03T18:43:42.759097] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-11-03T18:43:42.759134] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-11-03T18:43:42.759592] [DEBUG] [LOCAL ] EOI: Trimmed 15839 records to 9889 (keeping 200 days of data) [2025-11-03T18:43:42.818816] [DEBUG] [LOCAL ] EOI: Primary data saved (9889 records). [2025-11-03T18:43:42.818930] [INFO ] [MAIN ] EOI: Full history saved. [2025-11-03T18:43:42.819005] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. EOI took 26.0s. Estimated remaining: 3h 45m 32s. Rate: 7.2 symbols/min [2025-11-03T18:43:42.944082] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T18:43:42.997772] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:43.024285] [DEBUG] [LOCAL ] EPAC: Loaded 26468 existing records from primary storage. [2025-11-03T18:43:43.024613] [INFO ] [MAIN ] EPAC: Loaded 26468 existing records. [2025-11-03T18:43:43.140033] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-11-03T18:43:43.204375] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:43.204553] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-11-03T18:43:43.204600] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-11-03T18:43:43.205092] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-11-03T18:43:43.205148] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-11-03T18:43:43.553873] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:43.934893] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-11-03T18:43:44.186897] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T18:43:44.734913] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-11-03T18:43:44.824383] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:43:45.334126] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T18:43:45.534869] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-11-03T18:43:46.334892] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-11-03T18:43:46.407481] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T18:43:47.134908] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-11. [2025-11-03T18:43:47.850965] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T18:43:47.851710] [INFO ] [REMOTE ] EOT: Full fetch complete (10641 records). [2025-11-03T18:43:47.851784] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-11-03T18:43:47.935453] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-11-03T18:43:48.232824] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-11-03T18:43:48.232955] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-11-03T18:43:48.233326] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-11-03T18:43:48.233454] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-11-03T18:43:48.250228] [DEBUG] [LOCAL ] EOT: Trimmed 10641 records to 6936 (keeping 200 days of data) [2025-11-03T18:43:48.283700] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-11-03T18:43:48.324616] [DEBUG] [LOCAL ] EOT: Primary data saved (6936 records). [2025-11-03T18:43:48.324937] [INFO ] [MAIN ] EOT: Full history saved. [2025-11-03T18:43:48.325031] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EOT took 20.9s. Estimated remaining: 3h 45m 17s. Rate: 7.2 symbols/min [2025-11-03T18:43:48.494910] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:48.531339] [DEBUG] [LOCAL ] EPAM: Loaded 39545 existing records from primary storage. [2025-11-03T18:43:48.531705] [INFO ] [MAIN ] EPAM: Loaded 39545 existing records. [2025-11-03T18:43:48.713333] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:48.722206] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-11-03T18:43:48.722880] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-11-03T18:43:48.723260] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T18:43:48.726460] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-11-03T18:43:48.727060] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-11-03T18:43:48.739941] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-11-03T18:43:49.085446] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:49.534852] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-11-03T18:43:50.244970] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T18:43:50.334906] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-11-03T18:43:50.483091] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-11-03T18:43:50.879160] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-11-03T18:43:51.134871] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-11-03T18:43:51.934842] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-11-03T18:43:52.064414] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T18:43:52.734877] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-11-03T18:43:52.928347] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T18:43:53.534897] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-11-03T18:43:54.149118] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T18:43:54.334834] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-11-03T18:43:54.668942] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T18:43:55.134849] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-11-03T18:43:55.872152] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T18:43:55.934874] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-11-03T18:43:56.325892] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T18:43:56.673811] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T18:43:56.734889] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-11. [2025-11-03T18:43:57.534841] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-11-03T18:43:57.938851] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T18:43:57.940537] [INFO ] [REMOTE ] EOG: Full fetch complete (77468 records). [2025-11-03T18:43:57.940739] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-11-03T18:43:58.337367] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-11-03T18:43:58.366356] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-11-03T18:43:58.366636] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-11-03T18:43:58.368160] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-11-03T18:43:58.368684] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-11-03T18:43:58.387624] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T18:43:58.394389] [DEBUG] [LOCAL ] EOG: Trimmed 77468 records to 53388 (keeping 200 days of data) [2025-11-03T18:43:58.721458] [DEBUG] [LOCAL ] EOG: Primary data saved (53388 records). [2025-11-03T18:43:58.721585] [INFO ] [MAIN ] EOG: Full history saved. [2025-11-03T18:43:58.722197] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOG took 56.7s. Estimated remaining: 3h 45m 13s. Rate: 7.2 symbols/min [2025-11-03T18:43:58.887809] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:43:58.925712] [DEBUG] [LOCAL ] EPC: Loaded 40145 existing records from primary storage. [2025-11-03T18:43:58.926036] [INFO ] [MAIN ] EPC: Loaded 40145 existing records. [2025-11-03T18:43:59.118302] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:43:59.118559] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-11-03T18:43:59.118746] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-11-03T18:43:59.124694] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-11-03T18:43:59.129999] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-11-03T18:43:59.141957] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-11-03T18:43:59.142892] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T18:43:59.491139] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:43:59.941684] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-11. [2025-11-03T18:43:59.945314] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T18:44:00.734851] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-11-03T18:44:01.091763] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-11 (1.15 seconds). [2025-11-03T18:44:01.092679] [INFO ] [REMOTE ] EOS: Full fetch complete (22925 records). [2025-11-03T18:44:01.092751] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-11-03T18:44:01.490537] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-11-03T18:44:01.490636] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-11-03T18:44:01.491188] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-11-03T18:44:01.491250] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-11-03T18:44:01.492090] [DEBUG] [LOCAL ] EOS: Trimmed 22925 records to 14388 (keeping 200 days of data) [2025-11-03T18:44:01.536001] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-11-03T18:44:01.583378] [DEBUG] [LOCAL ] EOS: Primary data saved (14388 records). [2025-11-03T18:44:01.583500] [INFO ] [MAIN ] EOS: Full history saved. [2025-11-03T18:44:01.583569] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOS took 36.9s. Estimated remaining: 3h 44m 53s. Rate: 7.2 symbols/min [2025-11-03T18:44:01.815856] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:44:01.867466] [DEBUG] [LOCAL ] EPD: Loaded 54386 existing records from primary storage. [2025-11-03T18:44:01.867872] [INFO ] [MAIN ] EPD: Loaded 54386 existing records. [2025-11-03T18:44:02.050774] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:44:02.051082] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-11-03T18:44:02.051188] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-11-03T18:44:02.052149] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-11-03T18:44:02.052205] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-11-03T18:44:02.335842] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-11-03T18:44:02.417408] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:44:02.441683] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-11-03T18:44:02.583837] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T18:44:03.134892] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-11-03T18:44:03.200770] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T18:44:03.934873] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-11-03T18:44:04.363503] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T18:44:04.734860] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-11-03T18:44:04.754584] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T18:44:05.534878] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-11-03T18:44:06.033938] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:44:06.334859] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-11-03T18:44:06.402865] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T18:44:07.134872] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-11-03T18:44:07.525915] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T18:44:07.934902] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-11-03T18:44:08.734851] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-11-03T18:44:08.791424] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T18:44:08.899588] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-11-03T18:44:09.534891] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-11-03T18:44:09.749402] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-11-03T18:44:10.334876] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-11-03T18:44:10.866612] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T18:44:11.134887] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-11-03T18:44:11.178590] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T18:44:11.934824] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-11-03T18:44:12.033697] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-11-03T18:44:12.734869] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-11-03T18:44:13.063611] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T18:44:13.534847] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-11. [2025-11-03T18:44:14.215502] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T18:44:14.334839] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-11-03T18:44:14.820837] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-11 (1.29 seconds). [2025-11-03T18:44:14.821888] [INFO ] [REMOTE ] EPAC: Full fetch complete (38806 records). [2025-11-03T18:44:14.821959] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-11-03T18:44:15.143371] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-11-03T18:44:15.192303] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-11-03T18:44:15.192388] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-11-03T18:44:15.192992] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-11-03T18:44:15.193052] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-11-03T18:44:15.193883] [DEBUG] [LOCAL ] EPAC: Trimmed 38806 records to 26093 (keeping 200 days of data) [2025-11-03T18:44:15.345683] [DEBUG] [LOCAL ] EPAC: Primary data saved (26093 records). [2025-11-03T18:44:15.345819] [INFO ] [MAIN ] EPAC: Full history saved. [2025-11-03T18:44:15.345899] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EPAC took 32.5s. Estimated remaining: 3h 44m 56s. Rate: 7.2 symbols/min [2025-11-03T18:44:15.511165] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:44:15.548712] [DEBUG] [LOCAL ] EPR: Loaded 44161 existing records from primary storage. [2025-11-03T18:44:15.548993] [INFO ] [MAIN ] EPR: Loaded 44161 existing records. [2025-11-03T18:44:15.726177] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:44:15.726364] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-11-03T18:44:15.726410] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-11-03T18:44:15.727182] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-11-03T18:44:15.727239] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-11-03T18:44:15.937043] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-11-03T18:44:16.087168] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:44:16.128151] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-11-03T18:44:16.309432] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T18:44:16.734860] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-11-03T18:44:17.226635] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T18:44:17.534845] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-11-03T18:44:17.941255] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T18:44:18.334883] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-11-03T18:44:18.778884] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T18:44:19.134860] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-11-03T18:44:19.430106] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T18:44:19.934863] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-11-03T18:44:20.268626] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T18:44:20.734910] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-11-03T18:44:21.049737] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T18:44:21.534837] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-11-03T18:44:21.967241] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T18:44:22.334885] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-11-03T18:44:22.718156] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T18:44:23.134859] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-11-03T18:44:23.526611] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T18:44:23.934847] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-11-03T18:44:24.386259] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T18:44:24.734819] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-11-03T18:44:25.478401] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T18:44:25.534918] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-11-03T18:44:26.064389] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T18:44:26.334879] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-11. [2025-11-03T18:44:26.988941] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T18:44:27.134876] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-11-03T18:44:27.934907] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-11-03T18:44:28.235944] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-11 (1.90 seconds). [2025-11-03T18:44:28.237306] [INFO ] [REMOTE ] EPAM: Full fetch complete (57090 records). [2025-11-03T18:44:28.237390] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-11-03T18:44:28.576795] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T18:44:28.659844] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-11-03T18:44:28.659917] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-11-03T18:44:28.660668] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-11-03T18:44:28.660729] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-11-03T18:44:28.661813] [DEBUG] [LOCAL ] EPAM: Trimmed 57090 records to 38876 (keeping 200 days of data) [2025-11-03T18:44:28.745452] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-11-03T18:44:28.889305] [DEBUG] [LOCAL ] EPAM: Primary data saved (38876 records). [2025-11-03T18:44:28.889432] [INFO ] [MAIN ] EPAM: Full history saved. [2025-11-03T18:44:28.890034] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPAM took 40.6s. Estimated remaining: 3h 44m 59s. Rate: 7.2 symbols/min [2025-11-03T18:44:29.057602] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:44:29.100460] [DEBUG] [LOCAL ] EPRT: Loaded 49094 existing records from primary storage. [2025-11-03T18:44:29.100790] [INFO ] [MAIN ] EPRT: Loaded 49094 existing records. [2025-11-03T18:44:29.281157] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:44:29.281380] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-11-03T18:44:29.281450] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-11-03T18:44:29.282371] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-11-03T18:44:29.282432] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-11-03T18:44:29.539728] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-11-03T18:44:29.654639] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:44:29.684548] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T18:44:29.857914] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-11-03T18:44:30.334894] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-11-03T18:44:30.698690] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-11-03T18:44:31.134907] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-11-03T18:44:31.786559] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T18:44:31.934834] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-11-03T18:44:32.292422] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T18:44:32.734862] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-11-03T18:44:33.101471] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T18:44:33.534854] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-11-03T18:44:34.200557] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T18:44:34.334831] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-11. [2025-11-03T18:44:34.665970] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T18:44:35.134852] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-11-03T18:44:35.934879] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-11-03T18:44:36.022293] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-11 (1.69 seconds). [2025-11-03T18:44:36.023595] [INFO ] [REMOTE ] EPC: Full fetch complete (57505 records). [2025-11-03T18:44:36.023712] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-11-03T18:44:36.427053] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-11-03T18:44:36.427334] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-11-03T18:44:36.428955] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-11-03T18:44:36.429052] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-11-03T18:44:36.442815] [DEBUG] [LOCAL ] EPC: Trimmed 57505 records to 39708 (keeping 200 days of data) [2025-11-03T18:44:36.520047] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T18:44:36.716994] [DEBUG] [LOCAL ] EPC: Primary data saved (39708 records). [2025-11-03T18:44:36.717168] [INFO ] [MAIN ] EPC: Full history saved. [2025-11-03T18:44:36.717279] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPC took 38.0s. Estimated remaining: 3h 44m 50s. Rate: 7.2 symbols/min [2025-11-03T18:44:36.739927] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-11-03T18:44:36.891217] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:44:36.891386] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-11-03T18:44:36.891423] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-11-03T18:44:36.891531] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-11-03T18:44:36.891574] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-11-03T18:44:36.891615] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-11-03T18:44:36.891673] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-11-03T18:44:37.255172] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:44:37.534830] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-11-03T18:44:37.595302] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-11-03T18:44:38.029720] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T18:44:38.181990] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-11-03T18:44:38.334949] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-11-03T18:44:39.134920] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-11-03T18:44:39.509314] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T18:44:39.697668] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T18:44:39.934875] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-11. [2025-11-03T18:44:40.734890] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-11-03T18:44:41.275592] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-11-03T18:44:41.534889] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-11-03T18:44:42.181350] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-11-03T18:44:42.214055] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-11 (2.28 seconds). [2025-11-03T18:44:42.216017] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-11-03T18:44:42.216181] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-11-03T18:44:42.340022] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-11-03T18:44:42.656927] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-11-03T18:44:42.657000] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-11-03T18:44:42.658110] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-11-03T18:44:42.658177] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-11-03T18:44:42.659635] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53606 (keeping 200 days of data) [2025-11-03T18:44:43.003223] [DEBUG] [LOCAL ] EPD: Primary data saved (53606 records). [2025-11-03T18:44:43.003366] [INFO ] [MAIN ] EPD: Full history saved. [2025-11-03T18:44:43.003901] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPD took 41.4s. Estimated remaining: 3h 44m 37s. Rate: 7.2 symbols/min [2025-11-03T18:44:43.141866] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-11-03T18:44:43.174074] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:44:43.221901] [DEBUG] [LOCAL ] EQH: Loaded 53422 existing records from primary storage. [2025-11-03T18:44:43.222210] [INFO ] [MAIN ] EQH: Loaded 53422 existing records. [2025-11-03T18:44:43.406333] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:44:43.406695] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-11-03T18:44:43.406756] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-11-03T18:44:43.407746] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-11-03T18:44:43.407805] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-11-03T18:44:43.706019] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-11-03T18:44:43.789186] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:44:43.821440] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T18:44:43.934862] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-11-03T18:44:44.734908] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-11-03T18:44:45.107575] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T18:44:45.221054] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T18:44:45.534854] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-11-03T18:44:46.334874] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-11-03T18:44:46.711587] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T18:44:46.879686] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-11-03T18:44:47.134855] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-11-03T18:44:47.934867] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-11-03T18:44:48.435762] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T18:44:48.734855] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-11-03T18:44:49.057740] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-11-03T18:44:49.400890] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-11-03T18:44:49.534835] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-11. [2025-11-03T18:44:50.334925] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-11-03T18:44:51.134882] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-11-03T18:44:51.343136] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T18:44:51.344551] [INFO ] [REMOTE ] EPR: Full fetch complete (63496 records). [2025-11-03T18:44:51.344628] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-11-03T18:44:51.759624] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T18:44:51.786421] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-11-03T18:44:51.786670] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-11-03T18:44:51.787798] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-11-03T18:44:51.787910] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-11-03T18:44:51.789443] [DEBUG] [LOCAL ] EPR: Trimmed 63496 records to 43642 (keeping 200 days of data) [2025-11-03T18:44:51.920486] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-11-03T18:44:51.939611] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-11-03T18:44:52.111729] [DEBUG] [LOCAL ] EPR: Primary data saved (43642 records). [2025-11-03T18:44:52.111852] [INFO ] [MAIN ] EPR: Full history saved. [2025-11-03T18:44:52.112600] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EPR took 36.8s. Estimated remaining: 3h 44m 30s. Rate: 7.2 symbols/min [2025-11-03T18:44:52.277475] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:44:52.325218] [DEBUG] [LOCAL ] EQNR: Loaded 53807 existing records from primary storage. [2025-11-03T18:44:52.325511] [INFO ] [MAIN ] EQNR: Loaded 53807 existing records. [2025-11-03T18:44:52.498091] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:44:52.498283] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-11-03T18:44:52.498330] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-11-03T18:44:52.499288] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-11-03T18:44:52.499345] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-11-03T18:44:52.744585] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-11-03T18:44:52.851509] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:44:53.172381] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T18:44:53.534857] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-11-03T18:44:53.892323] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:44:54.334865] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-11-03T18:44:54.907372] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:44:55.134876] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-11-03T18:44:55.698947] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:44:55.934944] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-11-03T18:44:56.431481] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T18:44:56.734870] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-11-03T18:44:57.375999] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-11-03T18:44:57.534874] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-11-03T18:44:57.945723] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:44:58.334919] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-11-03T18:44:58.690900] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T18:44:59.033826] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T18:44:59.134850] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-11-03T18:44:59.934865] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-11-03T18:45:00.497050] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T18:45:00.734865] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-11. [2025-11-03T18:45:01.534850] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-11-03T18:45:01.868099] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-11-03T18:45:02.218301] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-11 (1.48 seconds). [2025-11-03T18:45:02.219123] [INFO ] [REMOTE ] EQBK: Full fetch complete (15649 records). [2025-11-03T18:45:02.219198] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-11-03T18:45:02.339995] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-11. [2025-11-03T18:45:02.619793] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-11-03T18:45:02.619873] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-11-03T18:45:02.620215] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-11-03T18:45:02.620253] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-11-03T18:45:02.620878] [DEBUG] [LOCAL ] EQBK: Trimmed 15649 records to 11022 (keeping 200 days of data) [2025-11-03T18:45:02.687477] [DEBUG] [LOCAL ] EQBK: Primary data saved (11022 records). [2025-11-03T18:45:02.687622] [INFO ] [MAIN ] EQBK: Full history saved. [2025-11-03T18:45:02.687727] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EQBK took 26.0s. Estimated remaining: 3h 44m 27s. Rate: 7.2 symbols/min [2025-11-03T18:45:02.855317] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:02.855506] [DEBUG] [LOCAL ] EQR: No existing data file found in primary storage. [2025-11-03T18:45:02.855544] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-11-03T18:45:02.855681] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-11-03T18:45:02.855734] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-11-03T18:45:02.855776] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-11-03T18:45:02.855807] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-11-03T18:45:03.140045] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-11-03T18:45:03.208736] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:03.664839] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-11-03T18:45:03.794409] [DEBUG] [REMOTE ] EPRT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:45:03.794703] [WARN ] [REMOTE ] EPRT: No data returned for month 2025-11 [2025-11-03T18:45:03.794801] [FATAL] [REMOTE ] EPRT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:45:03.794920] [FATAL] [MAIN ] EPRT: Failed to fetch primary data. [2025-11-03T18:45:03.794994] [WARN ] [MAIN ] EPRT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:45:03.795048] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-11-03T18:45:03.795103] [DEBUG] [LOCAL ] EPRT: No primary data file found to delete. [2025-11-03T18:45:03.795137] [INFO ] [LOCAL ] EPRT: Starting deletion of derivative data. [2025-11-03T18:45:03.795275] [DEBUG] [LOCAL ] EPRT: Deleted derivative data file. [2025-11-03T18:45:03.796096] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EPRT took 34.9s. Estimated remaining: 3h 44m 3s. Rate: 7.2 symbols/min [2025-11-03T18:45:03.942753] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-11-03T18:45:03.969512] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:03.969688] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-11-03T18:45:03.969741] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-11-03T18:45:03.969862] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-11-03T18:45:03.969906] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-11-03T18:45:03.969949] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-11-03T18:45:03.969982] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-11-03T18:45:04.327826] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:04.517747] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T18:45:04.734907] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-11-03T18:45:05.534849] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-11-03T18:45:05.582575] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-11-03T18:45:05.920442] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-11-03T18:45:06.122797] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T18:45:06.334864] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-11-03T18:45:06.584839] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-11-03T18:45:07.134882] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-11-03T18:45:07.934903] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-11-03T18:45:08.311182] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:45:08.734885] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-11-03T18:45:09.155789] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T18:45:09.405670] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T18:45:09.534834] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-11-03T18:45:09.746738] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-11-03T18:45:10.334850] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-11-03T18:45:10.675284] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T18:45:11.134876] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-11-03T18:45:11.409191] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-11-03T18:45:11.934898] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-11-03T18:45:12.734918] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-11-03T18:45:13.308307] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T18:45:13.534849] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-11-03T18:45:13.793091] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-11-03T18:45:14.236173] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T18:45:14.334830] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-11-03T18:45:15.134869] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-11-03T18:45:15.643362] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T18:45:15.934862] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-11-03T18:45:16.478672] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-11-03T18:45:16.717760] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-11-03T18:45:16.734801] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-11-03T18:45:17.534834] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-11-03T18:45:18.338849] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-11-03T18:45:18.345221] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-11-03T18:45:18.362687] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T18:45:19.134826] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-11-03T18:45:19.452305] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-11-03T18:45:19.739785] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T18:45:19.934850] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-11-03T18:45:20.734850] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-11. [2025-11-03T18:45:21.283251] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T18:45:21.283986] [INFO ] [REMOTE ] EQS: Full fetch complete (2353 records). [2025-11-03T18:45:21.284056] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-11-03T18:45:21.470417] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-11-03T18:45:21.470731] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:45:21.470944] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:45:21.471121] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-11-03T18:45:21.471235] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-11-03T18:45:21.471299] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-11-03T18:45:21.471410] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-11-03T18:45:21.471502] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EQS took 17.7s. Estimated remaining: 3h 44m 14s. Rate: 7.2 symbols/min [2025-11-03T18:45:21.540800] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-11-03T18:45:21.681479] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:21.684813] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-11-03T18:45:21.742874] [DEBUG] [LOCAL ] EQT: Loaded 54464 existing records from primary storage. [2025-11-03T18:45:21.743177] [INFO ] [MAIN ] EQT: Loaded 54464 existing records. [2025-11-03T18:45:21.923985] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:45:21.924169] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-11-03T18:45:21.924216] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-11-03T18:45:21.925149] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-11-03T18:45:21.925208] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-11-03T18:45:22.297020] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:22.334817] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-11-03T18:45:23.043430] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T18:45:23.134846] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-11-03T18:45:23.518618] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:45:23.934867] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-11-03T18:45:24.690498] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T18:45:24.734817] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-11-03T18:45:25.484066] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-11-03T18:45:25.534842] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-11. [2025-11-03T18:45:26.334821] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-11-03T18:45:26.454385] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-11-03T18:45:27.134902] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-11-03T18:45:27.287845] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-11 (1.75 seconds). [2025-11-03T18:45:27.289334] [INFO ] [REMOTE ] EQH: Full fetch complete (76588 records). [2025-11-03T18:45:27.289420] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-11-03T18:45:27.717866] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-11-03T18:45:27.718020] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-11-03T18:45:27.718998] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-11-03T18:45:27.719083] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-11-03T18:45:27.720539] [DEBUG] [LOCAL ] EQH: Trimmed 76588 records to 52648 (keeping 200 days of data) [2025-11-03T18:45:27.848454] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T18:45:27.940946] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-11-03T18:45:28.076330] [DEBUG] [LOCAL ] EQH: Primary data saved (52648 records). [2025-11-03T18:45:28.076498] [INFO ] [MAIN ] EQH: Full history saved. [2025-11-03T18:45:28.076612] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQH took 45.1s. Estimated remaining: 3h 44m 2s. Rate: 7.2 symbols/min [2025-11-03T18:45:28.734831] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-11. [2025-11-03T18:45:28.917614] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-11-03T18:45:29.473608] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T18:45:29.534836] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-11-03T18:45:30.334930] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-11-03T18:45:30.924856] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T18:45:31.082746] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-11 (2.35 seconds). [2025-11-03T18:45:31.084368] [INFO ] [REMOTE ] EQNR: Full fetch complete (76991 records). [2025-11-03T18:45:31.084459] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-11-03T18:45:31.142997] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-11-03T18:45:31.496905] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-11-03T18:45:31.497000] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-11-03T18:45:31.497931] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-11-03T18:45:31.497996] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-11-03T18:45:31.499428] [DEBUG] [LOCAL ] EQNR: Trimmed 76991 records to 53013 (keeping 200 days of data) [2025-11-03T18:45:31.818109] [DEBUG] [LOCAL ] EQNR: Primary data saved (53013 records). [2025-11-03T18:45:31.818568] [INFO ] [MAIN ] EQNR: Full history saved. [2025-11-03T18:45:31.819755] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQNR took 39.7s. Estimated remaining: 3h 43m 44s. Rate: 7.2 symbols/min [2025-11-03T18:45:31.856768] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T18:45:31.934875] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-11-03T18:45:33.068211] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-11-03T18:45:33.081217] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-11. [2025-11-03T18:45:33.317173] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T18:45:33.534851] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-11-03T18:45:35.014113] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T18:45:35.025142] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-11-03T18:45:35.169258] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-11 (2.09 seconds). [2025-11-03T18:45:35.170808] [INFO ] [REMOTE ] EQR: Full fetch complete (74698 records). [2025-11-03T18:45:35.170917] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-11-03T18:45:35.579354] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-11-03T18:45:35.579470] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-11-03T18:45:35.580729] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-11-03T18:45:35.580812] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-11-03T18:45:35.582750] [DEBUG] [LOCAL ] EQR: Trimmed 74698 records to 51833 (keeping 200 days of data) [2025-11-03T18:45:35.903778] [DEBUG] [LOCAL ] EQR: Primary data saved (51833 records). [2025-11-03T18:45:35.903917] [INFO ] [MAIN ] EQR: Full history saved. [2025-11-03T18:45:35.903989] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQR took 33.2s. Estimated remaining: 3h 43m 27s. Rate: 7.2 symbols/min [2025-11-03T18:45:36.500102] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T18:45:36.511267] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-11-03T18:45:38.122019] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T18:45:38.133171] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-11-03T18:45:39.849679] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-11-03T18:45:39.861452] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-11-03T18:45:41.233836] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T18:45:41.244918] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-11-03T18:45:42.754955] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T18:45:42.766349] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-11-03T18:45:44.720268] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-11-03T18:45:44.733079] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-11. [2025-11-03T18:45:44.888566] [DEBUG] [REMOTE ] EQT: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:45:44.888877] [WARN ] [REMOTE ] EQT: No data returned for month 2025-11 [2025-11-03T18:45:44.888964] [FATAL] [REMOTE ] EQT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:45:44.889039] [FATAL] [MAIN ] EQT: Failed to fetch primary data. [2025-11-03T18:45:44.889102] [WARN ] [MAIN ] EQT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:45:44.889172] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-11-03T18:45:44.889252] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-11-03T18:45:44.889289] [INFO ] [LOCAL ] EQT: Starting deletion of derivative data. [2025-11-03T18:45:44.889470] [DEBUG] [LOCAL ] EQT: Deleted derivative data file. [2025-11-03T18:45:44.890004] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQT took 23.4s. Estimated remaining: 3h 43m 20s. Rate: 7.2 symbols/min [2025-11-03T18:45:45.613632] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:45.565071] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:45.614778] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:45.571547] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:45:45.615715] [DEBUG] [LOCAL ] ESE: No existing data file found in primary storage. [2025-11-03T18:45:45.617624] [WARN ] [MAIN ] ESE: No existing data found, performing full refresh instead. [2025-11-03T18:45:45.617986] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-11-03T18:45:45.618048] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-11-03T18:45:45.618095] [DEBUG] [LOCAL ] ESE: No primary data file found to delete. [2025-11-03T18:45:45.618128] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-11-03T18:45:45.860161] [DEBUG] [LOCAL ] ESAB: Loaded 26298 existing records from primary storage. [2025-11-03T18:45:45.935045] [INFO ] [MAIN ] ESAB: Loaded 26298 existing records. [2025-11-03T18:45:45.941025] [DEBUG] [LOCAL ] ERO: Loaded 42555 existing records from primary storage. [2025-11-03T18:45:45.951874] [INFO ] [MAIN ] ERO: Loaded 42555 existing records. [2025-11-03T18:45:46.259956] [DEBUG] [LOCAL ] ES: Loaded 53431 existing records from primary storage. [2025-11-03T18:45:46.304104] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:46.330811] [INFO ] [MAIN ] ES: Loaded 53431 existing records. [2025-11-03T18:45:46.330633] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-11-03T18:45:46.521862] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:45:46.522304] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-11-03T18:45:46.516133] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:45:46.540705] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-11-03T18:45:46.540867] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-11-03T18:45:46.556848] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-11-03T18:45:46.567802] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-11-03T18:45:46.562614] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-11-03T18:45:46.578195] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-11-03T18:45:46.578318] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-11-03T18:45:46.721412] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:45:46.786692] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-11-03T18:45:46.812843] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-11-03T18:45:46.846439] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-11-03T18:45:46.851725] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-11-03T18:45:47.510492] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T18:45:47.562905] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-11-03T18:45:47.601923] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:47.617861] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-11-03T18:45:47.704628] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:47.726624] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-11-03T18:45:47.785266] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:45:47.786003] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-11-03T18:45:48.390938] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T18:45:48.394607] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-11-03T18:45:48.462031] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T18:45:48.466217] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-11-03T18:45:48.962328] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T18:45:48.970727] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-11-03T18:45:49.048027] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T18:45:49.053057] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-11-03T18:45:49.120296] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T18:45:49.125099] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-11-03T18:45:49.221092] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:45:49.231522] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-11-03T18:45:49.885587] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T18:45:49.890215] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-11-03T18:45:49.940496] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-11-03T18:45:49.948941] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-11-03T18:45:49.991706] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T18:45:50.334932] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-11-03T18:45:50.667805] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-11-03T18:45:50.859385] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-11-03T18:45:50.993917] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T18:45:51.134893] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-11-03T18:45:51.304246] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T18:45:51.934886] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-11-03T18:45:52.385966] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T18:45:52.734865] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-11-03T18:45:52.745705] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T18:45:53.534856] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-11-03T18:45:53.878114] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T18:45:54.334830] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-11-03T18:45:54.369361] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-11-03T18:45:55.134892] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-11-03T18:45:55.508674] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T18:45:55.934873] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-11-03T18:45:56.536779] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T18:45:56.734937] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-11-03T18:45:57.171186] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T18:45:57.520088] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T18:45:57.534832] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-11-03T18:45:58.334826] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-11-03T18:45:58.962192] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T18:45:59.025092] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-11-03T18:45:59.134835] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-11-03T18:45:59.934892] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-11-03T18:46:00.366734] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T18:46:00.734918] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-11-03T18:46:01.327958] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T18:46:01.534853] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-11-03T18:46:02.334934] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-11-03T18:46:03.134883] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-11-03T18:46:03.384790] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-11-03T18:46:03.829622] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (3.09 seconds). [2025-11-03T18:46:03.934835] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-11-03T18:46:04.039415] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-11-03T18:46:04.374378] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T18:46:04.734907] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-11-03T18:46:04.968502] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T18:46:05.534952] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-11-03T18:46:05.595684] [DEBUG] [REMOTE ] ESAB: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-11-03T18:46:05.596254] [WARN ] [REMOTE ] ESAB: No data returned for month 2025-10 [2025-11-03T18:46:05.596382] [FATAL] [REMOTE ] ESAB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:46:05.596513] [FATAL] [MAIN ] ESAB: Failed to fetch primary data. [2025-11-03T18:46:05.596600] [WARN ] [MAIN ] ESAB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:46:05.596747] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-11-03T18:46:05.596849] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-11-03T18:46:05.596911] [INFO ] [LOCAL ] ESAB: Starting deletion of derivative data. [2025-11-03T18:46:05.597166] [DEBUG] [LOCAL ] ESAB: Deleted derivative data file. [2025-11-03T18:46:05.597318] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. ESAB took 20.7s. Estimated remaining: 3h 43m 38s. Rate: 7.2 symbols/min [2025-11-03T18:46:05.804419] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:05.855193] [DEBUG] [LOCAL ] ESI: Loaded 51338 existing records from primary storage. [2025-11-03T18:46:05.855611] [INFO ] [MAIN ] ESI: Loaded 51338 existing records. [2025-11-03T18:46:06.047859] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:46:06.048265] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-11-03T18:46:06.048478] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-11-03T18:46:06.049359] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-11-03T18:46:06.049418] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-11-03T18:46:06.244518] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T18:46:06.339805] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-11-03T18:46:06.460724] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:07.134878] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-11-03T18:46:07.823209] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T18:46:07.913205] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T18:46:07.934861] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-11-03T18:46:08.734856] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-11-03T18:46:09.204049] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T18:46:09.534864] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-11. [2025-11-03T18:46:10.295883] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-11-03T18:46:10.334818] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-11-03T18:46:10.565355] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T18:46:10.566296] [INFO ] [REMOTE ] ESE: Full fetch complete (23135 records). [2025-11-03T18:46:10.566363] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-11-03T18:46:10.930127] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-11-03T18:46:10.930226] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-11-03T18:46:10.930723] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-11-03T18:46:10.930785] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-11-03T18:46:10.931484] [DEBUG] [LOCAL ] ESE: Trimmed 23135 records to 16143 (keeping 200 days of data) [2025-11-03T18:46:11.031171] [DEBUG] [LOCAL ] ESE: Primary data saved (16143 records). [2025-11-03T18:46:11.031303] [INFO ] [MAIN ] ESE: Full history saved. [2025-11-03T18:46:11.031373] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ESE took 26.1s. Estimated remaining: 3h 43m 23s. Rate: 7.2 symbols/min [2025-11-03T18:46:11.139934] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-11-03T18:46:11.200199] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:11.232704] [DEBUG] [LOCAL ] ESNT: Loaded 37993 existing records from primary storage. [2025-11-03T18:46:11.233003] [INFO ] [MAIN ] ESNT: Loaded 37993 existing records. [2025-11-03T18:46:11.419323] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:46:11.419534] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-11-03T18:46:11.419581] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-11-03T18:46:11.420226] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-11-03T18:46:11.420285] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-11-03T18:46:11.788590] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:11.814230] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-11-03T18:46:11.934850] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-11-03T18:46:12.687063] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-11-03T18:46:12.734856] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-11. [2025-11-03T18:46:13.248243] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T18:46:13.534831] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-11-03T18:46:14.334913] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-11-03T18:46:14.620005] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-11 (1.89 seconds). [2025-11-03T18:46:14.622004] [INFO ] [REMOTE ] ERO: Full fetch complete (60897 records). [2025-11-03T18:46:14.634784] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-11-03T18:46:14.652585] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T18:46:15.054532] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-11-03T18:46:15.054670] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-11-03T18:46:15.055548] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-11-03T18:46:15.055594] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-11-03T18:46:15.057016] [DEBUG] [LOCAL ] ERO: Trimmed 60897 records to 41882 (keeping 200 days of data) [2025-11-03T18:46:15.145145] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-11-03T18:46:15.327935] [DEBUG] [LOCAL ] ERO: Primary data saved (41882 records). [2025-11-03T18:46:15.328098] [INFO ] [MAIN ] ERO: Full history saved. [2025-11-03T18:46:15.328203] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ERO took 30.4s. Estimated remaining: 3h 43m 6s. Rate: 7.2 symbols/min [2025-11-03T18:46:15.545554] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:15.588418] [DEBUG] [LOCAL ] ESRT: Loaded 47104 existing records from primary storage. [2025-11-03T18:46:15.588793] [INFO ] [MAIN ] ESRT: Loaded 47104 existing records. [2025-11-03T18:46:15.816790] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:46:15.817069] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-11-03T18:46:15.817152] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-11-03T18:46:15.818031] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-11-03T18:46:15.818096] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-11-03T18:46:15.936753] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-11-03T18:46:16.031604] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-11-03T18:46:16.301164] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:16.734862] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-11-03T18:46:16.842305] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-11-03T18:46:17.259234] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T18:46:17.534866] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-11-03T18:46:18.114952] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T18:46:18.334857] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-11-03T18:46:18.763505] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:46:19.134846] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-11-03T18:46:19.376726] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T18:46:19.934862] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-11-03T18:46:20.219350] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T18:46:20.734861] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-11-03T18:46:21.039351] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T18:46:21.534908] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-11-03T18:46:21.732026] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T18:46:22.334848] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-11-03T18:46:22.604964] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T18:46:23.134895] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-11-03T18:46:23.832451] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T18:46:23.934811] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-11. [2025-11-03T18:46:24.178443] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T18:46:24.734906] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-11-03T18:46:25.125755] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T18:46:25.127458] [INFO ] [REMOTE ] ES: Full fetch complete (76441 records). [2025-11-03T18:46:25.127554] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-11-03T18:46:25.527140] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-11-03T18:46:25.527206] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-11-03T18:46:25.528103] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-11-03T18:46:25.528165] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-11-03T18:46:25.529523] [DEBUG] [LOCAL ] ES: Trimmed 76441 records to 52647 (keeping 200 days of data) [2025-11-03T18:46:25.582917] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-11-03T18:46:25.825239] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T18:46:25.875709] [DEBUG] [LOCAL ] ES: Primary data saved (52647 records). [2025-11-03T18:46:25.875815] [INFO ] [MAIN ] ES: Full history saved. [2025-11-03T18:46:25.875885] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. ES took 41.0s. Estimated remaining: 3h 43m 2s. Rate: 7.2 symbols/min [2025-11-03T18:46:26.042459] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:26.070620] [DEBUG] [LOCAL ] ESS: Loaded 30656 existing records from primary storage. [2025-11-03T18:46:26.070896] [INFO ] [MAIN ] ESS: Loaded 30656 existing records. [2025-11-03T18:46:26.243521] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:46:26.243726] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-11-03T18:46:26.243777] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-11-03T18:46:26.244354] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-11-03T18:46:26.244409] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-11-03T18:46:26.340874] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-11-03T18:46:26.597137] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:26.977127] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T18:46:27.134896] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-11-03T18:46:27.658729] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T18:46:27.934924] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-11-03T18:46:28.282260] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:46:28.734890] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-11-03T18:46:28.907955] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T18:46:29.534901] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-11-03T18:46:30.026532] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T18:46:30.334927] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-11-03T18:46:30.701458] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T18:46:31.134899] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-11-03T18:46:31.790472] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-11-03T18:46:31.934822] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-11. [2025-11-03T18:46:32.273017] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T18:46:32.734895] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-11-03T18:46:33.534933] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-11-03T18:46:33.763065] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T18:46:33.801799] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-11 (1.87 seconds). [2025-11-03T18:46:33.803341] [INFO ] [REMOTE ] ESI: Full fetch complete (73449 records). [2025-11-03T18:46:33.803460] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-11-03T18:46:34.202249] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-11-03T18:46:34.202348] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-11-03T18:46:34.203287] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-11-03T18:46:34.203350] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-11-03T18:46:34.204746] [DEBUG] [LOCAL ] ESI: Trimmed 73449 records to 50571 (keeping 200 days of data) [2025-11-03T18:46:34.334890] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-11-03T18:46:34.516750] [DEBUG] [LOCAL ] ESI: Primary data saved (50571 records). [2025-11-03T18:46:34.516886] [INFO ] [MAIN ] ESI: Full history saved. [2025-11-03T18:46:34.516963] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. ESI took 28.9s. Estimated remaining: 3h 42m 55s. Rate: 7.2 symbols/min [2025-11-03T18:46:34.694492] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:34.694777] [DEBUG] [LOCAL ] ESTC: No existing data file found in primary storage. [2025-11-03T18:46:34.694875] [WARN ] [MAIN ] ESTC: No existing data found, performing full refresh instead. [2025-11-03T18:46:34.695003] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-11-03T18:46:34.695154] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-11-03T18:46:34.695279] [DEBUG] [LOCAL ] ESTC: No primary data file found to delete. [2025-11-03T18:46:34.695334] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-11-03T18:46:34.915134] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T18:46:35.119072] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:35.134835] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-11-03T18:46:35.448975] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-11-03T18:46:35.934869] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-11-03T18:46:36.489916] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:46:36.734860] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-11. [2025-11-03T18:46:37.057181] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T18:46:37.534931] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-11-03T18:46:38.314775] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-11 (1.58 seconds). [2025-11-03T18:46:38.315929] [INFO ] [REMOTE ] ESNT: Full fetch complete (56533 records). [2025-11-03T18:46:38.316008] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-11-03T18:46:38.346485] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-11-03T18:46:38.694755] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-11-03T18:46:38.694840] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-11-03T18:46:38.695547] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-11-03T18:46:38.695635] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-11-03T18:46:38.697190] [DEBUG] [LOCAL ] ESNT: Trimmed 56533 records to 37402 (keeping 200 days of data) [2025-11-03T18:46:38.891926] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T18:46:38.961013] [DEBUG] [LOCAL ] ESNT: Primary data saved (37402 records). [2025-11-03T18:46:38.961144] [INFO ] [MAIN ] ESNT: Full history saved. [2025-11-03T18:46:38.961686] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESNT took 27.9s. Estimated remaining: 3h 42m 38s. Rate: 7.2 symbols/min [2025-11-03T18:46:39.127157] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:39.134917] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-11-03T18:46:39.181584] [DEBUG] [LOCAL ] ET: Loaded 54569 existing records from primary storage. [2025-11-03T18:46:39.181922] [INFO ] [MAIN ] ET: Loaded 54569 existing records. [2025-11-03T18:46:39.364524] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:46:39.364784] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-11-03T18:46:39.364998] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-11-03T18:46:39.365932] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-11-03T18:46:39.366001] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-11-03T18:46:39.486759] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T18:46:39.739396] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:39.934866] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-11-03T18:46:40.341559] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T18:46:40.734850] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-11-03T18:46:41.176119] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T18:46:41.534849] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-11-03T18:46:42.104275] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T18:46:42.334863] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-11-03T18:46:42.737061] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:46:43.134892] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-11-03T18:46:43.832672] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T18:46:43.934862] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-11-03T18:46:44.203046] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T18:46:44.734919] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-11-03T18:46:45.429196] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T18:46:45.534872] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-11-03T18:46:46.088575] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:46:46.334892] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-11-03T18:46:46.847549] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T18:46:47.134877] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-11-03T18:46:47.934834] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-11-03T18:46:47.994676] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T18:46:48.530094] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:46:48.734837] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-11-03T18:46:49.019052] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T18:46:49.534861] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-11-03T18:46:50.334829] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-11-03T18:46:50.440323] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-11-03T18:46:50.930290] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T18:46:51.134848] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-11-03T18:46:51.660614] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:46:51.934897] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-11-03T18:46:52.626507] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T18:46:52.734942] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-11-03T18:46:52.942769] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T18:46:53.534876] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-11-03T18:46:53.874271] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T18:46:54.334898] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-11-03T18:46:54.922870] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T18:46:55.134866] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-11. [2025-11-03T18:46:55.326851] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T18:46:55.934839] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-11-03T18:46:56.734927] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-11-03T18:46:57.088559] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T18:46:57.369580] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-11 (2.23 seconds). [2025-11-03T18:46:57.371001] [INFO ] [REMOTE ] ESTC: Full fetch complete (72557 records). [2025-11-03T18:46:57.371094] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-11-03T18:46:57.540233] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-11. [2025-11-03T18:46:57.755138] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-11-03T18:46:57.755217] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-11-03T18:46:57.756069] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-11-03T18:46:57.756130] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-11-03T18:46:57.757483] [DEBUG] [LOCAL ] ESTC: Trimmed 72557 records to 50206 (keeping 200 days of data) [2025-11-03T18:46:58.046560] [DEBUG] [LOCAL ] ESTC: Primary data saved (50206 records). [2025-11-03T18:46:58.046701] [INFO ] [MAIN ] ESTC: Full history saved. [2025-11-03T18:46:58.046779] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ESTC took 23.5s. Estimated remaining: 3h 42m 52s. Rate: 7.2 symbols/min [2025-11-03T18:46:58.218492] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:46:58.230304] [DEBUG] [LOCAL ] ETB: Loaded 11545 existing records from primary storage. [2025-11-03T18:46:58.230564] [INFO ] [MAIN ] ETB: Loaded 11545 existing records. [2025-11-03T18:46:58.339218] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-11-03T18:46:58.413870] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:46:58.414105] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-11-03T18:46:58.414187] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-11-03T18:46:58.414759] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-11-03T18:46:58.414824] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-11-03T18:46:58.529078] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-11-03T18:46:58.826377] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:46:59.134848] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-11-03T18:46:59.238732] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-11 (1.70 seconds). [2025-11-03T18:46:59.240459] [INFO ] [REMOTE ] ESRT: Full fetch complete (66892 records). [2025-11-03T18:46:59.240559] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-11-03T18:46:59.597406] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:46:59.649216] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-11-03T18:46:59.649541] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-11-03T18:46:59.650428] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-11-03T18:46:59.650509] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-11-03T18:46:59.652238] [DEBUG] [LOCAL ] ESRT: Trimmed 66892 records to 46420 (keeping 200 days of data) [2025-11-03T18:46:59.741395] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-11-03T18:46:59.918735] [DEBUG] [LOCAL ] ESRT: Primary data saved (46420 records). [2025-11-03T18:46:59.918860] [INFO ] [MAIN ] ESRT: Full history saved. [2025-11-03T18:46:59.918937] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESRT took 44.6s. Estimated remaining: 3h 42m 30s. Rate: 7.2 symbols/min [2025-11-03T18:46:59.941976] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-11-03T18:47:00.088073] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:00.111977] [DEBUG] [LOCAL ] ETD: Loaded 27122 existing records from primary storage. [2025-11-03T18:47:00.112249] [INFO ] [MAIN ] ETD: Loaded 27122 existing records. [2025-11-03T18:47:00.284069] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:00.284273] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-11-03T18:47:00.284320] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-11-03T18:47:00.284843] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-11-03T18:47:00.284900] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-11-03T18:47:00.626821] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:00.734857] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-11-03T18:47:00.917910] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T18:47:01.534872] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-11-03T18:47:02.334826] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-11-03T18:47:02.469630] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T18:47:03.044857] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-11-03T18:47:03.134881] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-11-03T18:47:03.509860] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:47:03.807793] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T18:47:03.934859] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-11-03T18:47:04.734860] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-11-03T18:47:05.536600] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-11-03T18:47:05.539073] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T18:47:05.662503] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-11-03T18:47:06.199496] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T18:47:06.334845] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-11. [2025-11-03T18:47:07.134857] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-11-03T18:47:07.934838] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-11-03T18:47:08.028722] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-11 (1.69 seconds). [2025-11-03T18:47:08.030021] [INFO ] [REMOTE ] ESS: Full fetch complete (44148 records). [2025-11-03T18:47:08.030097] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-11-03T18:47:08.396127] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-11-03T18:47:08.396203] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-11-03T18:47:08.396868] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-11-03T18:47:08.396929] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-11-03T18:47:08.397838] [DEBUG] [LOCAL ] ESS: Trimmed 44148 records to 30143 (keeping 200 days of data) [2025-11-03T18:47:08.597741] [DEBUG] [LOCAL ] ESS: Primary data saved (30143 records). [2025-11-03T18:47:08.597901] [INFO ] [MAIN ] ESS: Full history saved. [2025-11-03T18:47:08.598004] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ESS took 42.7s. Estimated remaining: 3h 42m 23s. Rate: 7.2 symbols/min [2025-11-03T18:47:08.738170] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-11-03T18:47:08.824889] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:08.869440] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T18:47:08.880982] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-11-03T18:47:08.908822] [DEBUG] [LOCAL ] ETG: Loaded 16348 existing records from primary storage. [2025-11-03T18:47:08.909133] [INFO ] [MAIN ] ETG: Loaded 16348 existing records. [2025-11-03T18:47:09.091057] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:09.091287] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-11-03T18:47:09.091342] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-11-03T18:47:09.091927] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-11-03T18:47:09.091984] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-11-03T18:47:09.466272] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T18:47:09.471058] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:09.534831] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-11-03T18:47:10.078946] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T18:47:10.334865] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-11-03T18:47:11.134880] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-11-03T18:47:11.934821] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-11-03T18:47:12.062913] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-11-03T18:47:12.134882] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T18:47:12.500926] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-11-03T18:47:12.734892] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-11-03T18:47:13.534824] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-11-03T18:47:13.678630] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T18:47:14.043969] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T18:47:14.334930] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-11-03T18:47:15.083967] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T18:47:15.134868] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-11-03T18:47:15.749879] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T18:47:15.934857] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-11-03T18:47:16.589106] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-11-03T18:47:16.734847] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-11-03T18:47:17.415070] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-11-03T18:47:17.534849] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-11-03T18:47:18.334826] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-11-03T18:47:18.480063] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T18:47:18.905427] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T18:47:19.134886] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-11-03T18:47:19.829282] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T18:47:19.934843] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-11-03T18:47:20.734846] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-11-03T18:47:20.838487] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T18:47:21.393163] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-11-03T18:47:21.534899] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-11-03T18:47:22.279784] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T18:47:22.334889] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-11-03T18:47:23.134866] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-11-03T18:47:23.813360] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T18:47:23.934858] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-11-03T18:47:24.200543] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-11-03T18:47:24.734821] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-11-03T18:47:24.894389] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T18:47:25.434808] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T18:47:25.534972] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-11-03T18:47:26.160520] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T18:47:26.334894] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-11-03T18:47:27.134891] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-11. [2025-11-03T18:47:27.934850] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-11-03T18:47:28.004902] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-11-03T18:47:28.337860] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T18:47:28.338583] [INFO ] [REMOTE ] ETB: Full fetch complete (18532 records). [2025-11-03T18:47:28.338672] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-11-03T18:47:28.710566] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-11-03T18:47:28.710756] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-11-03T18:47:28.711182] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-11-03T18:47:28.711231] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-11-03T18:47:28.711760] [DEBUG] [LOCAL ] ETB: Trimmed 18532 records to 11270 (keeping 200 days of data) [2025-11-03T18:47:28.739868] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-11-03T18:47:28.793570] [DEBUG] [LOCAL ] ETB: Primary data saved (11270 records). [2025-11-03T18:47:28.793495] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T18:47:28.793763] [INFO ] [MAIN ] ETB: Full history saved. [2025-11-03T18:47:28.797925] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ETB took 30.8s. Estimated remaining: 3h 42m 39s. Rate: 7.2 symbols/min [2025-11-03T18:47:28.980717] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:28.995124] [DEBUG] [LOCAL ] ETJ: Loaded 15857 existing records from primary storage. [2025-11-03T18:47:28.995323] [INFO ] [MAIN ] ETJ: Loaded 15857 existing records. [2025-11-03T18:47:29.183978] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:29.184208] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-11-03T18:47:29.184267] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-11-03T18:47:29.184634] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-11-03T18:47:29.184734] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-11-03T18:47:29.549190] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:29.544704] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-11. [2025-11-03T18:47:30.334816] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-11-03T18:47:30.558486] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T18:47:30.563804] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-11-03T18:47:30.564340] [INFO ] [REMOTE ] ETG: Full fetch complete (24353 records). [2025-11-03T18:47:30.569407] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-11-03T18:47:30.957080] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-11-03T18:47:30.957195] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-11-03T18:47:30.957946] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-11-03T18:47:30.958062] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-11-03T18:47:30.970827] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-11-03T18:47:30.971122] [DEBUG] [LOCAL ] ETG: Trimmed 24353 records to 16056 (keeping 200 days of data) [2025-11-03T18:47:31.070749] [DEBUG] [LOCAL ] ETG: Primary data saved (16056 records). [2025-11-03T18:47:31.070880] [INFO ] [MAIN ] ETG: Full history saved. [2025-11-03T18:47:31.071012] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ETG took 22.5s. Estimated remaining: 3h 42m 18s. Rate: 7.2 symbols/min [2025-11-03T18:47:31.140066] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-11-03T18:47:31.238094] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:31.288063] [DEBUG] [LOCAL ] ETN: Loaded 53259 existing records from primary storage. [2025-11-03T18:47:31.288365] [INFO ] [MAIN ] ETN: Loaded 53259 existing records. [2025-11-03T18:47:31.460524] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:31.460751] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-11-03T18:47:31.460803] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-11-03T18:47:31.461740] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-11-03T18:47:31.461798] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-11-03T18:47:31.810040] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:31.934826] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-11-03T18:47:32.387737] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T18:47:32.706772] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T18:47:32.734877] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-11. [2025-11-03T18:47:33.534845] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-11-03T18:47:34.334872] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-11-03T18:47:34.659746] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:47:35.134866] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-11. [2025-11-03T18:47:35.773213] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-11 (3.04 seconds). [2025-11-03T18:47:35.774767] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-11-03T18:47:35.774856] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-11-03T18:47:35.940747] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-11-03T18:47:36.157090] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-11-03T18:47:36.220638] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-11-03T18:47:36.220740] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-11-03T18:47:36.221693] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-11-03T18:47:36.221770] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-11-03T18:47:36.223153] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-11-03T18:47:36.443090] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T18:47:36.447968] [INFO ] [REMOTE ] ETD: Full fetch complete (38684 records). [2025-11-03T18:47:36.449921] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-11-03T18:47:36.738746] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-11-03T18:47:36.876875] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-11-03T18:47:36.892506] [INFO ] [MAIN ] ET: Full history saved. [2025-11-03T18:47:36.915996] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ET took 58.0s. Estimated remaining: 3h 42m 4s. Rate: 7.2 symbols/min [2025-11-03T18:47:36.970188] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-11-03T18:47:37.005540] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-11-03T18:47:37.031972] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-11-03T18:47:37.058928] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:47:37.063163] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-11-03T18:47:37.139796] [DEBUG] [LOCAL ] ETD: Trimmed 38684 records to 26849 (keeping 200 days of data) [2025-11-03T18:47:37.161520] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:37.260409] [DEBUG] [LOCAL ] ETO: Loaded 6713 existing records from primary storage. [2025-11-03T18:47:37.284574] [INFO ] [MAIN ] ETO: Loaded 6713 existing records. [2025-11-03T18:47:37.470810] [DEBUG] [LOCAL ] ETD: Primary data saved (26849 records). [2025-11-03T18:47:37.490611] [INFO ] [MAIN ] ETD: Full history saved. [2025-11-03T18:47:37.521996] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETD took 37.6s. Estimated remaining: 3h 41m 40s. Rate: 7.2 symbols/min [2025-11-03T18:47:37.527712] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:37.549472] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-11-03T18:47:37.578234] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-11-03T18:47:37.596447] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-11-03T18:47:37.626704] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-11-03T18:47:37.639237] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-11-03T18:47:37.839157] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:38.088549] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:38.107421] [DEBUG] [LOCAL ] ETR: Loaded 53945 existing records from primary storage. [2025-11-03T18:47:38.107743] [INFO ] [MAIN ] ETR: Loaded 53945 existing records. [2025-11-03T18:47:38.283206] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:38.283422] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-11-03T18:47:38.283470] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-11-03T18:47:38.284308] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-11-03T18:47:38.284365] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-11-03T18:47:38.337676] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-11-03T18:47:38.660226] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:38.674672] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T18:47:38.715562] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-11-03T18:47:38.870067] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T18:47:39.134856] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-11-03T18:47:39.790607] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-11-03T18:47:39.934859] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-11-03T18:47:40.593178] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T18:47:40.734896] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-11-03T18:47:41.534907] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-11-03T18:47:42.327484] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T18:47:42.338473] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-11-03T18:47:42.737079] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T18:47:42.845895] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T18:47:43.134909] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-11-03T18:47:43.934924] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-11-03T18:47:44.347139] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T18:47:44.734891] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-11-03T18:47:45.134906] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T18:47:45.350723] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T18:47:45.534857] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-11-03T18:47:46.214481] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-11-03T18:47:46.334873] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-11-03T18:47:46.810764] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-11-03T18:47:47.134827] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-11-03T18:47:47.674514] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T18:47:47.934875] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-11-03T18:47:48.734904] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-11-03T18:47:48.759996] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T18:47:49.534853] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-11-03T18:47:50.015465] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T18:47:50.055631] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-11-03T18:47:50.334830] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-11-03T18:47:50.829731] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T18:47:51.134871] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-11-03T18:47:51.934887] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-11-03T18:47:52.526475] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T18:47:52.734938] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-11-03T18:47:53.159125] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T18:47:53.434982] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T18:47:53.534872] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-11. [2025-11-03T18:47:54.334903] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-11-03T18:47:54.383108] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-11 (0.85 seconds). [2025-11-03T18:47:54.383970] [INFO ] [REMOTE ] ETJ: Full fetch complete (25003 records). [2025-11-03T18:47:54.384039] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-11-03T18:47:54.761471] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-11-03T18:47:54.761726] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-11-03T18:47:54.762354] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-11-03T18:47:54.767181] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-11-03T18:47:54.771318] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T18:47:54.774369] [DEBUG] [LOCAL ] ETJ: Trimmed 25003 records to 15244 (keeping 200 days of data) [2025-11-03T18:47:54.861832] [DEBUG] [LOCAL ] ETJ: Primary data saved (15244 records). [2025-11-03T18:47:54.861970] [INFO ] [MAIN ] ETJ: Full history saved. [2025-11-03T18:47:54.862047] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ETJ took 26.1s. Estimated remaining: 3h 41m 50s. Rate: 7.2 symbols/min [2025-11-03T18:47:55.044316] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:47:55.093002] [DEBUG] [LOCAL ] ETSY: Loaded 54336 existing records from primary storage. [2025-11-03T18:47:55.093405] [INFO ] [MAIN ] ETSY: Loaded 54336 existing records. [2025-11-03T18:47:55.140221] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-11-03T18:47:55.282691] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:47:55.282913] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-11-03T18:47:55.282970] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-11-03T18:47:55.283903] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-11-03T18:47:55.283964] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-11-03T18:47:55.649701] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:47:55.654764] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T18:47:55.934899] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-11-03T18:47:56.734928] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-11-03T18:47:57.456490] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T18:47:57.534894] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-11-03T18:47:58.336039] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-11-03T18:47:58.339177] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-11-03T18:47:58.764719] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T18:47:58.843518] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T18:47:59.134892] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-11-03T18:47:59.656623] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-11-03T18:47:59.934882] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-11-03T18:48:00.734838] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-11-03T18:48:01.534930] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-11-03T18:48:01.610373] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-11-03T18:48:02.334918] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-11. [2025-11-03T18:48:02.496429] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-11-03T18:48:02.896060] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T18:48:03.064691] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-11 (0.73 seconds). [2025-11-03T18:48:03.065679] [INFO ] [REMOTE ] ETO: Full fetch complete (9722 records). [2025-11-03T18:48:03.065766] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-11-03T18:48:03.145291] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-11-03T18:48:03.447760] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-11-03T18:48:03.447838] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-11-03T18:48:03.448082] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-11-03T18:48:03.448123] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-11-03T18:48:03.448518] [DEBUG] [LOCAL ] ETO: Trimmed 9722 records to 6655 (keeping 200 days of data) [2025-11-03T18:48:03.487673] [DEBUG] [LOCAL ] ETO: Primary data saved (6655 records). [2025-11-03T18:48:03.487756] [INFO ] [MAIN ] ETO: Full history saved. [2025-11-03T18:48:03.487831] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETO took 26.5s. Estimated remaining: 3h 41m 42s. Rate: 7.2 symbols/min [2025-11-03T18:48:03.651683] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:03.671352] [DEBUG] [LOCAL ] ETV: Loaded 21624 existing records from primary storage. [2025-11-03T18:48:03.671587] [INFO ] [MAIN ] ETV: Loaded 21624 existing records. [2025-11-03T18:48:03.843203] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:48:03.843375] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-11-03T18:48:03.843443] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-11-03T18:48:03.843896] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-11-03T18:48:03.843953] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-11-03T18:48:03.940079] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-11-03T18:48:04.192755] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:48:04.620274] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T18:48:04.734858] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-11-03T18:48:05.543512] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-11-03T18:48:05.545948] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T18:48:05.640631] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-11-03T18:48:06.334892] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-11-03T18:48:06.948297] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:48:06.979882] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T18:48:07.134896] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-11-03T18:48:07.934859] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-11-03T18:48:08.700424] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T18:48:08.734807] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-11-03T18:48:08.841503] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-11-03T18:48:09.392059] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T18:48:09.534847] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-11-03T18:48:10.334850] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-11-03T18:48:10.856211] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T18:48:11.016794] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T18:48:11.134839] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-11. [2025-11-03T18:48:11.934852] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-11-03T18:48:12.470134] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-11 (1.34 seconds). [2025-11-03T18:48:12.471703] [INFO ] [REMOTE ] ETN: Full fetch complete (76594 records). [2025-11-03T18:48:12.471793] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-11-03T18:48:12.740753] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-11-03T18:48:12.872991] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-11-03T18:48:12.873129] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-11-03T18:48:12.874625] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-11-03T18:48:12.874727] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-11-03T18:48:12.876714] [DEBUG] [LOCAL ] ETN: Trimmed 76594 records to 52483 (keeping 200 days of data) [2025-11-03T18:48:13.212993] [DEBUG] [LOCAL ] ETN: Primary data saved (52483 records). [2025-11-03T18:48:13.213224] [INFO ] [MAIN ] ETN: Full history saved. [2025-11-03T18:48:13.214328] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETN took 42.1s. Estimated remaining: 3h 41m 37s. Rate: 7.2 symbols/min [2025-11-03T18:48:13.393309] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:13.407093] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T18:48:13.449307] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T18:48:13.468939] [DEBUG] [LOCAL ] ETW: Loaded 24783 existing records from primary storage. [2025-11-03T18:48:13.469240] [INFO ] [MAIN ] ETW: Loaded 24783 existing records. [2025-11-03T18:48:13.540072] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-11-03T18:48:13.663248] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:48:13.663476] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-11-03T18:48:13.663526] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-11-03T18:48:13.664019] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-11-03T18:48:13.664077] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-11-03T18:48:14.015425] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:48:14.334852] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-11-03T18:48:15.016777] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T18:48:15.128662] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T18:48:15.134803] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-11-03T18:48:15.934823] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-11-03T18:48:16.009042] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-11-03T18:48:16.734884] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-11-03T18:48:17.266471] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T18:48:17.451182] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T18:48:17.534834] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-11-03T18:48:18.322734] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T18:48:18.334807] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-11. [2025-11-03T18:48:19.134857] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-11-03T18:48:19.525794] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T18:48:19.526734] [INFO ] [REMOTE ] ETV: Full fetch complete (31687 records). [2025-11-03T18:48:19.526804] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-11-03T18:48:19.893416] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-11-03T18:48:19.893495] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-11-03T18:48:19.894040] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-11-03T18:48:19.894103] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-11-03T18:48:19.894824] [DEBUG] [LOCAL ] ETV: Trimmed 31687 records to 21258 (keeping 200 days of data) [2025-11-03T18:48:19.945367] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-11-03T18:48:20.022553] [DEBUG] [LOCAL ] ETV: Primary data saved (21258 records). [2025-11-03T18:48:20.022706] [INFO ] [MAIN ] ETV: Full history saved. [2025-11-03T18:48:20.022794] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETV took 16.5s. Estimated remaining: 3h 41m 25s. Rate: 7.2 symbols/min [2025-11-03T18:48:20.193768] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:20.200209] [DEBUG] [LOCAL ] ETX: Loaded 5411 existing records from primary storage. [2025-11-03T18:48:20.200376] [INFO ] [MAIN ] ETX: Loaded 5411 existing records. [2025-11-03T18:48:20.384092] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:48:20.384434] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-11-03T18:48:20.384585] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-11-03T18:48:20.385134] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-11-03T18:48:20.385219] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-11-03T18:48:20.723702] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T18:48:20.739324] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-11-03T18:48:20.803912] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:48:21.368132] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T18:48:21.534872] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-11-03T18:48:21.598223] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-11-03T18:48:22.334934] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-11-03T18:48:22.925466] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T18:48:23.033937] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:48:23.134834] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-11. [2025-11-03T18:48:23.934861] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-11-03T18:48:24.338927] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-11-03T18:48:24.734897] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-11-03T18:48:25.149700] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T18:48:25.454573] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-11 (2.32 seconds). [2025-11-03T18:48:25.456292] [INFO ] [REMOTE ] ETR: Full fetch complete (77268 records). [2025-11-03T18:48:25.456604] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-11-03T18:48:25.539966] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-11-03T18:48:25.871945] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-11-03T18:48:25.872032] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-11-03T18:48:25.872993] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-11-03T18:48:25.873060] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-11-03T18:48:25.874528] [DEBUG] [LOCAL ] ETR: Trimmed 77268 records to 53174 (keeping 200 days of data) [2025-11-03T18:48:26.198889] [DEBUG] [LOCAL ] ETR: Primary data saved (53174 records). [2025-11-03T18:48:26.199041] [INFO ] [MAIN ] ETR: Full history saved. [2025-11-03T18:48:26.199125] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETR took 48.7s. Estimated remaining: 3h 41m 12s. Rate: 7.2 symbols/min [2025-11-03T18:48:26.346470] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-11-03T18:48:26.379750] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:26.403086] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-11-03T18:48:26.426839] [DEBUG] [LOCAL ] ETY: Loaded 21925 existing records from primary storage. [2025-11-03T18:48:26.427110] [INFO ] [MAIN ] ETY: Loaded 21925 existing records. [2025-11-03T18:48:26.631757] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:48:26.631986] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-11-03T18:48:26.632033] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-11-03T18:48:26.632494] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-11-03T18:48:26.632550] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-11-03T18:48:26.746149] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T18:48:26.991088] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:48:27.134834] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-11-03T18:48:27.934832] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-11-03T18:48:28.031070] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T18:48:28.371992] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T18:48:28.734863] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-11-03T18:48:29.118324] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-11-03T18:48:29.534915] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-11-03T18:48:30.334868] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-11-03T18:48:30.520478] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T18:48:30.810923] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T18:48:31.134867] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-11-03T18:48:31.934232] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T18:48:31.939514] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-11-03T18:48:32.734881] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-11-03T18:48:33.429944] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:48:33.471348] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T18:48:33.534849] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-11-03T18:48:34.334851] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-11-03T18:48:34.350027] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T18:48:34.693252] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-11-03T18:48:35.134897] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-11-03T18:48:35.934842] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-11-03T18:48:36.011847] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-11-03T18:48:36.326639] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T18:48:36.734873] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-11-03T18:48:37.157848] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-11-03T18:48:37.534924] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-11-03T18:48:37.967161] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-11-03T18:48:38.334873] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-11-03T18:48:39.072109] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T18:48:39.134856] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-11-03T18:48:39.934839] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-11-03T18:48:40.001363] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-11-03T18:48:40.668825] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T18:48:40.734824] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-11-03T18:48:41.534879] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-11-03T18:48:41.579483] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-11-03T18:48:42.281762] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T18:48:42.334826] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-11-03T18:48:42.998114] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-11-03T18:48:43.134871] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-11. [2025-11-03T18:48:43.934928] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-11-03T18:48:44.275878] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T18:48:44.276910] [INFO ] [REMOTE ] ETW: Full fetch complete (36356 records). [2025-11-03T18:48:44.276987] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-11-03T18:48:44.656011] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-11-03T18:48:44.656097] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-11-03T18:48:44.656700] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-11-03T18:48:44.656764] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-11-03T18:48:44.657740] [DEBUG] [LOCAL ] ETW: Trimmed 36356 records to 24469 (keeping 200 days of data) [2025-11-03T18:48:44.740706] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-11. [2025-11-03T18:48:44.801664] [DEBUG] [LOCAL ] ETW: Primary data saved (24469 records). [2025-11-03T18:48:44.801832] [INFO ] [MAIN ] ETW: Full history saved. [2025-11-03T18:48:44.801947] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETW took 31.6s. Estimated remaining: 3h 41m 25s. Rate: 7.2 symbols/min [2025-11-03T18:48:44.975001] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:44.975186] [DEBUG] [LOCAL ] EVC: No existing data file found in primary storage. [2025-11-03T18:48:44.975224] [WARN ] [MAIN ] EVC: No existing data found, performing full refresh instead. [2025-11-03T18:48:44.975333] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-11-03T18:48:44.975376] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-11-03T18:48:44.975419] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-11-03T18:48:44.975452] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-11-03T18:48:45.312598] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T18:48:45.368913] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:48:45.363348] [INFO ] [REMOTE ] ETX: Full fetch complete (6851 records). [2025-11-03T18:48:45.369337] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-11-03T18:48:45.538348] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-11-03T18:48:45.618989] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-11-03T18:48:45.787089] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-11-03T18:48:45.787173] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-11-03T18:48:45.787431] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-11-03T18:48:45.787493] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-11-03T18:48:45.787997] [DEBUG] [LOCAL ] ETX: Trimmed 6851 records to 5345 (keeping 200 days of data) [2025-11-03T18:48:45.821503] [DEBUG] [LOCAL ] ETX: Primary data saved (5345 records). [2025-11-03T18:48:45.821670] [INFO ] [MAIN ] ETX: Full history saved. [2025-11-03T18:48:45.821771] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETX took 25.8s. Estimated remaining: 3h 41m 2s. Rate: 7.2 symbols/min [2025-11-03T18:48:45.997387] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:46.031947] [DEBUG] [LOCAL ] EVEX: Loaded 34192 existing records from primary storage. [2025-11-03T18:48:46.032239] [INFO ] [MAIN ] EVEX: Loaded 34192 existing records. [2025-11-03T18:48:46.210251] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:48:46.210486] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-11-03T18:48:46.210554] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-11-03T18:48:46.211071] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-11-03T18:48:46.211129] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-11-03T18:48:46.340026] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-11-03T18:48:46.594312] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:48:46.607984] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T18:48:47.134879] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-11-03T18:48:47.240173] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T18:48:47.903750] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T18:48:47.934891] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-11-03T18:48:48.657790] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T18:48:48.734845] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-11-03T18:48:49.468290] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T18:48:49.534934] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-11-03T18:48:50.334873] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-11-03T18:48:50.412314] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-11-03T18:48:51.134888] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-11-03T18:48:51.152824] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T18:48:51.934862] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-11-03T18:48:51.976806] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T18:48:52.734866] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-11-03T18:48:53.387148] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T18:48:53.534871] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-11-03T18:48:53.569902] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T18:48:54.242346] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T18:48:54.334872] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-11-03T18:48:55.075818] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T18:48:55.134836] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-11-03T18:48:55.836113] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T18:48:55.934889] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-11-03T18:48:56.734817] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-11-03T18:48:56.789262] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T18:48:57.365360] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-11-03T18:48:57.534897] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-10. [2025-11-03T18:48:58.323512] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T18:48:58.334824] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-11. [2025-11-03T18:48:59.134883] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-11-03T18:48:59.308510] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T18:48:59.309480] [INFO ] [REMOTE ] ETY: Full fetch complete (33581 records). [2025-11-03T18:48:59.309550] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-11-03T18:48:59.678091] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-11-03T18:48:59.678229] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-11-03T18:48:59.678790] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-11-03T18:48:59.678850] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-11-03T18:48:59.679545] [DEBUG] [LOCAL ] ETY: Trimmed 33581 records to 21642 (keeping 200 days of data) [2025-11-03T18:48:59.805982] [DEBUG] [LOCAL ] ETY: Primary data saved (21642 records). [2025-11-03T18:48:59.806070] [INFO ] [MAIN ] ETY: Full history saved. [2025-11-03T18:48:59.806145] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETY took 33.6s. Estimated remaining: 3h 41m 5s. Rate: 7.2 symbols/min [2025-11-03T18:48:59.944392] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-11-03T18:48:59.975966] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:48:59.985225] [DEBUG] [LOCAL ] EVF: Loaded 9482 existing records from primary storage. [2025-11-03T18:48:59.985422] [INFO ] [MAIN ] EVF: Loaded 9482 existing records. [2025-11-03T18:49:00.165147] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:00.165386] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-11-03T18:49:00.165555] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-11-03T18:49:00.166002] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-11-03T18:49:00.166096] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-11-03T18:49:00.288907] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T18:49:00.542889] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:00.734870] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-11-03T18:49:01.189455] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-11-03T18:49:01.534870] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-11-03T18:49:01.764400] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-11-03T18:49:02.270353] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T18:49:02.334818] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-11-03T18:49:03.104866] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T18:49:03.134811] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-11-03T18:49:03.866517] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T18:49:03.934820] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-11-03T18:49:04.642270] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T18:49:04.734867] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-11-03T18:49:05.143162] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T18:49:05.534896] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-11-03T18:49:06.334855] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-11-03T18:49:06.628169] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T18:49:06.843787] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T18:49:07.134843] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-11. [2025-11-03T18:49:07.934851] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-11-03T18:49:08.461308] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-11-03T18:49:08.734863] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-11-03T18:49:09.180124] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-11-03T18:49:09.313418] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-11 (2.18 seconds). [2025-11-03T18:49:09.315508] [INFO ] [REMOTE ] ETSY: Full fetch complete (77672 records). [2025-11-03T18:49:09.315713] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-11-03T18:49:09.540040] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-11-03T18:49:09.738513] [DEBUG] [VALIDATOR ] ETSY: All expected trading days are present. [2025-11-03T18:49:09.738594] [DEBUG] [VALIDATOR ] ETSY: Primary data validation passed. [2025-11-03T18:49:09.739519] [INFO ] [MAIN ] ETSY: Fetched primary data is valid. [2025-11-03T18:49:09.739581] [DEBUG] [LOCAL ] ETSY: Saving primary data. [2025-11-03T18:49:09.741044] [DEBUG] [LOCAL ] ETSY: Trimmed 77672 records to 53556 (keeping 200 days of data) [2025-11-03T18:49:10.041787] [DEBUG] [LOCAL ] ETSY: Primary data saved (53556 records). [2025-11-03T18:49:10.041907] [INFO ] [MAIN ] ETSY: Full history saved. [2025-11-03T18:49:10.041982] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETSY took 1m 15s. Estimated remaining: 3h 40m 60s. Rate: 7.2 symbols/min [2025-11-03T18:49:10.146719] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T18:49:10.215541] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:49:10.222776] [DEBUG] [LOCAL ] EVG: Loaded 5887 existing records from primary storage. [2025-11-03T18:49:10.222977] [INFO ] [MAIN ] EVG: Loaded 5887 existing records. [2025-11-03T18:49:10.339940] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-11-03T18:49:10.399972] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:10.400382] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-11-03T18:49:10.400485] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-11-03T18:49:10.400916] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-11-03T18:49:10.401064] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-11-03T18:49:10.743517] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:11.030796] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-11-03T18:49:11.134873] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-11-03T18:49:11.669752] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T18:49:11.934865] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-11-03T18:49:12.617062] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-11-03T18:49:12.734848] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-11-03T18:49:13.278216] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T18:49:13.534845] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-11-03T18:49:14.087157] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T18:49:14.334885] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-11-03T18:49:14.800554] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-11-03T18:49:15.134910] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-11-03T18:49:15.934919] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-11. [2025-11-03T18:49:16.343578] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T18:49:16.734901] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-11-03T18:49:16.799259] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T18:49:16.800019] [INFO ] [REMOTE ] EVF: Full fetch complete (12994 records). [2025-11-03T18:49:16.800106] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-11-03T18:49:17.172762] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-11-03T18:49:17.172857] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-11-03T18:49:17.173183] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-11-03T18:49:17.173224] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-11-03T18:49:17.173845] [DEBUG] [LOCAL ] EVF: Trimmed 12994 records to 9314 (keeping 200 days of data) [2025-11-03T18:49:17.230458] [DEBUG] [LOCAL ] EVF: Primary data saved (9314 records). [2025-11-03T18:49:17.233044] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T18:49:17.232887] [INFO ] [MAIN ] EVF: Full history saved. [2025-11-03T18:49:17.234946] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. EVF took 17.4s. Estimated remaining: 3h 40m 49s. Rate: 7.2 symbols/min [2025-11-03T18:49:17.412038] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:49:17.454938] [DEBUG] [LOCAL ] EVH: Loaded 50241 existing records from primary storage. [2025-11-03T18:49:17.455270] [INFO ] [MAIN ] EVH: Loaded 50241 existing records. [2025-11-03T18:49:17.540003] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-11-03T18:49:17.649666] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:17.649883] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-11-03T18:49:17.649933] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-11-03T18:49:17.650622] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-11-03T18:49:17.650715] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-11-03T18:49:18.036269] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:18.211611] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T18:49:18.334866] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-11-03T18:49:19.134917] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-11-03T18:49:19.547842] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T18:49:19.934914] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-11-03T18:49:20.317732] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T18:49:20.734901] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-11. [2025-11-03T18:49:21.155353] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:49:21.534882] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-11. [2025-11-03T18:49:22.334918] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-11-03T18:49:22.505921] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-11 (1.77 seconds). [2025-11-03T18:49:22.507149] [INFO ] [REMOTE ] EVEX: Full fetch complete (44709 records). [2025-11-03T18:49:22.507227] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-11-03T18:49:22.747028] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-11 (1.21 seconds). [2025-11-03T18:49:22.786580] [INFO ] [REMOTE ] EVC: Full fetch complete (27887 records). [2025-11-03T18:49:22.805694] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-11-03T18:49:23.016903] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-11-03T18:49:23.022484] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T18:49:23.027736] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-11-03T18:49:23.045801] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-11-03T18:49:23.069197] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-11-03T18:49:23.138219] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-11-03T18:49:23.150215] [DEBUG] [LOCAL ] EVEX: Trimmed 44709 records to 34067 (keeping 200 days of data) [2025-11-03T18:49:23.403795] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-11-03T18:49:23.405707] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-11-03T18:49:23.411886] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-11-03T18:49:23.412025] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-11-03T18:49:23.448549] [DEBUG] [LOCAL ] EVC: Trimmed 27887 records to 17197 (keeping 200 days of data) [2025-11-03T18:49:23.562683] [DEBUG] [LOCAL ] EVEX: Primary data saved (34067 records). [2025-11-03T18:49:23.567331] [INFO ] [MAIN ] EVEX: Full history saved. [2025-11-03T18:49:23.568491] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. EVEX took 37.7s. Estimated remaining: 3h 40m 37s. Rate: 7.2 symbols/min [2025-11-03T18:49:23.697777] [DEBUG] [LOCAL ] EVC: Primary data saved (17197 records). [2025-11-03T18:49:23.705210] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T18:49:23.705032] [INFO ] [MAIN ] EVC: Full history saved. [2025-11-03T18:49:23.722907] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. EVC took 38.9s. Estimated remaining: 3h 40m 12s. Rate: 7.2 symbols/min [2025-11-03T18:49:23.843250] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:49:23.936013] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-11-03T18:49:23.966227] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:49:23.971556] [DEBUG] [LOCAL ] EVN: Loaded 11009 existing records from primary storage. [2025-11-03T18:49:23.971861] [INFO ] [MAIN ] EVN: Loaded 11009 existing records. [2025-11-03T18:49:24.171304] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:24.172258] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-11-03T18:49:24.172333] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-11-03T18:49:24.172887] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-11-03T18:49:24.172846] [DEBUG] [LOCAL ] EVR: Loaded 33387 existing records from primary storage. [2025-11-03T18:49:24.173061] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-11-03T18:49:24.173132] [INFO ] [MAIN ] EVR: Loaded 33387 existing records. [2025-11-03T18:49:24.518727] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:24.519934] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-11-03T18:49:24.534221] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-11-03T18:49:24.569996] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-11-03T18:49:24.602947] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-11-03T18:49:24.757334] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-11-03T18:49:24.854790] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:25.094143] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:25.166273] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:49:25.245919] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T18:49:25.534842] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-11-03T18:49:26.334829] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-11-03T18:49:26.547056] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T18:49:26.625613] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-11-03T18:49:27.134853] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-11-03T18:49:27.524896] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T18:49:27.934849] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-11-03T18:49:28.734880] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-11-03T18:49:29.163606] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T18:49:29.432965] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T18:49:29.534878] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-11-03T18:49:30.114458] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T18:49:30.334851] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-11-03T18:49:30.975555] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-11-03T18:49:31.134891] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-11-03T18:49:31.794628] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T18:49:31.934878] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-11-03T18:49:32.734952] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-11-03T18:49:33.023953] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T18:49:33.263359] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T18:49:33.534860] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-11-03T18:49:33.925679] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T18:49:34.334935] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-11-03T18:49:35.134906] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-11-03T18:49:35.784843] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T18:49:35.934939] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-11-03T18:49:36.569329] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T18:49:36.734856] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-11-03T18:49:37.187639] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T18:49:37.534955] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-11-03T18:49:38.045010] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T18:49:38.334944] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-11-03T18:49:38.478513] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T18:49:38.823331] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T18:49:39.134890] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-11-03T18:49:39.714206] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T18:49:39.934943] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-11-03T18:49:40.734937] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-11. [2025-11-03T18:49:41.101267] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T18:49:41.416706] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T18:49:41.417667] [INFO ] [REMOTE ] EVG: Full fetch complete (8191 records). [2025-11-03T18:49:41.417747] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-11-03T18:49:41.540086] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-11-03T18:49:41.948582] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-11-03T18:49:41.948736] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-11-03T18:49:41.949140] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-11-03T18:49:41.949212] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-11-03T18:49:41.950029] [DEBUG] [LOCAL ] EVG: Trimmed 8191 records to 5857 (keeping 200 days of data) [2025-11-03T18:49:41.994077] [DEBUG] [LOCAL ] EVG: Primary data saved (5857 records). [2025-11-03T18:49:41.994224] [INFO ] [MAIN ] EVG: Full history saved. [2025-11-03T18:49:41.994306] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. EVG took 32.0s. Estimated remaining: 3h 40m 23s. Rate: 7.2 symbols/min [2025-11-03T18:49:42.186877] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:49:42.194401] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T18:49:42.212404] [DEBUG] [LOCAL ] EVT: Loaded 16479 existing records from primary storage. [2025-11-03T18:49:42.212695] [INFO ] [MAIN ] EVT: Loaded 16479 existing records. [2025-11-03T18:49:42.340112] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-11-03T18:49:42.401183] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:42.401418] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-11-03T18:49:42.401507] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-11-03T18:49:42.401908] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-11-03T18:49:42.401966] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-11-03T18:49:42.762447] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:43.134852] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-11-03T18:49:43.828101] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:49:43.865798] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T18:49:43.934836] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-11-03T18:49:44.626317] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T18:49:44.734878] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-11-03T18:49:45.528520] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-11-03T18:49:45.534798] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-11-03T18:49:46.308018] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T18:49:46.334815] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-11-03T18:49:47.134849] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-11-03T18:49:47.465685] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-11-03T18:49:47.908489] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T18:49:47.934815] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-11-03T18:49:48.594436] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T18:49:48.734868] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-11-03T18:49:49.534826] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-11-03T18:49:49.701188] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T18:49:50.334873] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-11-03T18:49:50.912735] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T18:49:51.134820] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-11-03T18:49:51.367929] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T18:49:51.836951] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-11-03T18:49:51.934852] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-11-03T18:49:52.714530] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-11-03T18:49:52.734847] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-11-03T18:49:53.368445] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T18:49:53.534888] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-11-03T18:49:54.263827] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T18:49:54.334818] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-11. [2025-11-03T18:49:55.134848] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-11-03T18:49:55.299173] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T18:49:55.300179] [INFO ] [REMOTE ] EVT: Full fetch complete (24685 records). [2025-11-03T18:49:55.300256] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-11-03T18:49:55.689680] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-11-03T18:49:55.689771] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-11-03T18:49:55.690270] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-11-03T18:49:55.690310] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-11-03T18:49:55.691020] [DEBUG] [LOCAL ] EVT: Trimmed 24685 records to 16290 (keeping 200 days of data) [2025-11-03T18:49:55.792265] [DEBUG] [LOCAL ] EVT: Primary data saved (16290 records). [2025-11-03T18:49:55.799744] [INFO ] [MAIN ] EVT: Full history saved. [2025-11-03T18:49:55.800803] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVT took 13.8s. Estimated remaining: 3h 40m 26s. Rate: 7.2 symbols/min [2025-11-03T18:49:55.800614] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T18:49:55.940015] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-11-03T18:49:55.995848] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:49:56.023836] [DEBUG] [LOCAL ] EVTC: Loaded 27088 existing records from primary storage. [2025-11-03T18:49:56.024182] [INFO ] [MAIN ] EVTC: Loaded 27088 existing records. [2025-11-03T18:49:56.215760] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:49:56.215999] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-11-03T18:49:56.216065] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-11-03T18:49:56.216625] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-11-03T18:49:56.216722] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-11-03T18:49:56.597329] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:49:56.734848] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-11-03T18:49:57.379161] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T18:49:57.398435] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T18:49:57.534843] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-11-03T18:49:58.334873] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-11-03T18:49:58.843948] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T18:49:58.925610] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-11-03T18:49:59.134862] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-11-03T18:49:59.934838] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-11-03T18:50:00.140530] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T18:50:00.734854] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-11-03T18:50:01.076304] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T18:50:01.534907] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-11-03T18:50:01.695534] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-11-03T18:50:02.334903] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-11. [2025-11-03T18:50:02.779421] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T18:50:03.134919] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-11-03T18:50:03.934864] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-11. [2025-11-03T18:50:04.149629] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T18:50:04.151333] [INFO ] [REMOTE ] EVR: Full fetch complete (50541 records). [2025-11-03T18:50:04.151414] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-11-03T18:50:04.502604] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:50:04.595236] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-11-03T18:50:04.595317] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-11-03T18:50:04.596059] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-11-03T18:50:04.596121] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-11-03T18:50:04.597171] [DEBUG] [LOCAL ] EVR: Trimmed 50541 records to 32761 (keeping 200 days of data) [2025-11-03T18:50:04.753996] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-11-03T18:50:04.802678] [DEBUG] [LOCAL ] EVR: Primary data saved (32761 records). [2025-11-03T18:50:04.802794] [INFO ] [MAIN ] EVR: Full history saved. [2025-11-03T18:50:04.802866] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVR took 41.0s. Estimated remaining: 3h 40m 19s. Rate: 7.2 symbols/min [2025-11-03T18:50:04.972420] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:05.011253] [DEBUG] [LOCAL ] EVTL: Loaded 43031 existing records from primary storage. [2025-11-03T18:50:05.011594] [INFO ] [MAIN ] EVTL: Loaded 43031 existing records. [2025-11-03T18:50:05.183177] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:05.183372] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-11-03T18:50:05.183419] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-11-03T18:50:05.184097] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-11-03T18:50:05.184155] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-11-03T18:50:05.528389] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:05.534814] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-11. [2025-11-03T18:50:05.820001] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T18:50:06.242036] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-11 (2.31 seconds). [2025-11-03T18:50:06.243539] [INFO ] [REMOTE ] EVH: Full fetch complete (71897 records). [2025-11-03T18:50:06.243691] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-11-03T18:50:06.344998] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-11-03T18:50:06.564123] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T18:50:06.599947] [INFO ] [REMOTE ] EVN: Full fetch complete (16638 records). [2025-11-03T18:50:06.621340] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-11-03T18:50:06.729364] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-11-03T18:50:06.740581] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-11-03T18:50:06.762485] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-11-03T18:50:06.762696] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-11-03T18:50:06.838792] [DEBUG] [LOCAL ] EVH: Trimmed 71897 records to 49513 (keeping 200 days of data) [2025-11-03T18:50:07.140349] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-11-03T18:50:07.161546] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-11-03T18:50:07.161814] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-11-03T18:50:07.162384] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-11-03T18:50:07.211334] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-11-03T18:50:07.252354] [DEBUG] [LOCAL ] EVN: Trimmed 16638 records to 10855 (keeping 200 days of data) [2025-11-03T18:50:07.374291] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T18:50:07.402188] [DEBUG] [LOCAL ] EVN: Primary data saved (10855 records). [2025-11-03T18:50:07.435854] [INFO ] [MAIN ] EVN: Full history saved. [2025-11-03T18:50:07.447080] [DEBUG] [LOCAL ] EVH: Primary data saved (49513 records). [2025-11-03T18:50:07.447253] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVN took 43.9s. Estimated remaining: 3h 39m 59s. Rate: 7.2 symbols/min [2025-11-03T18:50:07.448045] [INFO ] [MAIN ] EVH: Full history saved. [2025-11-03T18:50:07.490975] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVH took 50.3s. Estimated remaining: 3h 39m 34s. Rate: 7.2 symbols/min [2025-11-03T18:50:07.768747] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:07.789425] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:07.813134] [DEBUG] [LOCAL ] EVTR: Loaded 26148 existing records from primary storage. [2025-11-03T18:50:07.813376] [INFO ] [MAIN ] EVTR: Loaded 26148 existing records. [2025-11-03T18:50:07.950348] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-11-03T18:50:08.025782] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:08.027369] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-11-03T18:50:08.027459] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-11-03T18:50:08.027190] [DEBUG] [LOCAL ] EW: Loaded 54167 existing records from primary storage. [2025-11-03T18:50:08.027892] [INFO ] [MAIN ] EW: Loaded 54167 existing records. [2025-11-03T18:50:08.039079] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-11-03T18:50:08.058997] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-11-03T18:50:08.356757] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:08.386988] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-11-03T18:50:08.393179] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-11-03T18:50:08.419526] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-11-03T18:50:08.447739] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-11-03T18:50:08.782052] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:08.815576] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-11-03T18:50:08.913047] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-11-03T18:50:09.037311] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:09.055529] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T18:50:09.534831] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-11-03T18:50:09.658367] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T18:50:10.334883] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-11-03T18:50:10.631856] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T18:50:11.134833] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-11-03T18:50:11.267519] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T18:50:11.934888] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-11-03T18:50:12.222284] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T18:50:12.639544] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T18:50:12.734889] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-11-03T18:50:13.517604] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-11-03T18:50:13.534815] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-11-03T18:50:14.286745] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T18:50:14.334886] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-11-03T18:50:15.134852] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-11-03T18:50:15.803706] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T18:50:15.934866] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-11-03T18:50:16.247308] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T18:50:16.734898] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-11-03T18:50:17.201552] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T18:50:17.534876] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-11-03T18:50:18.051898] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T18:50:18.334871] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-11-03T18:50:18.958595] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T18:50:19.134835] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-11-03T18:50:19.193408] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T18:50:19.934856] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-11-03T18:50:20.669810] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T18:50:20.734841] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-11-03T18:50:21.023554] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T18:50:21.534857] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-11-03T18:50:22.210132] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T18:50:22.334857] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-11-03T18:50:23.026998] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T18:50:23.134850] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-11-03T18:50:23.901374] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T18:50:23.934805] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-11-03T18:50:23.990952] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-11-03T18:50:24.734815] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-11-03T18:50:24.774588] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T18:50:25.534858] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-11-03T18:50:26.199983] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T18:50:26.334854] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-11-03T18:50:26.932346] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T18:50:27.134855] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-11-03T18:50:27.883457] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-11-03T18:50:27.934827] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-11-03T18:50:28.734866] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-11-03T18:50:28.737929] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-11-03T18:50:29.390579] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T18:50:29.474195] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T18:50:29.534939] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-11-03T18:50:30.240792] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T18:50:30.334834] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-11-03T18:50:31.134859] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-11-03T18:50:31.163468] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T18:50:31.934906] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-11-03T18:50:32.744324] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-11. [2025-11-03T18:50:32.751041] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T18:50:33.463552] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T18:50:33.534861] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-11-03T18:50:34.325520] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-11 (1.58 seconds). [2025-11-03T18:50:34.326731] [INFO ] [REMOTE ] EVTC: Full fetch complete (38706 records). [2025-11-03T18:50:34.326809] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-11-03T18:50:34.356989] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-11. [2025-11-03T18:50:34.632082] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:50:34.728115] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-11-03T18:50:34.728208] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-11-03T18:50:34.728945] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-11-03T18:50:34.729006] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-11-03T18:50:34.729966] [DEBUG] [LOCAL ] EVTC: Trimmed 38706 records to 26832 (keeping 200 days of data) [2025-11-03T18:50:34.891161] [DEBUG] [LOCAL ] EVTC: Primary data saved (26832 records). [2025-11-03T18:50:34.891305] [INFO ] [MAIN ] EVTC: Full history saved. [2025-11-03T18:50:34.891388] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVTC took 39.1s. Estimated remaining: 3h 40m 4s. Rate: 7.2 symbols/min [2025-11-03T18:50:35.056603] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:35.086513] [DEBUG] [LOCAL ] EXG: Loaded 33311 existing records from primary storage. [2025-11-03T18:50:35.086841] [INFO ] [MAIN ] EXG: Loaded 33311 existing records. [2025-11-03T18:50:35.140599] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-11-03T18:50:35.263035] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:35.263268] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-11-03T18:50:35.263314] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-11-03T18:50:35.264118] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-11-03T18:50:35.264179] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-11-03T18:50:35.619554] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:35.760224] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T18:50:35.761772] [INFO ] [REMOTE ] EW: Full fetch complete (77505 records). [2025-11-03T18:50:35.761877] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-11-03T18:50:35.941285] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-11. [2025-11-03T18:50:36.164169] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-11-03T18:50:36.164304] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-11-03T18:50:36.165351] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-11-03T18:50:36.165450] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-11-03T18:50:36.173936] [DEBUG] [LOCAL ] EW: Trimmed 77505 records to 53388 (keeping 200 days of data) [2025-11-03T18:50:36.186999] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-11-03T18:50:36.507761] [DEBUG] [LOCAL ] EW: Primary data saved (53388 records). [2025-11-03T18:50:36.507858] [INFO ] [MAIN ] EW: Full history saved. [2025-11-03T18:50:36.507931] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EW took 29.0s. Estimated remaining: 3h 39m 42s. Rate: 7.2 symbols/min [2025-11-03T18:50:36.675945] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:36.724186] [DEBUG] [LOCAL ] EXK: Loaded 53962 existing records from primary storage. [2025-11-03T18:50:36.724495] [INFO ] [MAIN ] EXK: Loaded 53962 existing records. [2025-11-03T18:50:36.744883] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-11-03T18:50:36.926113] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:36.926319] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-11-03T18:50:36.926364] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-11-03T18:50:36.927302] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-11-03T18:50:36.927363] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-11-03T18:50:37.296224] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:37.534887] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-11-03T18:50:37.784356] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T18:50:38.334855] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-11-03T18:50:38.700415] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-11 (2.76 seconds). [2025-11-03T18:50:38.702378] [INFO ] [REMOTE ] EVTL: Full fetch complete (56263 records). [2025-11-03T18:50:38.702496] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-11-03T18:50:39.149615] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-11-03T18:50:39.170007] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-11-03T18:50:39.181957] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-11-03T18:50:39.188091] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-11-03T18:50:39.201437] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-11-03T18:50:39.204112] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-11-03T18:50:39.216259] [DEBUG] [LOCAL ] EVTL: Trimmed 56263 records to 43040 (keeping 200 days of data) [2025-11-03T18:50:39.476891] [DEBUG] [LOCAL ] EVTL: Primary data saved (43040 records). [2025-11-03T18:50:39.477107] [INFO ] [MAIN ] EVTL: Full history saved. [2025-11-03T18:50:39.478040] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVTL took 34.7s. Estimated remaining: 3h 39m 23s. Rate: 7.2 symbols/min [2025-11-03T18:50:39.595462] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T18:50:39.722143] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:39.749449] [DEBUG] [LOCAL ] EXP: Loaded 29291 existing records from primary storage. [2025-11-03T18:50:39.749761] [INFO ] [MAIN ] EXP: Loaded 29291 existing records. [2025-11-03T18:50:39.924955] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:39.925138] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-11-03T18:50:39.925184] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-11-03T18:50:39.925790] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-11-03T18:50:39.925846] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-11-03T18:50:39.940098] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-11-03T18:50:40.292245] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:40.310696] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T18:50:40.734913] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-11-03T18:50:41.399459] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-11-03T18:50:41.534885] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-11-03T18:50:41.853808] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:50:42.334864] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-11-03T18:50:42.473226] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T18:50:43.134901] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-11. [2025-11-03T18:50:43.804734] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T18:50:43.934841] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-11-03T18:50:44.583706] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-11 (1.45 seconds). [2025-11-03T18:50:44.584816] [INFO ] [REMOTE ] EVTR: Full fetch complete (34994 records). [2025-11-03T18:50:44.584897] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-11-03T18:50:44.743531] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-11-03T18:50:44.990779] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-11-03T18:50:44.990896] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-11-03T18:50:44.991757] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-11-03T18:50:44.991859] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-11-03T18:50:45.008926] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T18:50:45.013861] [DEBUG] [LOCAL ] EVTR: Trimmed 34994 records to 25987 (keeping 200 days of data) [2025-11-03T18:50:45.173117] [DEBUG] [LOCAL ] EVTR: Primary data saved (25987 records). [2025-11-03T18:50:45.173248] [INFO ] [MAIN ] EVTR: Full history saved. [2025-11-03T18:50:45.173328] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EVTR took 37.7s. Estimated remaining: 3h 39m 9s. Rate: 7.2 symbols/min [2025-11-03T18:50:45.339987] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:50:45.394694] [DEBUG] [LOCAL ] EXPD: Loaded 48054 existing records from primary storage. [2025-11-03T18:50:45.395194] [INFO ] [MAIN ] EXPD: Loaded 48054 existing records. [2025-11-03T18:50:45.550912] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-11-03T18:50:45.596412] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:50:45.596572] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-11-03T18:50:45.596687] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-11-03T18:50:45.597490] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-11-03T18:50:45.597547] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-11-03T18:50:45.946633] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:50:46.334910] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-11-03T18:50:46.395197] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T18:50:46.518966] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T18:50:47.134851] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-11-03T18:50:47.682719] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T18:50:47.934853] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-11-03T18:50:48.614227] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T18:50:48.734872] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-11-03T18:50:49.319733] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T18:50:49.534876] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-11-03T18:50:50.264432] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-11-03T18:50:50.334818] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-11-03T18:50:50.595023] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T18:50:51.134848] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-11-03T18:50:51.846961] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T18:50:51.934816] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-11-03T18:50:52.035367] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T18:50:52.734909] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-11-03T18:50:53.384804] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T18:50:53.534822] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-11-03T18:50:54.197070] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T18:50:54.334874] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-11-03T18:50:55.139954] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-11-03T18:50:55.160174] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-11-03T18:50:55.782567] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T18:50:55.934885] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-11-03T18:50:56.215776] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T18:50:56.734864] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-11-03T18:50:57.478384] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T18:50:57.534862] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-11-03T18:50:57.878493] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T18:50:58.334934] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-11-03T18:50:58.804244] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T18:50:59.134830] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-11-03T18:50:59.334161] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T18:50:59.934923] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-11-03T18:51:00.734839] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-11-03T18:51:00.953636] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-11-03T18:51:01.534946] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-11-03T18:51:01.538060] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-11-03T18:51:01.911990] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T18:51:02.334855] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-11-03T18:51:03.134846] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-11-03T18:51:03.665322] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:51:03.718991] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (2.18 seconds). [2025-11-03T18:51:03.934855] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-11-03T18:51:04.313193] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T18:51:04.734863] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-11-03T18:51:04.815911] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-11-03T18:51:05.534844] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-11-03T18:51:06.105331] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T18:51:06.334857] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-11. [2025-11-03T18:51:06.505920] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T18:51:07.134851] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-11-03T18:51:07.934922] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-11-03T18:51:08.550379] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T18:51:08.734845] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-11-03T18:51:08.902990] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T18:51:09.185911] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-11 (2.85 seconds). [2025-11-03T18:51:09.187483] [INFO ] [REMOTE ] EXK: Full fetch complete (76930 records). [2025-11-03T18:51:09.187621] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-11-03T18:51:09.542615] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-11. [2025-11-03T18:51:09.601996] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-11-03T18:51:09.602231] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-11-03T18:51:09.603293] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-11-03T18:51:09.603418] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-11-03T18:51:09.605164] [DEBUG] [LOCAL ] EXK: Trimmed 76930 records to 53188 (keeping 200 days of data) [2025-11-03T18:51:09.726609] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T18:51:09.936199] [DEBUG] [LOCAL ] EXK: Primary data saved (53188 records). [2025-11-03T18:51:09.936333] [INFO ] [MAIN ] EXK: Full history saved. [2025-11-03T18:51:09.936414] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EXK took 33.4s. Estimated remaining: 3h 39m 33s. Rate: 7.2 symbols/min [2025-11-03T18:51:10.106839] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:10.149490] [DEBUG] [LOCAL ] EXR: Loaded 45913 existing records from primary storage. [2025-11-03T18:51:10.149816] [INFO ] [MAIN ] EXR: Loaded 45913 existing records. [2025-11-03T18:51:10.324426] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:51:10.324663] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-11-03T18:51:10.324725] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-11-03T18:51:10.325508] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-11-03T18:51:10.325564] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-11-03T18:51:10.339946] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-11-03T18:51:10.706853] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:11.134813] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-11-03T18:51:11.167354] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-11 (1.62 seconds). [2025-11-03T18:51:11.168587] [INFO ] [REMOTE ] EXP: Full fetch complete (43113 records). [2025-11-03T18:51:11.168763] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-11-03T18:51:11.533970] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T18:51:11.591230] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-11-03T18:51:11.591312] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-11-03T18:51:11.591951] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-11-03T18:51:11.592014] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-11-03T18:51:11.593063] [DEBUG] [LOCAL ] EXP: Trimmed 43113 records to 28946 (keeping 200 days of data) [2025-11-03T18:51:11.774396] [DEBUG] [LOCAL ] EXP: Primary data saved (28946 records). [2025-11-03T18:51:11.774564] [INFO ] [MAIN ] EXP: Full history saved. [2025-11-03T18:51:11.774694] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EXP took 32.3s. Estimated remaining: 3h 39m 12s. Rate: 7.2 symbols/min [2025-11-03T18:51:11.945252] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-11-03T18:51:11.948553] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:12.000504] [DEBUG] [LOCAL ] F: Loaded 54600 existing records from primary storage. [2025-11-03T18:51:12.000889] [INFO ] [MAIN ] F: Loaded 54600 existing records. [2025-11-03T18:51:12.177629] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:51:12.177847] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-11-03T18:51:12.177894] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-11-03T18:51:12.178884] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-11-03T18:51:12.178941] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-11-03T18:51:12.539761] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:12.565811] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:51:12.734813] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-11-03T18:51:12.942407] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T18:51:13.534864] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-11-03T18:51:14.334861] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-11. [2025-11-03T18:51:14.717218] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:51:14.771275] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-11-03T18:51:15.134912] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-11-03T18:51:15.344715] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T18:51:15.346190] [INFO ] [REMOTE ] EXPD: Full fetch complete (69228 records). [2025-11-03T18:51:15.346471] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-11-03T18:51:15.738841] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-11-03T18:51:15.738913] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-11-03T18:51:15.739920] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-11-03T18:51:15.739988] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-11-03T18:51:15.741406] [DEBUG] [LOCAL ] EXPD: Trimmed 69228 records to 47382 (keeping 200 days of data) [2025-11-03T18:51:15.950742] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-11. [2025-11-03T18:51:16.038214] [DEBUG] [LOCAL ] EXPD: Primary data saved (47382 records). [2025-11-03T18:51:16.038382] [INFO ] [MAIN ] EXPD: Full history saved. [2025-11-03T18:51:16.039118] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EXPD took 30.9s. Estimated remaining: 3h 38m 55s. Rate: 7.2 symbols/min [2025-11-03T18:51:16.547637] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T18:51:16.734821] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-11-03T18:51:17.459620] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T18:51:17.460825] [INFO ] [REMOTE ] EXG: Full fetch complete (49285 records). [2025-11-03T18:51:17.460907] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-11-03T18:51:17.539930] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-11-03T18:51:17.869114] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-11-03T18:51:17.869265] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-11-03T18:51:17.870048] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-11-03T18:51:17.870112] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-11-03T18:51:17.871134] [DEBUG] [LOCAL ] EXG: Trimmed 49285 records to 32730 (keeping 200 days of data) [2025-11-03T18:51:18.061578] [DEBUG] [LOCAL ] EXG: Primary data saved (32730 records). [2025-11-03T18:51:18.061792] [INFO ] [MAIN ] EXG: Full history saved. [2025-11-03T18:51:18.061977] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EXG took 43.2s. Estimated remaining: 3h 38m 34s. Rate: 7.2 symbols/min [2025-11-03T18:51:18.089879] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T18:51:18.334864] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-11-03T18:51:19.634597] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T18:51:19.643991] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-11-03T18:51:19.717362] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-11-03T18:51:19.934890] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-11-03T18:51:20.740907] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T18:51:20.750055] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-11-03T18:51:21.964284] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:51:21.974219] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-11-03T18:51:22.253267] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-11-03T18:51:22.334878] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-11-03T18:51:23.222232] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T18:51:23.232030] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-11-03T18:51:24.359878] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T18:51:24.369790] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-11-03T18:51:24.590054] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-11-03T18:51:24.734884] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-11-03T18:51:25.820226] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T18:51:25.830711] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-11. [2025-11-03T18:51:26.613191] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-11-03T18:51:26.624443] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-11-03T18:51:27.814813] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T18:51:27.816246] [INFO ] [REMOTE ] EXR: Full fetch complete (66110 records). [2025-11-03T18:51:27.816350] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-11-03T18:51:28.215158] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-11-03T18:51:28.215234] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-11-03T18:51:28.216127] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-11-03T18:51:28.216189] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-11-03T18:51:28.217525] [DEBUG] [LOCAL ] EXR: Trimmed 66110 records to 45344 (keeping 200 days of data) [2025-11-03T18:51:28.495122] [DEBUG] [LOCAL ] EXR: Primary data saved (45344 records). [2025-11-03T18:51:28.495266] [INFO ] [MAIN ] EXR: Full history saved. [2025-11-03T18:51:28.495381] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXR took 18.6s. Estimated remaining: 3h 38m 30s. Rate: 7.2 symbols/min [2025-11-03T18:51:28.522630] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-11-03T18:51:28.533353] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-11-03T18:51:30.840075] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-11-03T18:51:30.856037] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-11-03T18:51:33.092487] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-11-03T18:51:33.104630] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-11-03T18:51:34.950052] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-11-03T18:51:34.961299] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-11-03T18:51:37.038989] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-11-03T18:51:37.055003] [INFO ] [REMOTE ] F: Fetching primary data for 2025-11. [2025-11-03T18:51:40.209869] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-11 (3.15 seconds). [2025-11-03T18:51:40.211358] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-11-03T18:51:40.211451] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-11-03T18:51:40.658632] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-11-03T18:51:40.658749] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-11-03T18:51:40.659830] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-11-03T18:51:40.659899] [DEBUG] [LOCAL ] F: Saving primary data. [2025-11-03T18:51:40.661409] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-11-03T18:51:40.987505] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-11-03T18:51:40.987630] [INFO ] [MAIN ] F: Full history saved. [2025-11-03T18:51:40.988408] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. F took 29.2s. Estimated remaining: 3h 38m 30s. Rate: 7.2 symbols/min [2025-11-03T18:51:41.595300] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:41.734515] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:41.733297] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:41.769197] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:41.770240] [DEBUG] [LOCAL ] FBK: No existing data file found in primary storage. [2025-11-03T18:51:41.770302] [WARN ] [MAIN ] FBK: No existing data found, performing full refresh instead. [2025-11-03T18:51:41.770396] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-11-03T18:51:41.770435] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-11-03T18:51:41.770477] [DEBUG] [LOCAL ] FBK: No primary data file found to delete. [2025-11-03T18:51:41.770510] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-11-03T18:51:42.010901] [DEBUG] [LOCAL ] FBIN: Loaded 50901 existing records from primary storage. [2025-11-03T18:51:42.062787] [DEBUG] [LOCAL ] FAF: Loaded 41713 existing records from primary storage. [2025-11-03T18:51:42.056951] [INFO ] [MAIN ] FBIN: Loaded 50901 existing records. [2025-11-03T18:51:42.111755] [INFO ] [MAIN ] FAF: Loaded 41713 existing records. [2025-11-03T18:51:42.167621] [DEBUG] [LOCAL ] FBP: Loaded 46073 existing records from primary storage. [2025-11-03T18:51:42.219824] [INFO ] [MAIN ] FBP: Loaded 46073 existing records. [2025-11-03T18:51:42.621640] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:51:42.658846] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-11-03T18:51:42.689942] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-11-03T18:51:42.703082] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:42.726300] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-11-03T18:51:42.768275] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-11-03T18:51:42.795366] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:51:42.800193] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:51:42.801304] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-11-03T18:51:42.801537] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-11-03T18:51:42.801061] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-11-03T18:51:42.807036] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-11-03T18:51:42.801778] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-11-03T18:51:42.807294] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-11-03T18:51:42.823106] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-11-03T18:51:42.843239] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-11-03T18:51:42.879747] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-11-03T18:51:43.869796] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:43.908377] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-11-03T18:51:43.934712] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T18:51:43.902799] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:43.935741] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-11-03T18:51:43.934251] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:43.940875] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-11-03T18:51:43.941413] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-11-03T18:51:44.535681] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T18:51:44.539423] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-11-03T18:51:44.891719] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:51:44.898909] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-11-03T18:51:45.067105] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T18:51:45.076353] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-11-03T18:51:45.108160] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T18:51:45.118362] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-11-03T18:51:45.146125] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T18:51:45.150411] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-11-03T18:51:45.925448] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T18:51:45.932869] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-11-03T18:51:46.114769] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T18:51:46.123950] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-11-03T18:51:46.178731] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-11-03T18:51:46.185265] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-11-03T18:51:46.284346] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T18:51:46.293941] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-11-03T18:51:46.900195] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-11-03T18:51:46.904881] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-11-03T18:51:47.126218] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T18:51:47.136539] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-11-03T18:51:47.208130] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T18:51:47.216525] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-11-03T18:51:47.410529] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T18:51:47.420665] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-11-03T18:51:47.615674] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T18:51:47.620406] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-11-03T18:51:48.361833] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T18:51:48.371303] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-11-03T18:51:48.521680] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T18:51:48.534173] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-11-03T18:51:48.730535] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T18:51:48.738790] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-11-03T18:51:48.834360] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T18:51:48.844685] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-11-03T18:51:49.450391] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T18:51:49.490398] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T18:51:49.534811] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-11-03T18:51:49.583213] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T18:51:50.089328] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T18:51:50.323466] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:51:50.334822] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-11-03T18:51:51.134829] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-11-03T18:51:51.252617] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T18:51:51.934876] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-11-03T18:51:52.324077] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T18:51:52.734915] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-11. [2025-11-03T18:51:53.018530] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T18:51:53.534882] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-11-03T18:51:53.992204] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-11 (1.26 seconds). [2025-11-03T18:51:53.993273] [INFO ] [REMOTE ] FBK: Full fetch complete (35691 records). [2025-11-03T18:51:53.993347] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-11-03T18:51:54.343153] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-11-03T18:51:54.400219] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-11-03T18:51:54.400302] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-11-03T18:51:54.401049] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-11-03T18:51:54.401113] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-11-03T18:51:54.401998] [DEBUG] [LOCAL ] FBK: Trimmed 35691 records to 26864 (keeping 200 days of data) [2025-11-03T18:51:54.564202] [DEBUG] [LOCAL ] FBK: Primary data saved (26864 records). [2025-11-03T18:51:54.564329] [INFO ] [MAIN ] FBK: Full history saved. [2025-11-03T18:51:54.564400] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. FBK took 13.6s. Estimated remaining: 3h 38m 32s. Rate: 7.2 symbols/min [2025-11-03T18:51:54.729775] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:51:54.762249] [DEBUG] [LOCAL ] FBRT: Loaded 35288 existing records from primary storage. [2025-11-03T18:51:54.762516] [INFO ] [MAIN ] FBRT: Loaded 35288 existing records. [2025-11-03T18:51:54.939213] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:51:54.939757] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-11-03T18:51:54.939858] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-11-03T18:51:54.940502] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-11-03T18:51:54.940681] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-11-03T18:51:55.105482] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T18:51:55.137971] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-11-03T18:51:55.362884] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:51:55.693860] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:51:55.934907] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-11-03T18:51:56.227952] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T18:51:56.734886] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-11-03T18:51:57.201484] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T18:51:57.534876] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-11-03T18:51:58.032673] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:51:58.334913] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-11-03T18:51:58.652614] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T18:51:59.134914] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-11-03T18:51:59.341290] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-11-03T18:51:59.934873] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-11-03T18:52:00.124425] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T18:52:00.734928] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-11-03T18:52:01.545444] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-11-03T18:52:01.552430] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-11-03T18:52:01.859712] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T18:52:02.334884] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-11. [2025-11-03T18:52:02.668041] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:52:03.134864] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-11-03T18:52:03.934880] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-11. [2025-11-03T18:52:04.085117] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:52:04.314890] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T18:52:04.316339] [INFO ] [REMOTE ] FBIN: Full fetch complete (72797 records). [2025-11-03T18:52:04.316427] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-11-03T18:52:04.716701] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-11-03T18:52:04.716802] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-11-03T18:52:04.717802] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-11-03T18:52:04.717883] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-11-03T18:52:04.719410] [DEBUG] [LOCAL ] FBIN: Trimmed 72797 records to 50140 (keeping 200 days of data) [2025-11-03T18:52:04.771776] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-11-03T18:52:05.027867] [DEBUG] [LOCAL ] FBIN: Primary data saved (50140 records). [2025-11-03T18:52:05.028009] [INFO ] [MAIN ] FBIN: Full history saved. [2025-11-03T18:52:05.028089] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. FBIN took 24.0s. Estimated remaining: 3h 38m 27s. Rate: 7.2 symbols/min [2025-11-03T18:52:05.204376] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:52:05.219130] [DEBUG] [LOCAL ] FC: Loaded 13996 existing records from primary storage. [2025-11-03T18:52:05.219389] [INFO ] [MAIN ] FC: Loaded 13996 existing records. [2025-11-03T18:52:05.397726] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:52:05.397942] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-11-03T18:52:05.397989] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-11-03T18:52:05.398464] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-11-03T18:52:05.398519] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-11-03T18:52:05.540144] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-11-03T18:52:05.766113] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-11 (1.83 seconds). [2025-11-03T18:52:05.765889] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:52:05.767771] [INFO ] [REMOTE ] FAF: Full fetch complete (58539 records). [2025-11-03T18:52:05.767852] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-11-03T18:52:06.086809] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T18:52:06.183335] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-11-03T18:52:06.183615] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-11-03T18:52:06.184424] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-11-03T18:52:06.184482] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-11-03T18:52:06.185734] [DEBUG] [LOCAL ] FAF: Trimmed 58539 records to 41156 (keeping 200 days of data) [2025-11-03T18:52:06.355958] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-11-03T18:52:06.434485] [DEBUG] [LOCAL ] FAF: Primary data saved (41156 records). [2025-11-03T18:52:06.434617] [INFO ] [MAIN ] FAF: Full history saved. [2025-11-03T18:52:06.434724] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. FAF took 25.4s. Estimated remaining: 3h 38m 5s. Rate: 7.2 symbols/min [2025-11-03T18:52:06.603831] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:52:06.639589] [DEBUG] [LOCAL ] FCF: Loaded 39159 existing records from primary storage. [2025-11-03T18:52:06.639900] [INFO ] [MAIN ] FCF: Loaded 39159 existing records. [2025-11-03T18:52:06.819324] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:52:06.819567] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-11-03T18:52:06.819615] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-11-03T18:52:06.820302] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-11-03T18:52:06.820359] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-11-03T18:52:07.138214] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-11-03T18:52:07.261514] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:52:07.263968] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-11-03T18:52:07.489388] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T18:52:07.925165] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T18:52:07.934805] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-11-03T18:52:08.498037] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T18:52:08.734965] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-11-03T18:52:09.534899] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-11-03T18:52:10.105099] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T18:52:10.313916] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-11-03T18:52:10.334817] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-11-03T18:52:11.016396] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-11-03T18:52:11.134866] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-11-03T18:52:11.662710] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T18:52:11.934884] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-11. [2025-11-03T18:52:12.734866] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-11-03T18:52:13.331044] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-11-03T18:52:13.534852] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-11-03T18:52:13.708756] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-11 (1.77 seconds). [2025-11-03T18:52:13.710572] [INFO ] [REMOTE ] FBP: Full fetch complete (66835 records). [2025-11-03T18:52:13.710704] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-11-03T18:52:14.138929] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-11-03T18:52:14.139067] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-11-03T18:52:14.140523] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-11-03T18:52:14.140604] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-11-03T18:52:14.142775] [DEBUG] [LOCAL ] FBP: Trimmed 66835 records to 45304 (keeping 200 days of data) [2025-11-03T18:52:14.346051] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-11-03T18:52:14.416444] [DEBUG] [LOCAL ] FBP: Primary data saved (45304 records). [2025-11-03T18:52:14.416594] [INFO ] [MAIN ] FBP: Full history saved. [2025-11-03T18:52:14.416708] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. FBP took 33.4s. Estimated remaining: 3h 37m 56s. Rate: 7.2 symbols/min [2025-11-03T18:52:14.605925] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:52:14.632397] [DEBUG] [LOCAL ] FCN: Loaded 26298 existing records from primary storage. [2025-11-03T18:52:14.632705] [INFO ] [MAIN ] FCN: Loaded 26298 existing records. [2025-11-03T18:52:14.823715] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:52:14.824039] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-11-03T18:52:14.824112] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-11-03T18:52:14.824822] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-11-03T18:52:14.824884] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-11-03T18:52:14.918307] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T18:52:15.137684] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-11-03T18:52:15.251683] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T18:52:15.257544] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:52:15.934885] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-11-03T18:52:16.144325] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T18:52:16.728832] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T18:52:16.734802] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-11-03T18:52:17.534851] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-11-03T18:52:17.566469] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T18:52:18.167693] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-11-03T18:52:18.334890] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-11-03T18:52:19.134818] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-11-03T18:52:19.303370] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T18:52:19.934852] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-11-03T18:52:20.369459] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T18:52:20.734911] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-11-03T18:52:20.978105] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T18:52:21.247781] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T18:52:21.534910] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-11-03T18:52:22.334869] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-11-03T18:52:22.725582] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-11-03T18:52:23.134852] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-11-03T18:52:23.477466] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T18:52:23.934922] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-11-03T18:52:24.194897] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T18:52:24.734929] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-11-03T18:52:25.036045] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:52:25.195614] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-11-03T18:52:25.534864] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-11. [2025-11-03T18:52:26.334927] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-11-03T18:52:26.447111] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T18:52:26.448281] [INFO ] [REMOTE ] FC: Full fetch complete (21540 records). [2025-11-03T18:52:26.448364] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-11-03T18:52:26.827618] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-11-03T18:52:26.827729] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-11-03T18:52:26.828197] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-11-03T18:52:26.828236] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-11-03T18:52:26.828936] [DEBUG] [LOCAL ] FC: Trimmed 21540 records to 13828 (keeping 200 days of data) [2025-11-03T18:52:26.915405] [DEBUG] [LOCAL ] FC: Primary data saved (13828 records). [2025-11-03T18:52:26.915542] [INFO ] [MAIN ] FC: Full history saved. [2025-11-03T18:52:26.915622] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FC took 21.9s. Estimated remaining: 3h 37m 56s. Rate: 7.2 symbols/min [2025-11-03T18:52:27.086796] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:52:27.119818] [DEBUG] [LOCAL ] FCPT: Loaded 37087 existing records from primary storage. [2025-11-03T18:52:27.120106] [INFO ] [MAIN ] FCPT: Loaded 37087 existing records. [2025-11-03T18:52:27.141131] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-11-03T18:52:27.307693] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:52:27.307939] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-11-03T18:52:27.307990] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-11-03T18:52:27.308612] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-11-03T18:52:27.308707] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-11-03T18:52:27.681948] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:52:27.709095] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T18:52:27.934870] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-11-03T18:52:28.228460] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T18:52:28.734920] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-11-03T18:52:29.000863] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T18:52:29.534864] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-11-03T18:52:29.726008] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T18:52:30.334934] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-11-03T18:52:30.573319] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T18:52:31.134877] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-11-03T18:52:31.645271] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T18:52:31.934898] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-11-03T18:52:32.163965] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T18:52:32.734842] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-11. [2025-11-03T18:52:32.777811] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T18:52:33.534901] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-11-03T18:52:34.334887] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-11-03T18:52:34.395009] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T18:52:34.419358] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-11 (1.68 seconds). [2025-11-03T18:52:34.420595] [INFO ] [REMOTE ] FBRT: Full fetch complete (49854 records). [2025-11-03T18:52:34.420691] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-11-03T18:52:34.823370] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-11-03T18:52:34.823456] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-11-03T18:52:34.824163] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-11-03T18:52:34.824228] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-11-03T18:52:34.825334] [DEBUG] [LOCAL ] FBRT: Trimmed 49854 records to 34757 (keeping 200 days of data) [2025-11-03T18:52:35.032480] [DEBUG] [LOCAL ] FBRT: Primary data saved (34757 records). [2025-11-03T18:52:35.032620] [INFO ] [MAIN ] FBRT: Full history saved. [2025-11-03T18:52:35.032733] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBRT took 40.5s. Estimated remaining: 3h 37m 47s. Rate: 7.2 symbols/min [2025-11-03T18:52:35.135176] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-11-03T18:52:35.209093] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:52:35.209259] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-11-03T18:52:35.209297] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-11-03T18:52:35.209455] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-11-03T18:52:35.209519] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-11-03T18:52:35.209569] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-11-03T18:52:35.209603] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-11-03T18:52:35.570119] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T18:52:35.606773] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:52:35.934833] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-11-03T18:52:36.222766] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-11-03T18:52:36.431771] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:52:36.734841] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-11-03T18:52:37.534852] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-11-03T18:52:37.841798] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T18:52:38.334865] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-11-03T18:52:38.752782] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T18:52:38.948806] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T18:52:39.134849] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-11-03T18:52:39.934874] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-11-03T18:52:40.210591] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-11-03T18:52:40.232192] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T18:52:40.734893] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-11-03T18:52:41.028419] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-11-03T18:52:41.534891] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-11-03T18:52:42.239446] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T18:52:42.334827] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-11-03T18:52:43.134906] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-11-03T18:52:43.555957] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-11-03T18:52:43.644939] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T18:52:43.934875] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-11. [2025-11-03T18:52:44.734853] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-11-03T18:52:45.394183] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T18:52:45.395254] [INFO ] [REMOTE ] FCN: Full fetch complete (37162 records). [2025-11-03T18:52:45.395326] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-11-03T18:52:45.544193] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-11-03T18:52:45.769447] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-11-03T18:52:45.769529] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-11-03T18:52:45.770150] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-11-03T18:52:45.770211] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-11-03T18:52:45.771004] [DEBUG] [LOCAL ] FCN: Trimmed 37162 records to 25939 (keeping 200 days of data) [2025-11-03T18:52:45.834357] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T18:52:45.931998] [DEBUG] [LOCAL ] FCN: Primary data saved (25939 records). [2025-11-03T18:52:45.932157] [INFO ] [MAIN ] FCN: Full history saved. [2025-11-03T18:52:45.932304] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FCN took 31.5s. Estimated remaining: 3h 37m 43s. Rate: 7.2 symbols/min [2025-11-03T18:52:46.128469] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:52:46.126206] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T18:52:46.150982] [DEBUG] [LOCAL ] FCT: Loaded 14720 existing records from primary storage. [2025-11-03T18:52:46.151204] [INFO ] [MAIN ] FCT: Loaded 14720 existing records. [2025-11-03T18:52:46.323572] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:52:46.323922] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-11-03T18:52:46.323979] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-11-03T18:52:46.324706] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-11-03T18:52:46.324764] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-11-03T18:52:46.344825] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-11-03T18:52:46.684916] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-11-03T18:52:46.689100] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:52:47.134938] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-11-03T18:52:47.371008] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-11-03T18:52:47.934886] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-11-03T18:52:48.688722] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T18:52:48.734810] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-11-03T18:52:49.319034] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T18:52:49.534867] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-11-03T18:52:50.177773] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-11-03T18:52:50.334858] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-11-03T18:52:51.115709] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-11-03T18:52:51.134873] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-11-03T18:52:51.754284] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-11-03T18:52:51.934888] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-11-03T18:52:52.734900] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-11-03T18:52:53.029885] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:52:53.534880] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-11-03T18:52:53.688383] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T18:52:53.775809] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-11-03T18:52:54.334912] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-11-03T18:52:54.631287] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-11-03T18:52:55.134856] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-11-03T18:52:55.673915] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-11-03T18:52:55.934892] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-11-03T18:52:56.608238] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T18:52:56.734883] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-11-03T18:52:57.534845] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-11-03T18:52:57.940290] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:52:58.099512] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T18:52:58.334862] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-11-03T18:52:58.891693] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-11-03T18:52:59.134912] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-11. [2025-11-03T18:52:59.611591] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-11 (0.48 seconds). [2025-11-03T18:52:59.613162] [INFO ] [REMOTE ] FCRX: Full fetch complete (1602 records). [2025-11-03T18:52:59.613370] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-11-03T18:52:59.786993] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-11-03T18:52:59.787182] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:52:59.787229] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:52:59.787270] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-11-03T18:52:59.787377] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-11-03T18:52:59.787421] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-11-03T18:52:59.787462] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-11-03T18:52:59.787518] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FCRX took 24.8s. Estimated remaining: 3h 37m 46s. Rate: 7.2 symbols/min [2025-11-03T18:52:59.938693] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-11-03T18:52:59.960907] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:00.009709] [DEBUG] [LOCAL ] FCX: Loaded 54482 existing records from primary storage. [2025-11-03T18:53:00.010021] [INFO ] [MAIN ] FCX: Loaded 54482 existing records. [2025-11-03T18:53:00.188165] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:53:00.188394] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-11-03T18:53:00.188442] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-11-03T18:53:00.189571] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-11-03T18:53:00.189630] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-11-03T18:53:00.537215] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:00.734831] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-11-03T18:53:01.272914] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T18:53:01.534822] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-11-03T18:53:02.281426] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T18:53:02.334858] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-11-03T18:53:02.894523] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T18:53:02.970972] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T18:53:03.134809] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-11-03T18:53:03.906570] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T18:53:03.934806] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-11. [2025-11-03T18:53:04.734857] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-11-03T18:53:04.988727] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T18:53:04.989538] [INFO ] [REMOTE ] FCT: Full fetch complete (20986 records). [2025-11-03T18:53:04.989608] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-11-03T18:53:05.372539] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-11-03T18:53:05.372617] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-11-03T18:53:05.373129] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-11-03T18:53:05.373188] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-11-03T18:53:05.373811] [DEBUG] [LOCAL ] FCT: Trimmed 20986 records to 14546 (keeping 200 days of data) [2025-11-03T18:53:05.456880] [DEBUG] [LOCAL ] FCT: Primary data saved (14546 records). [2025-11-03T18:53:05.457017] [INFO ] [MAIN ] FCT: Full history saved. [2025-11-03T18:53:05.457094] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FCT took 19.5s. Estimated remaining: 3h 37m 32s. Rate: 7.2 symbols/min [2025-11-03T18:53:05.540044] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-11-03T18:53:05.625684] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:05.653579] [DEBUG] [LOCAL ] FDP: Loaded 29943 existing records from primary storage. [2025-11-03T18:53:05.653878] [INFO ] [MAIN ] FDP: Loaded 29943 existing records. [2025-11-03T18:53:05.853263] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:53:05.853507] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-11-03T18:53:05.853558] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-11-03T18:53:05.854258] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-11-03T18:53:05.854316] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-11-03T18:53:06.225173] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:06.334894] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-11. [2025-11-03T18:53:06.408129] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-11-03T18:53:06.636269] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T18:53:07.134898] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-11-03T18:53:07.934835] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-11-03T18:53:07.988047] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-11 (1.65 seconds). [2025-11-03T18:53:07.989422] [INFO ] [REMOTE ] FCF: Full fetch complete (57940 records). [2025-11-03T18:53:07.989511] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-11-03T18:53:08.430893] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T18:53:08.461441] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-11-03T18:53:08.461775] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-11-03T18:53:08.462964] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-11-03T18:53:08.463070] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-11-03T18:53:08.464545] [DEBUG] [LOCAL ] FCF: Trimmed 57940 records to 38443 (keeping 200 days of data) [2025-11-03T18:53:08.724960] [DEBUG] [LOCAL ] FCF: Primary data saved (38443 records). [2025-11-03T18:53:08.725186] [INFO ] [MAIN ] FCF: Full history saved. [2025-11-03T18:53:08.726204] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FCF took 1m 2s. Estimated remaining: 3h 37m 14s. Rate: 7.2 symbols/min [2025-11-03T18:53:08.739980] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-11-03T18:53:08.942691] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:08.942855] [DEBUG] [LOCAL ] FDS: No existing data file found in primary storage. [2025-11-03T18:53:08.942894] [WARN ] [MAIN ] FDS: No existing data found, performing full refresh instead. [2025-11-03T18:53:08.943006] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-11-03T18:53:08.943074] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-11-03T18:53:08.943140] [DEBUG] [LOCAL ] FDS: No primary data file found to delete. [2025-11-03T18:53:08.943188] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-11-03T18:53:09.316030] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:09.534821] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-11-03T18:53:09.645299] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-11-03T18:53:09.856866] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T18:53:10.334852] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-11. [2025-11-03T18:53:10.381361] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T18:53:11.134917] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-11-03T18:53:11.848994] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T18:53:11.850344] [INFO ] [REMOTE ] FCPT: Full fetch complete (53873 records). [2025-11-03T18:53:11.850426] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-11-03T18:53:11.935726] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-11-03T18:53:12.250177] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-11-03T18:53:12.255465] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-11-03T18:53:12.264547] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-11-03T18:53:12.264803] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-11-03T18:53:12.265853] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T18:53:12.272130] [DEBUG] [LOCAL ] FCPT: Trimmed 53873 records to 36505 (keeping 200 days of data) [2025-11-03T18:53:12.484352] [DEBUG] [LOCAL ] FCPT: Primary data saved (36505 records). [2025-11-03T18:53:12.484475] [INFO ] [MAIN ] FCPT: Full history saved. [2025-11-03T18:53:12.484549] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCPT took 45.6s. Estimated remaining: 3h 36m 57s. Rate: 7.2 symbols/min [2025-11-03T18:53:12.663724] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:12.712330] [DEBUG] [LOCAL ] FDX: Loaded 51699 existing records from primary storage. [2025-11-03T18:53:12.712621] [INFO ] [MAIN ] FDX: Loaded 51699 existing records. [2025-11-03T18:53:12.745444] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-11-03T18:53:12.899891] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:53:12.900092] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-11-03T18:53:12.900139] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-11-03T18:53:12.901042] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-11-03T18:53:12.901099] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-11-03T18:53:13.262987] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:13.534821] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-11-03T18:53:13.668772] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-11-03T18:53:13.747768] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T18:53:14.334927] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-11-03T18:53:15.009802] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T18:53:15.134818] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-11-03T18:53:15.313233] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T18:53:15.934850] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-11-03T18:53:16.416337] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:53:16.734912] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-11-03T18:53:17.432781] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T18:53:17.534914] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-11-03T18:53:17.654979] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T18:53:18.335128] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-11-03T18:53:18.542785] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-11-03T18:53:19.134909] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-11-03T18:53:19.441990] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T18:53:19.934859] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-11-03T18:53:20.713317] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-11-03T18:53:20.734860] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-11-03T18:53:20.869437] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-11-03T18:53:21.534829] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-11-03T18:53:21.645518] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T18:53:22.334864] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-11-03T18:53:22.976743] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T18:53:23.134824] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-11-03T18:53:23.319124] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-11-03T18:53:23.934828] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-11-03T18:53:24.074438] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T18:53:24.734870] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-11-03T18:53:25.534823] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-11-03T18:53:25.684234] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T18:53:25.789098] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-11-03T18:53:26.334897] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-11-03T18:53:27.134898] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-11-03T18:53:27.205630] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-11-03T18:53:27.368063] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T18:53:27.934877] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-11-03T18:53:28.734846] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-11-03T18:53:28.820268] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-11-03T18:53:28.852273] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T18:53:29.534957] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-11-03T18:53:30.275186] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T18:53:30.334864] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-11-03T18:53:31.134833] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-11-03T18:53:31.212205] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-11-03T18:53:31.941366] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-11-03T18:53:31.947247] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T18:53:32.070090] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T18:53:32.734894] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-11-03T18:53:33.256177] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:53:33.534841] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-11-03T18:53:33.641537] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T18:53:34.334878] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-11-03T18:53:35.134900] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-11-03T18:53:35.394670] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-11-03T18:53:35.540349] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T18:53:35.934859] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-11. [2025-11-03T18:53:36.479146] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T18:53:36.734911] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-11. [2025-11-03T18:53:37.534895] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-11-03T18:53:37.974885] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-11 (2.04 seconds). [2025-11-03T18:53:37.976351] [INFO ] [REMOTE ] FCX: Full fetch complete (77879 records). [2025-11-03T18:53:37.976452] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-11-03T18:53:38.341701] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-11-03T18:53:38.372289] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-11-03T18:53:38.372441] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-11-03T18:53:38.373406] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-11-03T18:53:38.373469] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-11-03T18:53:38.374995] [DEBUG] [LOCAL ] FCX: Trimmed 77879 records to 53702 (keeping 200 days of data) [2025-11-03T18:53:38.592187] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-11 (1.86 seconds). [2025-11-03T18:53:38.614897] [INFO ] [REMOTE ] FDS: Full fetch complete (40472 records). [2025-11-03T18:53:38.622040] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T18:53:38.622124] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-11-03T18:53:39.138304] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-11-03T18:53:39.147157] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-11-03T18:53:39.154179] [DEBUG] [LOCAL ] FCX: Primary data saved (53702 records). [2025-11-03T18:53:39.154409] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-11-03T18:53:39.155115] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-11-03T18:53:39.155190] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-11-03T18:53:39.155434] [INFO ] [MAIN ] FCX: Full history saved. [2025-11-03T18:53:39.155536] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCX took 39.4s. Estimated remaining: 3h 37m 23s. Rate: 7.1 symbols/min [2025-11-03T18:53:39.230933] [DEBUG] [LOCAL ] FDS: Trimmed 40472 records to 28933 (keeping 200 days of data) [2025-11-03T18:53:39.437863] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:39.522276] [DEBUG] [LOCAL ] FDS: Primary data saved (28933 records). [2025-11-03T18:53:39.522432] [INFO ] [MAIN ] FDS: Full history saved. [2025-11-03T18:53:39.522511] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FDS took 30.8s. Estimated remaining: 3h 36m 60s. Rate: 7.2 symbols/min [2025-11-03T18:53:39.714762] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:39.715179] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-11-03T18:53:39.715328] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-11-03T18:53:39.715497] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-11-03T18:53:39.715624] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-11-03T18:53:39.715842] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-11-03T18:53:39.715896] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-11-03T18:53:39.838706] [DEBUG] [LOCAL ] FE: Loaded 54209 existing records from primary storage. [2025-11-03T18:53:39.844892] [INFO ] [MAIN ] FE: Loaded 54209 existing records. [2025-11-03T18:53:40.180104] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:53:40.218487] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-11-03T18:53:40.223637] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-11-03T18:53:40.328346] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-11-03T18:53:40.333459] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-11-03T18:53:40.333675] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-11-03T18:53:40.352337] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:40.382508] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-11-03T18:53:40.425580] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:53:40.744372] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-11-03T18:53:40.744234] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-11. [2025-11-03T18:53:40.750240] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:41.534916] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-11-03T18:53:42.034810] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-11 (1.29 seconds). [2025-11-03T18:53:42.035981] [INFO ] [REMOTE ] FDP: Full fetch complete (43126 records). [2025-11-03T18:53:42.036055] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-11-03T18:53:42.340073] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-11-03T18:53:42.418373] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-11-03T18:53:42.418458] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-11-03T18:53:42.419129] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-11-03T18:53:42.419190] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-11-03T18:53:42.420194] [DEBUG] [LOCAL ] FDP: Trimmed 43126 records to 29616 (keeping 200 days of data) [2025-11-03T18:53:42.599163] [DEBUG] [LOCAL ] FDP: Primary data saved (29616 records). [2025-11-03T18:53:42.599313] [INFO ] [MAIN ] FDP: Full history saved. [2025-11-03T18:53:42.599412] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FDP took 37.1s. Estimated remaining: 3h 36m 41s. Rate: 7.2 symbols/min [2025-11-03T18:53:42.771540] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:42.816430] [DEBUG] [LOCAL ] FERG: Loaded 49195 existing records from primary storage. [2025-11-03T18:53:42.816770] [INFO ] [MAIN ] FERG: Loaded 49195 existing records. [2025-11-03T18:53:43.001626] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:53:43.001915] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-11-03T18:53:43.002039] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-11-03T18:53:43.003130] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-11-03T18:53:43.003190] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-11-03T18:53:43.152030] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-11-03T18:53:43.314847] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-11-03T18:53:43.410976] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:43.556091] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T18:53:43.658162] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T18:53:43.934829] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-11-03T18:53:44.734877] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-11-03T18:53:45.134060] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T18:53:45.189082] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T18:53:45.534857] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-11-03T18:53:46.334857] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-11-03T18:53:46.784240] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T18:53:47.134848] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-11-03T18:53:47.474878] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-11-03T18:53:47.510104] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T18:53:47.934857] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-11-03T18:53:48.734893] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-11-03T18:53:49.110272] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:53:49.534874] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-11-03T18:53:49.865169] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-11-03T18:53:50.271026] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T18:53:50.334893] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-11-03T18:53:50.587916] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-11-03T18:53:51.134874] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-11-03T18:53:51.934856] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-11. [2025-11-03T18:53:52.657081] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T18:53:52.734883] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-11-03T18:53:53.534872] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-11-03T18:53:53.783211] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-11-03T18:53:53.961091] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T18:53:54.104481] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-11 (2.17 seconds). [2025-11-03T18:53:54.106386] [INFO ] [REMOTE ] FDX: Full fetch complete (74071 records). [2025-11-03T18:53:54.106574] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-11-03T18:53:54.340066] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-11-03T18:53:54.508148] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-11-03T18:53:54.508237] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-11-03T18:53:54.509179] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-11-03T18:53:54.509242] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-11-03T18:53:54.510619] [DEBUG] [LOCAL ] FDX: Trimmed 74071 records to 50932 (keeping 200 days of data) [2025-11-03T18:53:54.841420] [DEBUG] [LOCAL ] FDX: Primary data saved (50932 records). [2025-11-03T18:53:54.841555] [INFO ] [MAIN ] FDX: Full history saved. [2025-11-03T18:53:54.841634] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FDX took 42.4s. Estimated remaining: 3h 36m 40s. Rate: 7.2 symbols/min [2025-11-03T18:53:55.032081] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:53:55.045540] [DEBUG] [LOCAL ] FET: Loaded 13323 existing records from primary storage. [2025-11-03T18:53:55.045790] [INFO ] [MAIN ] FET: Loaded 13323 existing records. [2025-11-03T18:53:55.142414] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-11-03T18:53:55.225110] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:53:55.225326] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-11-03T18:53:55.225377] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-11-03T18:53:55.225765] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-11-03T18:53:55.225825] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-11-03T18:53:55.595214] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:53:55.934833] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-11-03T18:53:55.973205] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T18:53:56.468525] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T18:53:56.550695] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T18:53:56.734873] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-11-03T18:53:57.020295] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-11-03T18:53:57.534849] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-11-03T18:53:57.865760] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T18:53:58.334857] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-11-03T18:53:58.581837] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-11-03T18:53:59.134839] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-11-03T18:53:59.934847] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-11-03T18:54:00.632736] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T18:54:00.734838] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-11-03T18:54:01.207861] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-11-03T18:54:01.534846] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-11-03T18:54:01.594874] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-11-03T18:54:02.334846] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-11-03T18:54:02.910043] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T18:54:03.003422] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T18:54:03.134847] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-11. [2025-11-03T18:54:03.632556] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-11 (0.50 seconds). [2025-11-03T18:54:03.633208] [INFO ] [REMOTE ] FENG: Full fetch complete (2248 records). [2025-11-03T18:54:03.633275] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-11-03T18:54:03.824786] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-11-03T18:54:03.825043] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:54:03.825135] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:54:03.825231] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-11-03T18:54:03.825528] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-11-03T18:54:03.825590] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-11-03T18:54:03.825670] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-11-03T18:54:03.825770] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FENG took 24.3s. Estimated remaining: 3h 36m 33s. Rate: 7.2 symbols/min [2025-11-03T18:54:03.938108] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-11-03T18:54:04.015346] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:04.044422] [DEBUG] [LOCAL ] FF: Loaded 23206 existing records from primary storage. [2025-11-03T18:54:04.044837] [INFO ] [MAIN ] FF: Loaded 23206 existing records. [2025-11-03T18:54:04.319532] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:54:04.319848] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-11-03T18:54:04.319913] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-11-03T18:54:04.320477] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-11-03T18:54:04.320543] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-11-03T18:54:04.740019] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-11-03T18:54:04.861261] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:05.241433] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:54:05.279558] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T18:54:05.534956] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-11-03T18:54:06.334857] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-11-03T18:54:06.804885] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T18:54:07.134833] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-11-03T18:54:07.152244] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T18:54:07.934858] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-11-03T18:54:08.359050] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T18:54:08.734852] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-11-03T18:54:09.252450] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T18:54:09.544683] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-11-03T18:54:09.545858] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T18:54:10.334857] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-11-03T18:54:10.591847] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T18:54:11.134823] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-11-03T18:54:11.265686] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T18:54:11.645821] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-11-03T18:54:11.934855] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-11-03T18:54:12.556203] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-11-03T18:54:12.734917] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-11-03T18:54:13.534864] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-11-03T18:54:14.131931] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T18:54:14.334833] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-11-03T18:54:14.530572] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T18:54:15.134870] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-11-03T18:54:15.738620] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T18:54:15.934851] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-11-03T18:54:16.585706] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-11-03T18:54:16.645727] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T18:54:16.734892] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-11. [2025-11-03T18:54:17.534910] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-11-03T18:54:18.334903] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-11-03T18:54:18.427911] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-11 (1.69 seconds). [2025-11-03T18:54:18.429282] [INFO ] [REMOTE ] FERG: Full fetch complete (71043 records). [2025-11-03T18:54:18.429366] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-11-03T18:54:18.836726] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-11-03T18:54:18.836814] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-11-03T18:54:18.837773] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-11-03T18:54:18.838012] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-11-03T18:54:18.839343] [DEBUG] [LOCAL ] FERG: Trimmed 71043 records to 48384 (keeping 200 days of data) [2025-11-03T18:54:19.068559] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T18:54:19.137429] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-11-03T18:54:19.169848] [DEBUG] [LOCAL ] FERG: Primary data saved (48384 records). [2025-11-03T18:54:19.170460] [INFO ] [MAIN ] FERG: Full history saved. [2025-11-03T18:54:19.171401] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FERG took 36.6s. Estimated remaining: 3h 36m 38s. Rate: 7.2 symbols/min [2025-11-03T18:54:19.387048] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:19.390013] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-11-03T18:54:19.407693] [DEBUG] [LOCAL ] FFA: Loaded 5309 existing records from primary storage. [2025-11-03T18:54:19.407988] [INFO ] [MAIN ] FFA: Loaded 5309 existing records. [2025-11-03T18:54:19.607141] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:54:19.607421] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-11-03T18:54:19.607474] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-11-03T18:54:19.607750] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-11-03T18:54:19.607820] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-11-03T18:54:19.935528] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-11. [2025-11-03T18:54:19.982125] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:19.984469] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-11-03T18:54:20.734860] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-11-03T18:54:21.235004] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T18:54:21.236545] [INFO ] [REMOTE ] FE: Full fetch complete (77503 records). [2025-11-03T18:54:21.236632] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-11-03T18:54:21.539973] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-11-03T18:54:21.676691] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-11-03T18:54:21.677330] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-11-03T18:54:21.677984] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T18:54:21.679587] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-11-03T18:54:21.685588] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-11-03T18:54:21.687203] [DEBUG] [LOCAL ] FE: Trimmed 77503 records to 53437 (keeping 200 days of data) [2025-11-03T18:54:22.007179] [DEBUG] [LOCAL ] FE: Primary data saved (53437 records). [2025-11-03T18:54:22.007339] [INFO ] [MAIN ] FE: Full history saved. [2025-11-03T18:54:22.007431] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FE took 42.9s. Estimated remaining: 3h 36m 19s. Rate: 7.2 symbols/min [2025-11-03T18:54:22.135532] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T18:54:22.184101] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:22.184257] [DEBUG] [LOCAL ] FFC: No existing data file found in primary storage. [2025-11-03T18:54:22.184293] [WARN ] [MAIN ] FFC: No existing data found, performing full refresh instead. [2025-11-03T18:54:22.184399] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-11-03T18:54:22.184440] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-11-03T18:54:22.184479] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-11-03T18:54:22.184510] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-11-03T18:54:22.335531] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-11. [2025-11-03T18:54:22.532496] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:23.134825] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-11-03T18:54:23.491701] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T18:54:23.492566] [INFO ] [REMOTE ] FET: Full fetch complete (18939 records). [2025-11-03T18:54:23.492632] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-11-03T18:54:23.853432] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-11-03T18:54:23.853536] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-11-03T18:54:23.854070] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-11-03T18:54:23.854228] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-11-03T18:54:23.854891] [DEBUG] [LOCAL ] FET: Trimmed 18939 records to 13172 (keeping 200 days of data) [2025-11-03T18:54:23.936194] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-11-03T18:54:23.936342] [DEBUG] [LOCAL ] FET: Primary data saved (13172 records). [2025-11-03T18:54:23.943484] [INFO ] [MAIN ] FET: Full history saved. [2025-11-03T18:54:23.943629] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FET took 29.1s. Estimated remaining: 3h 35m 58s. Rate: 7.2 symbols/min [2025-11-03T18:54:23.946144] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T18:54:24.120354] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:24.120512] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-11-03T18:54:24.120548] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-11-03T18:54:24.120685] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-11-03T18:54:24.120738] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-11-03T18:54:24.120780] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-11-03T18:54:24.120811] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-11-03T18:54:24.467108] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:24.734828] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-11-03T18:54:24.834166] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T18:54:25.534835] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-11-03T18:54:25.625970] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:54:26.316355] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T18:54:26.334829] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-11-03T18:54:26.969014] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T18:54:27.134882] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-11-03T18:54:27.753185] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-11-03T18:54:27.934859] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-11-03T18:54:28.688185] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-11-03T18:54:28.734824] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-11-03T18:54:29.522286] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:54:29.534873] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-11-03T18:54:30.254737] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T18:54:30.334888] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-11-03T18:54:31.134871] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-11-03T18:54:31.348902] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T18:54:31.810979] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T18:54:31.934876] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-11-03T18:54:32.366660] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-11-03T18:54:32.734856] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-11-03T18:54:33.179494] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-11-03T18:54:33.534919] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-11-03T18:54:34.334879] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-11-03T18:54:34.528389] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T18:54:34.749150] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-11-03T18:54:35.134865] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-11-03T18:54:35.934873] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-11-03T18:54:36.294491] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T18:54:36.332069] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T18:54:36.734897] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-11-03T18:54:37.182742] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-11-03T18:54:37.534895] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-11-03T18:54:38.334880] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-11-03T18:54:38.557579] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T18:54:39.073704] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T18:54:39.134889] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-11-03T18:54:39.851504] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-11-03T18:54:39.934876] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-11-03T18:54:40.588758] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-11-03T18:54:40.734877] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-11-03T18:54:41.468018] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-11-03T18:54:41.534814] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-11. [2025-11-03T18:54:42.334870] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-11-03T18:54:42.561583] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T18:54:42.562581] [INFO ] [REMOTE ] FF: Full fetch complete (35967 records). [2025-11-03T18:54:42.562689] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-11-03T18:54:42.935998] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-11-03T18:54:42.936074] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-11-03T18:54:42.936624] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-11-03T18:54:42.936697] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-11-03T18:54:42.937454] [DEBUG] [LOCAL ] FF: Trimmed 35967 records to 22640 (keeping 200 days of data) [2025-11-03T18:54:43.061416] [DEBUG] [LOCAL ] FF: Primary data saved (22640 records). [2025-11-03T18:54:43.061529] [INFO ] [MAIN ] FF: Full history saved. [2025-11-03T18:54:43.061602] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FF took 39.2s. Estimated remaining: 3h 36m 10s. Rate: 7.2 symbols/min [2025-11-03T18:54:43.140096] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-11-03T18:54:43.234182] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:43.234347] [DEBUG] [LOCAL ] FG: No existing data file found in primary storage. [2025-11-03T18:54:43.234401] [WARN ] [MAIN ] FG: No existing data found, performing full refresh instead. [2025-11-03T18:54:43.234507] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-11-03T18:54:43.234548] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-11-03T18:54:43.234589] [DEBUG] [LOCAL ] FG: No primary data file found to delete. [2025-11-03T18:54:43.234621] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-11-03T18:54:43.411610] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T18:54:43.604462] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-11-03T18:54:43.628219] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:43.934924] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-11-03T18:54:44.734852] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-11-03T18:54:44.884517] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-11-03T18:54:45.294724] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-11-03T18:54:45.534894] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-11-03T18:54:46.334826] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-11-03T18:54:46.471585] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T18:54:47.004720] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-11-03T18:54:47.134888] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-11-03T18:54:47.693551] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T18:54:47.934846] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-11-03T18:54:48.362486] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-11-03T18:54:48.734850] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-11-03T18:54:49.534820] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-11-03T18:54:49.703032] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T18:54:50.227777] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T18:54:50.334850] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-11. [2025-11-03T18:54:51.134884] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-11-03T18:54:51.203788] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T18:54:51.204597] [INFO ] [REMOTE ] FFC: Full fetch complete (24427 records). [2025-11-03T18:54:51.204688] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-11-03T18:54:51.564769] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-11-03T18:54:51.564847] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-11-03T18:54:51.565321] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-11-03T18:54:51.565358] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-11-03T18:54:51.565983] [DEBUG] [LOCAL ] FFC: Trimmed 24427 records to 16163 (keeping 200 days of data) [2025-11-03T18:54:51.660547] [DEBUG] [LOCAL ] FFC: Primary data saved (16163 records). [2025-11-03T18:54:51.660690] [INFO ] [MAIN ] FFC: Full history saved. [2025-11-03T18:54:51.660770] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FFC took 29.7s. Estimated remaining: 3h 36m 2s. Rate: 7.2 symbols/min [2025-11-03T18:54:51.832372] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:51.837085] [DEBUG] [LOCAL ] FGN: Loaded 3503 existing records from primary storage. [2025-11-03T18:54:51.837276] [INFO ] [MAIN ] FGN: Loaded 3503 existing records. [2025-11-03T18:54:51.938698] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-11-03T18:54:52.017329] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:54:52.017665] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-11-03T18:54:52.017728] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-11-03T18:54:52.017986] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-11-03T18:54:52.018045] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-11-03T18:54:52.380554] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-11-03T18:54:52.399879] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:52.418680] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-11-03T18:54:52.734851] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-11-03T18:54:53.266841] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-11-03T18:54:53.534878] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-11-03T18:54:53.916478] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-11-03T18:54:54.334887] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-11-03T18:54:54.643945] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-11-03T18:54:55.134869] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-11-03T18:54:55.866193] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T18:54:55.934870] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-11-03T18:54:56.734877] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-11. [2025-11-03T18:54:56.827981] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T18:54:57.469530] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-11 (0.73 seconds). [2025-11-03T18:54:57.470484] [INFO ] [REMOTE ] FFA: Full fetch complete (8646 records). [2025-11-03T18:54:57.470565] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-11-03T18:54:57.540041] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-11-03T18:54:57.829414] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-11-03T18:54:57.829492] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-11-03T18:54:57.829715] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-11-03T18:54:57.829776] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-11-03T18:54:57.830155] [DEBUG] [LOCAL ] FFA: Trimmed 8646 records to 5192 (keeping 200 days of data) [2025-11-03T18:54:57.859732] [DEBUG] [LOCAL ] FFA: Primary data saved (5192 records). [2025-11-03T18:54:57.859806] [INFO ] [MAIN ] FFA: Full history saved. [2025-11-03T18:54:57.859879] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FFA took 38.7s. Estimated remaining: 3h 35m 49s. Rate: 7.2 symbols/min [2025-11-03T18:54:58.004871] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-11-03T18:54:58.036908] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:54:58.037099] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-11-03T18:54:58.037154] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-11-03T18:54:58.037263] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-11-03T18:54:58.037329] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-11-03T18:54:58.037390] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-11-03T18:54:58.037444] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-11-03T18:54:58.348305] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-11-03T18:54:58.388152] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:54:59.134824] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-11. [2025-11-03T18:54:59.182737] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-11-03T18:54:59.934846] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-11-03T18:55:00.734889] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-11-03T18:55:00.801953] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-11 (1.67 seconds). [2025-11-03T18:55:00.809819] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T18:55:00.812015] [INFO ] [REMOTE ] FFWM: Full fetch complete (52574 records). [2025-11-03T18:55:00.814177] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-11-03T18:55:01.189150] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-11-03T18:55:01.189226] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-11-03T18:55:01.189953] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-11-03T18:55:01.190015] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-11-03T18:55:01.191033] [DEBUG] [LOCAL ] FFWM: Trimmed 52574 records to 35520 (keeping 200 days of data) [2025-11-03T18:55:01.382897] [DEBUG] [LOCAL ] FFWM: Primary data saved (35520 records). [2025-11-03T18:55:01.383030] [INFO ] [MAIN ] FFWM: Full history saved. [2025-11-03T18:55:01.383098] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FFWM took 37.4s. Estimated remaining: 3h 35m 32s. Rate: 7.2 symbols/min [2025-11-03T18:55:01.540026] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-11-03T18:55:01.572451] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:01.573320] [DEBUG] [LOCAL ] FHI: No existing data file found in primary storage. [2025-11-03T18:55:01.573369] [WARN ] [MAIN ] FHI: No existing data found, performing full refresh instead. [2025-11-03T18:55:01.573488] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-11-03T18:55:01.573530] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-11-03T18:55:01.573573] [DEBUG] [LOCAL ] FHI: No primary data file found to delete. [2025-11-03T18:55:01.573607] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-11-03T18:55:01.973961] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:02.334845] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-11-03T18:55:02.402172] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-11-03T18:55:02.484634] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-11-03T18:55:03.134897] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-11-03T18:55:03.696158] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T18:55:03.934881] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-11-03T18:55:03.952781] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T18:55:04.363076] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-11-03T18:55:04.734907] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-11-03T18:55:05.100336] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T18:55:05.534824] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-11-03T18:55:06.334885] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-11-03T18:55:06.655372] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T18:55:07.076057] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T18:55:07.134854] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-11-03T18:55:07.919946] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:55:07.934824] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-11-03T18:55:08.734891] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-11-03T18:55:09.144546] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T18:55:09.233533] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:55:09.534849] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-11-03T18:55:09.905040] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-11-03T18:55:10.334856] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-11-03T18:55:11.044825] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T18:55:11.134827] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-11. [2025-11-03T18:55:11.934905] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-11-03T18:55:12.301709] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T18:55:12.303034] [INFO ] [REMOTE ] FG: Full fetch complete (29132 records). [2025-11-03T18:55:12.303147] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-11-03T18:55:12.510922] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-11-03T18:55:12.740152] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-11-03T18:55:12.900293] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-11-03T18:55:12.900392] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-11-03T18:55:12.901118] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-11-03T18:55:12.901186] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-11-03T18:55:12.902292] [DEBUG] [LOCAL ] FG: Trimmed 29132 records to 20194 (keeping 200 days of data) [2025-11-03T18:55:13.055567] [DEBUG] [LOCAL ] FG: Primary data saved (20194 records). [2025-11-03T18:55:13.055786] [INFO ] [MAIN ] FG: Full history saved. [2025-11-03T18:55:13.055892] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FG took 30.0s. Estimated remaining: 3h 35m 30s. Rate: 7.2 symbols/min [2025-11-03T18:55:13.168127] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-11-03T18:55:13.240081] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:13.296903] [DEBUG] [LOCAL ] FHN: Loaded 54176 existing records from primary storage. [2025-11-03T18:55:13.297485] [INFO ] [MAIN ] FHN: Loaded 54176 existing records. [2025-11-03T18:55:13.476443] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:55:13.476726] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-11-03T18:55:13.476781] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-11-03T18:55:13.477797] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-11-03T18:55:13.477855] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-11-03T18:55:13.540085] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-11-03T18:55:13.860585] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:13.933415] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-11-03T18:55:14.334886] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-11-03T18:55:15.134955] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-11-03T18:55:15.527906] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T18:55:15.600701] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T18:55:15.934858] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-11-03T18:55:16.734887] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-11-03T18:55:16.998242] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T18:55:17.534877] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-11-03T18:55:17.945363] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-11-03T18:55:17.985499] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T18:55:18.334886] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-11-03T18:55:19.134923] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-11-03T18:55:19.514440] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:55:19.934867] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-11-03T18:55:20.276975] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-11-03T18:55:20.433263] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:55:20.734852] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-11-03T18:55:21.534953] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-11-03T18:55:21.813810] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T18:55:22.334922] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-11-03T18:55:22.732598] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T18:55:22.769802] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T18:55:23.134919] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-11-03T18:55:23.463834] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T18:55:23.934917] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-11-03T18:55:24.268269] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-11-03T18:55:24.734877] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-11. [2025-11-03T18:55:25.285148] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T18:55:25.286095] [INFO ] [REMOTE ] FGN: Full fetch complete (5356 records). [2025-11-03T18:55:25.286184] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-11-03T18:55:25.541711] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-11-03T18:55:25.665854] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-11-03T18:55:25.665935] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-11-03T18:55:25.666096] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-11-03T18:55:25.666155] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-11-03T18:55:25.666503] [DEBUG] [LOCAL ] FGN: Trimmed 5356 records to 3440 (keeping 200 days of data) [2025-11-03T18:55:25.686613] [DEBUG] [LOCAL ] FGN: Primary data saved (3440 records). [2025-11-03T18:55:25.686726] [INFO ] [MAIN ] FGN: Full history saved. [2025-11-03T18:55:25.686817] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FGN took 34.0s. Estimated remaining: 3h 35m 29s. Rate: 7.2 symbols/min [2025-11-03T18:55:25.853924] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:25.906065] [DEBUG] [LOCAL ] FI: Loaded 54355 existing records from primary storage. [2025-11-03T18:55:25.906416] [INFO ] [MAIN ] FI: Loaded 54355 existing records. [2025-11-03T18:55:26.087421] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:55:26.087706] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-11-03T18:55:26.087767] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-11-03T18:55:26.089042] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-11-03T18:55:26.089107] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-11-03T18:55:26.340161] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-11-03T18:55:26.460223] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:26.688887] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T18:55:26.748486] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-11-03T18:55:27.134926] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-11-03T18:55:27.558463] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T18:55:27.934873] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-11-03T18:55:28.734843] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-11-03T18:55:28.918125] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-11-03T18:55:29.534915] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-11-03T18:55:30.192458] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T18:55:30.334878] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-11. [2025-11-03T18:55:30.676585] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T18:55:30.949189] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-11 (0.61 seconds). [2025-11-03T18:55:30.949942] [INFO ] [REMOTE ] FGSN: Full fetch complete (8271 records). [2025-11-03T18:55:30.950012] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-11-03T18:55:31.135135] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-11-03T18:55:31.161366] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-11-03T18:55:31.162496] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-11-03T18:55:31.162572] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-11-03T18:55:31.162673] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-11-03T18:55:31.162779] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-11-03T18:55:31.162836] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-11-03T18:55:31.162882] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-11-03T18:55:31.162942] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FGSN took 33.3s. Estimated remaining: 3h 35m 15s. Rate: 7.2 symbols/min [2025-11-03T18:55:31.352783] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:31.374033] [DEBUG] [LOCAL ] FICO: Loaded 22177 existing records from primary storage. [2025-11-03T18:55:31.374321] [INFO ] [MAIN ] FICO: Loaded 22177 existing records. [2025-11-03T18:55:31.570281] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:55:31.570526] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-11-03T18:55:31.570582] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-11-03T18:55:31.571172] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-11-03T18:55:31.571232] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-11-03T18:55:31.930768] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:31.934825] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-11-03T18:55:32.507188] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T18:55:32.734836] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-11. [2025-11-03T18:55:32.823917] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T18:55:33.534917] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-11-03T18:55:34.121726] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-11 (1.39 seconds). [2025-11-03T18:55:34.123083] [INFO ] [REMOTE ] FHI: Full fetch complete (57364 records). [2025-11-03T18:55:34.123204] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-11-03T18:55:34.342578] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-11-03T18:55:34.525561] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T18:55:34.549188] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-11-03T18:55:34.549250] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-11-03T18:55:34.550015] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-11-03T18:55:34.550099] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-11-03T18:55:34.551207] [DEBUG] [LOCAL ] FHI: Trimmed 57364 records to 39191 (keeping 200 days of data) [2025-11-03T18:55:34.777030] [DEBUG] [LOCAL ] FHI: Primary data saved (39191 records). [2025-11-03T18:55:34.777164] [INFO ] [MAIN ] FHI: Full history saved. [2025-11-03T18:55:34.777232] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FHI took 33.4s. Estimated remaining: 3h 34m 58s. Rate: 7.2 symbols/min [2025-11-03T18:55:34.944567] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:34.944776] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-11-03T18:55:34.944820] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-11-03T18:55:34.944952] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-11-03T18:55:34.944993] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-11-03T18:55:34.945034] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-11-03T18:55:34.945065] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-11-03T18:55:35.143026] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-11-03T18:55:35.307071] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:35.684105] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T18:55:35.934828] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-11-03T18:55:35.953765] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T18:55:36.156310] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-11-03T18:55:36.734909] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-11-03T18:55:37.534860] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-11-03T18:55:37.577475] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T18:55:37.763756] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-11-03T18:55:38.334890] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-11-03T18:55:39.134877] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-11-03T18:55:39.249994] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T18:55:39.934917] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-11-03T18:55:40.151301] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-11-03T18:55:40.532250] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T18:55:40.734862] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-11-03T18:55:41.534848] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-11-03T18:55:42.035207] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:55:42.274058] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T18:55:42.334868] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-11-03T18:55:43.134858] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-11-03T18:55:43.713480] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T18:55:43.934859] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-11-03T18:55:44.442168] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T18:55:44.734850] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-11-03T18:55:45.314256] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T18:55:45.534884] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-11-03T18:55:46.234703] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T18:55:46.334845] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-11-03T18:55:46.877187] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T18:55:47.134856] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-11-03T18:55:47.368212] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-11-03T18:55:47.701893] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T18:55:47.934851] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-11-03T18:55:48.160596] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-11-03T18:55:48.734861] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-11-03T18:55:49.534854] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-11-03T18:55:50.143179] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T18:55:50.334824] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-11-03T18:55:50.427052] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-11-03T18:55:51.134847] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-11-03T18:55:51.795052] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-11-03T18:55:51.934829] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-11. [2025-11-03T18:55:52.067175] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T18:55:52.734862] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-11-03T18:55:52.883581] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:55:52.883938] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-11-03T18:55:52.884045] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:55:52.884121] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-11-03T18:55:52.884184] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:55:52.884253] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-11-03T18:55:52.884314] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-11-03T18:55:52.884349] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-11-03T18:55:52.884407] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-11-03T18:55:52.884453] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FIG took 18.1s. Estimated remaining: 3h 35m 8s. Rate: 7.1 symbols/min [2025-11-03T18:55:53.056691] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:53.100849] [DEBUG] [LOCAL ] FIGS: Loaded 48932 existing records from primary storage. [2025-11-03T18:55:53.101192] [INFO ] [MAIN ] FIGS: Loaded 48932 existing records. [2025-11-03T18:55:53.276510] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:55:53.276753] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-11-03T18:55:53.276804] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-11-03T18:55:53.277503] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-11-03T18:55:53.277560] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-11-03T18:55:53.545189] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-11-03T18:55:53.634477] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:53.862961] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-11 (1.93 seconds). [2025-11-03T18:55:53.865271] [INFO ] [REMOTE ] FHN: Full fetch complete (77482 records). [2025-11-03T18:55:53.865515] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-11-03T18:55:54.313858] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-11-03T18:55:54.314001] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-11-03T18:55:54.315265] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-11-03T18:55:54.315403] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-11-03T18:55:54.317177] [DEBUG] [LOCAL ] FHN: Trimmed 77482 records to 53395 (keeping 200 days of data) [2025-11-03T18:55:54.377062] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-11-03T18:55:54.439030] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T18:55:54.671036] [DEBUG] [LOCAL ] FHN: Primary data saved (53395 records). [2025-11-03T18:55:54.671168] [INFO ] [MAIN ] FHN: Full history saved. [2025-11-03T18:55:54.671244] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FHN took 41.6s. Estimated remaining: 3h 34m 47s. Rate: 7.2 symbols/min [2025-11-03T18:55:54.841520] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:55:54.875749] [DEBUG] [LOCAL ] FIHL: Loaded 39116 existing records from primary storage. [2025-11-03T18:55:54.876053] [INFO ] [MAIN ] FIHL: Loaded 39116 existing records. [2025-11-03T18:55:55.068584] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:55:55.068828] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-11-03T18:55:55.068880] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-11-03T18:55:55.069516] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-11-03T18:55:55.069575] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-11-03T18:55:55.144581] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-11-03T18:55:55.432907] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:55:55.691017] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:55:55.934849] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-11-03T18:55:56.734884] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-11-03T18:55:56.855602] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-11-03T18:55:57.117121] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T18:55:57.534859] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-11-03T18:55:57.630377] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-11-03T18:55:58.334893] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-11-03T18:55:58.879238] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T18:55:59.134826] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-11-03T18:55:59.277988] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T18:55:59.934841] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-11-03T18:56:00.734824] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-11. [2025-11-03T18:56:00.970503] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-11-03T18:56:01.043849] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T18:56:01.534907] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-11-03T18:56:02.334920] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-11-03T18:56:02.452355] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-11 (1.72 seconds). [2025-11-03T18:56:02.453578] [INFO ] [REMOTE ] FICO: Full fetch complete (30662 records). [2025-11-03T18:56:02.453671] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-11-03T18:56:02.835774] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-11-03T18:56:02.835899] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-11-03T18:56:02.836465] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-11-03T18:56:02.836538] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-11-03T18:56:02.837708] [DEBUG] [LOCAL ] FICO: Trimmed 30662 records to 22233 (keeping 200 days of data) [2025-11-03T18:56:02.959412] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T18:56:03.025073] [DEBUG] [LOCAL ] FICO: Primary data saved (22233 records). [2025-11-03T18:56:03.025213] [INFO ] [MAIN ] FICO: Full history saved. [2025-11-03T18:56:03.025294] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FICO took 31.9s. Estimated remaining: 3h 34m 39s. Rate: 7.2 symbols/min [2025-11-03T18:56:03.139966] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-11-03T18:56:03.203784] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:03.212576] [DEBUG] [LOCAL ] FINS: Loaded 8239 existing records from primary storage. [2025-11-03T18:56:03.212799] [INFO ] [MAIN ] FINS: Loaded 8239 existing records. [2025-11-03T18:56:03.394755] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:56:03.395051] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-11-03T18:56:03.395193] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-11-03T18:56:03.395468] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-11-03T18:56:03.395527] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-11-03T18:56:03.774019] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:03.789770] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T18:56:03.934841] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-11-03T18:56:04.414689] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T18:56:04.734833] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-11-03T18:56:04.930010] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-11-03T18:56:05.534900] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-11. [2025-11-03T18:56:05.810903] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T18:56:06.334869] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-11-03T18:56:06.768107] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-11-03T18:56:07.134870] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-11-03T18:56:07.934870] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-11-03T18:56:08.342092] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-11-03T18:56:08.421369] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T18:56:08.561946] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-11 (3.03 seconds). [2025-11-03T18:56:08.563424] [INFO ] [REMOTE ] FI: Full fetch complete (77513 records). [2025-11-03T18:56:08.563513] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-11-03T18:56:08.740803] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-11-03T18:56:08.964547] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-11-03T18:56:08.964614] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-11-03T18:56:08.965620] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-11-03T18:56:08.965723] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-11-03T18:56:08.967200] [DEBUG] [LOCAL ] FI: Trimmed 77513 records to 53592 (keeping 200 days of data) [2025-11-03T18:56:09.283551] [DEBUG] [LOCAL ] FI: Primary data saved (53592 records). [2025-11-03T18:56:09.283734] [INFO ] [MAIN ] FI: Full history saved. [2025-11-03T18:56:09.283827] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FI took 43.6s. Estimated remaining: 3h 34m 27s. Rate: 7.2 symbols/min [2025-11-03T18:56:09.407672] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T18:56:09.466192] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:09.504312] [DEBUG] [LOCAL ] FINV: Loaded 45954 existing records from primary storage. [2025-11-03T18:56:09.504599] [INFO ] [MAIN ] FINV: Loaded 45954 existing records. [2025-11-03T18:56:09.540056] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-11-03T18:56:09.682581] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:56:09.682768] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-11-03T18:56:09.682816] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-11-03T18:56:09.683437] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-11-03T18:56:09.683494] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-11-03T18:56:10.026893] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:10.165955] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T18:56:10.334909] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-11-03T18:56:10.866579] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T18:56:11.134903] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-11-03T18:56:11.934895] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-11-03T18:56:12.584166] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T18:56:12.734882] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-11-03T18:56:12.951574] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T18:56:13.534911] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-11-03T18:56:13.996014] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T18:56:14.334869] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-11-03T18:56:14.660478] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T18:56:15.134852] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-11-03T18:56:15.738402] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:56:15.934859] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-11-03T18:56:16.087064] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T18:56:16.734858] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-11-03T18:56:17.266562] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:56:17.534876] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-11-03T18:56:17.796266] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T18:56:18.334870] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-11-03T18:56:18.848773] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T18:56:19.134869] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-11-03T18:56:19.507373] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T18:56:19.934857] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-11-03T18:56:20.524408] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T18:56:20.734928] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-11. [2025-11-03T18:56:21.192161] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T18:56:21.534886] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-11-03T18:56:22.334921] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-11-03T18:56:22.661725] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T18:56:22.713393] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-11 (1.98 seconds). [2025-11-03T18:56:22.714854] [INFO ] [REMOTE ] FIGS: Full fetch complete (70596 records). [2025-11-03T18:56:22.714974] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-11-03T18:56:22.900727] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-11-03T18:56:23.127952] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-11-03T18:56:23.128045] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-11-03T18:56:23.128995] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-11-03T18:56:23.129067] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-11-03T18:56:23.130474] [DEBUG] [LOCAL ] FIGS: Trimmed 70596 records to 48278 (keeping 200 days of data) [2025-11-03T18:56:23.173833] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-11-03T18:56:23.401018] [DEBUG] [LOCAL ] FIGS: Primary data saved (48278 records). [2025-11-03T18:56:23.401159] [INFO ] [MAIN ] FIGS: Full history saved. [2025-11-03T18:56:23.401243] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FIGS took 30.5s. Estimated remaining: 3h 34m 29s. Rate: 7.2 symbols/min [2025-11-03T18:56:23.572122] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:23.618558] [DEBUG] [LOCAL ] FIS: Loaded 54103 existing records from primary storage. [2025-11-03T18:56:23.618913] [INFO ] [MAIN ] FIS: Loaded 54103 existing records. [2025-11-03T18:56:23.798046] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:56:23.798362] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-11-03T18:56:23.798418] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-11-03T18:56:23.799559] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-11-03T18:56:23.799617] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-11-03T18:56:23.940079] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-11-03T18:56:24.172537] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:24.267248] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T18:56:24.734888] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-11-03T18:56:25.141085] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-11-03T18:56:25.311210] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T18:56:25.534886] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-11-03T18:56:26.334946] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-11-03T18:56:26.775214] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T18:56:27.134939] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-11-03T18:56:27.408225] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T18:56:27.934901] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-11-03T18:56:28.321093] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T18:56:28.532175] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T18:56:28.734883] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-11-03T18:56:29.534910] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-11-03T18:56:29.962284] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T18:56:30.334852] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-11-03T18:56:30.811546] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T18:56:31.134839] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-11-03T18:56:31.724419] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T18:56:31.934862] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-11-03T18:56:32.589991] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T18:56:32.734854] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-11-03T18:56:33.422130] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T18:56:33.534837] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-11. [2025-11-03T18:56:34.174612] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T18:56:34.334851] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-11-03T18:56:35.134845] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-11-03T18:56:35.218820] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-11 (1.68 seconds). [2025-11-03T18:56:35.220437] [INFO ] [REMOTE ] FIHL: Full fetch complete (56487 records). [2025-11-03T18:56:35.220560] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-11-03T18:56:35.637403] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-11-03T18:56:35.637514] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-11-03T18:56:35.638360] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-11-03T18:56:35.638445] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-11-03T18:56:35.639688] [DEBUG] [LOCAL ] FIHL: Trimmed 56487 records to 38381 (keeping 200 days of data) [2025-11-03T18:56:35.892490] [DEBUG] [LOCAL ] FIHL: Primary data saved (38381 records). [2025-11-03T18:56:35.892783] [INFO ] [MAIN ] FIHL: Full history saved. [2025-11-03T18:56:35.892928] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FIHL took 41.2s. Estimated remaining: 3h 34m 28s. Rate: 7.1 symbols/min [2025-11-03T18:56:35.936917] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-11-03T18:56:36.069699] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-11-03T18:56:36.112527] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:36.139680] [DEBUG] [LOCAL ] FIX: Loaded 28632 existing records from primary storage. [2025-11-03T18:56:36.139961] [INFO ] [MAIN ] FIX: Loaded 28632 existing records. [2025-11-03T18:56:36.315713] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:56:36.315930] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-11-03T18:56:36.315980] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-11-03T18:56:36.316754] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-11-03T18:56:36.316813] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-11-03T18:56:36.569935] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T18:56:36.694868] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:36.721709] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-11-03T18:56:36.734824] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-11-03T18:56:37.534867] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-11. [2025-11-03T18:56:37.937422] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T18:56:38.327908] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T18:56:38.328623] [INFO ] [REMOTE ] FINS: Full fetch complete (11388 records). [2025-11-03T18:56:38.328722] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-11-03T18:56:38.339968] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-11-03T18:56:38.682053] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-11-03T18:56:38.682127] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-11-03T18:56:38.682397] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-11-03T18:56:38.682437] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-11-03T18:56:38.682945] [DEBUG] [LOCAL ] FINS: Trimmed 11388 records to 8009 (keeping 200 days of data) [2025-11-03T18:56:38.730159] [DEBUG] [LOCAL ] FINS: Primary data saved (8009 records). [2025-11-03T18:56:38.730270] [INFO ] [MAIN ] FINS: Full history saved. [2025-11-03T18:56:38.730342] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FINS took 35.7s. Estimated remaining: 3h 34m 9s. Rate: 7.2 symbols/min [2025-11-03T18:56:38.895221] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:38.895368] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-11-03T18:56:38.895404] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-11-03T18:56:38.895513] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-11-03T18:56:38.895554] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-11-03T18:56:38.895593] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-11-03T18:56:38.895627] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-11-03T18:56:39.144421] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-11-03T18:56:39.268000] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:39.858681] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T18:56:39.934867] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-11. [2025-11-03T18:56:40.615921] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T18:56:40.734845] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-11-03T18:56:41.534857] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-11-03T18:56:41.683002] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T18:56:41.683274] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-11-03T18:56:41.683366] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T18:56:41.683451] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-11-03T18:56:41.683533] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T18:56:41.683608] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-11-03T18:56:41.683701] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-11-03T18:56:41.683762] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-11-03T18:56:41.683830] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-11-03T18:56:41.683878] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FIXT took 3.0s. Estimated remaining: 3h 33m 51s. Rate: 7.2 symbols/min [2025-11-03T18:56:41.885679] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:41.892603] [DEBUG] [LOCAL ] FLC: Loaded 5104 existing records from primary storage. [2025-11-03T18:56:41.892819] [INFO ] [MAIN ] FLC: Loaded 5104 existing records. [2025-11-03T18:56:42.026355] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-11 (2.09 seconds). [2025-11-03T18:56:42.053760] [INFO ] [REMOTE ] FINV: Full fetch complete (65383 records). [2025-11-03T18:56:42.114597] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-11-03T18:56:42.120775] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:56:42.121393] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-11-03T18:56:42.121670] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-11-03T18:56:42.148922] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-11-03T18:56:42.162240] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-11-03T18:56:42.364093] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-11-03T18:56:42.889809] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-11-03T18:56:42.897173] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-11-03T18:56:42.936247] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-11-03T18:56:42.944937] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-11-03T18:56:42.953026] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-11-03T18:56:43.033387] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:43.034018] [DEBUG] [LOCAL ] FINV: Trimmed 65383 records to 45242 (keeping 200 days of data) [2025-11-03T18:56:43.134965] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-11-03T18:56:43.314133] [DEBUG] [LOCAL ] FINV: Primary data saved (45242 records). [2025-11-03T18:56:43.314264] [INFO ] [MAIN ] FINV: Full history saved. [2025-11-03T18:56:43.314346] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FINV took 34.0s. Estimated remaining: 3h 33m 30s. Rate: 7.2 symbols/min [2025-11-03T18:56:43.483752] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:56:43.533795] [DEBUG] [LOCAL ] FLG: Loaded 54083 existing records from primary storage. [2025-11-03T18:56:43.534109] [INFO ] [MAIN ] FLG: Loaded 54083 existing records. [2025-11-03T18:56:43.717417] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:56:43.717806] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-11-03T18:56:43.717883] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-11-03T18:56:43.719065] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-11-03T18:56:43.719129] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-11-03T18:56:43.880914] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T18:56:43.940333] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-11-03T18:56:44.127889] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:56:44.609141] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-11-03T18:56:44.616285] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T18:56:44.734851] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-11-03T18:56:45.128510] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T18:56:45.534851] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-11-03T18:56:46.334892] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-11-03T18:56:47.013876] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T18:56:47.134865] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-11-03T18:56:47.598834] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T18:56:47.934863] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-11-03T18:56:48.625670] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T18:56:48.734858] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-11. [2025-11-03T18:56:49.369282] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-11-03T18:56:49.534862] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-11-03T18:56:49.891513] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T18:56:49.893058] [INFO ] [REMOTE ] FIS: Full fetch complete (77419 records). [2025-11-03T18:56:49.893168] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-11-03T18:56:50.301619] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-11-03T18:56:50.301739] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-11-03T18:56:50.302638] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-11-03T18:56:50.302721] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-11-03T18:56:50.304154] [DEBUG] [LOCAL ] FIS: Trimmed 77419 records to 53324 (keeping 200 days of data) [2025-11-03T18:56:50.357456] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-11-03T18:56:50.629095] [DEBUG] [LOCAL ] FIS: Primary data saved (53324 records). [2025-11-03T18:56:50.629222] [INFO ] [MAIN ] FIS: Full history saved. [2025-11-03T18:56:50.629301] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FIS took 27.2s. Estimated remaining: 3h 33m 20s. Rate: 7.2 symbols/min [2025-11-03T18:56:50.854309] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-11-03T18:56:50.933006] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T18:56:51.134879] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-11-03T18:56:51.712481] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-11-03T18:56:51.934847] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-11-03T18:56:52.390969] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-11-03T18:56:52.734905] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-11-03T18:56:53.534858] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-11-03T18:56:54.168033] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T18:56:54.334847] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-11-03T18:56:54.599977] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T18:56:55.134888] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-11-03T18:56:55.750012] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T18:56:55.934844] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-11-03T18:56:56.274876] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T18:56:56.734907] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-11-03T18:56:57.385596] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T18:56:57.534842] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-11-03T18:56:57.709617] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T18:56:58.334892] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-11-03T18:56:58.999694] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T18:56:59.134894] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-11-03T18:56:59.199162] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T18:56:59.934973] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-11-03T18:57:00.523940] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T18:57:00.734859] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-11-03T18:57:01.060765] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-11-03T18:57:01.534896] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-11-03T18:57:01.698453] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T18:57:01.939468] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T18:57:02.334908] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-11-03T18:57:03.134903] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-11-03T18:57:03.532765] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T18:57:03.667785] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:57:03.934890] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-11-03T18:57:04.344014] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-11-03T18:57:04.734930] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-11-03T18:57:05.213667] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-11-03T18:57:05.534902] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-11-03T18:57:06.334912] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-11-03T18:57:06.566557] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T18:57:07.134897] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-11-03T18:57:07.934871] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-11. [2025-11-03T18:57:08.274637] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T18:57:08.723885] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-11-03T18:57:08.734825] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-11. [2025-11-03T18:57:08.835769] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T18:57:08.836631] [INFO ] [REMOTE ] FLC: Full fetch complete (7788 records). [2025-11-03T18:57:08.836745] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-11-03T18:57:09.216044] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-11-03T18:57:09.216119] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-11-03T18:57:09.216332] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-11-03T18:57:09.216378] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-11-03T18:57:09.216819] [DEBUG] [LOCAL ] FLC: Trimmed 7788 records to 4998 (keeping 200 days of data) [2025-11-03T18:57:09.245920] [DEBUG] [LOCAL ] FLC: Primary data saved (4998 records). [2025-11-03T18:57:09.246003] [INFO ] [MAIN ] FLC: Full history saved. [2025-11-03T18:57:09.246077] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FLC took 27.6s. Estimated remaining: 3h 33m 30s. Rate: 7.2 symbols/min [2025-11-03T18:57:09.534840] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-11-03T18:57:10.448331] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-11 (1.71 seconds). [2025-11-03T18:57:10.449528] [INFO ] [REMOTE ] FIX: Full fetch complete (45633 records). [2025-11-03T18:57:10.449614] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-11-03T18:57:10.837727] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-11-03T18:57:10.837824] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-11-03T18:57:10.838483] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-11-03T18:57:10.838524] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-11-03T18:57:10.839587] [DEBUG] [LOCAL ] FIX: Trimmed 45633 records to 28199 (keeping 200 days of data) [2025-11-03T18:57:11.029714] [DEBUG] [LOCAL ] FIX: Primary data saved (28199 records). [2025-11-03T18:57:11.029912] [INFO ] [MAIN ] FIX: Full history saved. [2025-11-03T18:57:11.030023] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIX took 35.1s. Estimated remaining: 3h 33m 10s. Rate: 7.2 symbols/min [2025-11-03T18:57:11.118693] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-11-03T18:57:11.131010] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-11. [2025-11-03T18:57:13.211828] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-11 (2.08 seconds). [2025-11-03T18:57:13.213360] [INFO ] [REMOTE ] FLG: Full fetch complete (77407 records). [2025-11-03T18:57:13.213468] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-11-03T18:57:13.615801] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-11-03T18:57:13.615878] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-11-03T18:57:13.616829] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-11-03T18:57:13.616890] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-11-03T18:57:13.618287] [DEBUG] [LOCAL ] FLG: Trimmed 77407 records to 53298 (keeping 200 days of data) [2025-11-03T18:57:13.936341] [DEBUG] [LOCAL ] FLG: Primary data saved (53298 records). [2025-11-03T18:57:13.936466] [INFO ] [MAIN ] FLG: Full history saved. [2025-11-03T18:57:13.936541] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FLG took 30.6s. Estimated remaining: 3h 32m 51s. Rate: 7.2 symbols/min [2025-11-03T18:57:14.604278] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:14.589011] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:14.662610] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:14.659752] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:14.699369] [DEBUG] [LOCAL ] FLOC: Loaded 27975 existing records from primary storage. [2025-11-03T18:57:14.699869] [INFO ] [MAIN ] FLOC: Loaded 27975 existing records. [2025-11-03T18:57:14.779095] [DEBUG] [LOCAL ] FLNG: Loaded 33245 existing records from primary storage. [2025-11-03T18:57:14.806330] [INFO ] [MAIN ] FLNG: Loaded 33245 existing records. [2025-11-03T18:57:14.940024] [DEBUG] [LOCAL ] FLO: Loaded 52868 existing records from primary storage. [2025-11-03T18:57:14.972621] [INFO ] [MAIN ] FLO: Loaded 52868 existing records. [2025-11-03T18:57:15.002097] [DEBUG] [LOCAL ] FLR: Loaded 54015 existing records from primary storage. [2025-11-03T18:57:15.094737] [INFO ] [MAIN ] FLR: Loaded 54015 existing records. [2025-11-03T18:57:15.134667] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:15.228199] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-11-03T18:57:15.329253] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-11-03T18:57:15.338070] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:15.353953] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-11-03T18:57:15.366482] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-11-03T18:57:15.371852] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-11-03T18:57:15.382868] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-11-03T18:57:15.408723] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-11-03T18:57:15.408814] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-11-03T18:57:15.564054] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:15.610239] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:15.620851] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-11-03T18:57:15.620727] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-11-03T18:57:15.657725] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-11-03T18:57:15.718548] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-11-03T18:57:15.735081] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-11-03T18:57:15.738850] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-11-03T18:57:15.750043] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-11-03T18:57:15.750167] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-11-03T18:57:16.726949] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:16.829170] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-11-03T18:57:16.865742] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:16.894080] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-11-03T18:57:17.004816] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:17.032960] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:17.033570] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-11-03T18:57:17.034006] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-11-03T18:57:17.787245] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T18:57:17.791935] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-11-03T18:57:18.066257] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T18:57:18.075579] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-11-03T18:57:18.287366] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T18:57:18.299199] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-11-03T18:57:18.476917] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T18:57:18.487715] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-11-03T18:57:18.559375] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T18:57:18.565371] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-11-03T18:57:18.982114] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T18:57:18.989841] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-11-03T18:57:19.507359] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T18:57:19.517344] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-11-03T18:57:19.606723] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T18:57:19.682885] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-11-03T18:57:19.934902] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-11-03T18:57:19.966427] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T18:57:20.529297] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-11-03T18:57:20.734916] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-11-03T18:57:21.296327] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T18:57:21.534878] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-11-03T18:57:21.937092] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T18:57:22.334924] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-11-03T18:57:23.134866] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-11-03T18:57:23.516169] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T18:57:23.575855] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-11-03T18:57:23.934885] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-11-03T18:57:24.020310] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T18:57:24.734859] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-11-03T18:57:25.012767] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T18:57:25.534901] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-11-03T18:57:26.204485] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T18:57:26.334852] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-11-03T18:57:26.412991] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-11-03T18:57:27.134910] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-11-03T18:57:27.711336] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T18:57:27.930595] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T18:57:27.936373] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-11-03T18:57:28.734914] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-11-03T18:57:29.293363] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-11-03T18:57:29.534867] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-11-03T18:57:30.170007] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T18:57:30.334928] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-11-03T18:57:30.773959] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T18:57:31.134933] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-11-03T18:57:31.385766] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T18:57:31.934872] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-11-03T18:57:32.568390] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T18:57:32.734860] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-11-03T18:57:33.297481] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T18:57:33.534844] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-11-03T18:57:33.577211] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-11-03T18:57:34.334885] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-11-03T18:57:34.615421] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T18:57:35.134918] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-11-03T18:57:35.616321] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T18:57:35.934897] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-11-03T18:57:36.488342] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T18:57:36.546763] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-11-03T18:57:36.734864] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-11-03T18:57:37.534892] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-11-03T18:57:37.869090] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T18:57:38.334843] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-11-03T18:57:38.421108] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T18:57:39.134882] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-11-03T18:57:39.304878] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T18:57:39.934934] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-11. [2025-11-03T18:57:40.538080] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T18:57:40.734959] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-11. [2025-11-03T18:57:41.245844] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T18:57:41.247022] [INFO ] [REMOTE ] FLOC: Full fetch complete (42615 records). [2025-11-03T18:57:41.247104] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-11-03T18:57:41.541794] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-11-03T18:57:41.663258] [DEBUG] [VALIDATOR ] FLOC: All expected trading days are present. [2025-11-03T18:57:41.663381] [DEBUG] [VALIDATOR ] FLOC: Primary data validation passed. [2025-11-03T18:57:41.664242] [INFO ] [MAIN ] FLOC: Fetched primary data is valid. [2025-11-03T18:57:41.664310] [DEBUG] [LOCAL ] FLOC: Saving primary data. [2025-11-03T18:57:41.665475] [DEBUG] [LOCAL ] FLOC: Trimmed 42615 records to 27578 (keeping 200 days of data) [2025-11-03T18:57:41.845343] [DEBUG] [LOCAL ] FLOC: Primary data saved (27578 records). [2025-11-03T18:57:41.845468] [INFO ] [MAIN ] FLOC: Full history saved. [2025-11-03T18:57:41.845555] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FLOC took 27.9s. Estimated remaining: 3h 33m 19s. Rate: 7.1 symbols/min [2025-11-03T18:57:42.016534] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:42.046957] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T18:57:42.048777] [INFO ] [REMOTE ] FLNG: Full fetch complete (49558 records). [2025-11-03T18:57:42.048923] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-11-03T18:57:42.185493] [DEBUG] [LOCAL ] FLS: Loaded 51170 existing records from primary storage. [2025-11-03T18:57:42.201898] [INFO ] [MAIN ] FLS: Loaded 51170 existing records. [2025-11-03T18:57:42.346998] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-11-03T18:57:42.601306] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:42.617152] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-11-03T18:57:42.622414] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-11-03T18:57:42.646349] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-11-03T18:57:42.676881] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-11-03T18:57:42.758226] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-11-03T18:57:42.769959] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-11-03T18:57:42.786916] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-11-03T18:57:42.794632] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-11-03T18:57:42.851557] [DEBUG] [LOCAL ] FLNG: Trimmed 49558 records to 32841 (keeping 200 days of data) [2025-11-03T18:57:43.168839] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:43.169606] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-11-03T18:57:43.275075] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-11-03T18:57:43.310848] [DEBUG] [LOCAL ] FLNG: Primary data saved (32841 records). [2025-11-03T18:57:43.311012] [INFO ] [MAIN ] FLNG: Full history saved. [2025-11-03T18:57:43.311106] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLNG took 29.4s. Estimated remaining: 3h 32m 58s. Rate: 7.2 symbols/min [2025-11-03T18:57:43.484015] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:43.529632] [DEBUG] [LOCAL ] FLUT: Loaded 51353 existing records from primary storage. [2025-11-03T18:57:43.529970] [INFO ] [MAIN ] FLUT: Loaded 51353 existing records. [2025-11-03T18:57:43.715045] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:43.715325] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-11-03T18:57:43.715375] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-11-03T18:57:43.716276] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-11-03T18:57:43.716334] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-11-03T18:57:43.978789] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-11-03T18:57:44.087039] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:44.118723] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-11-03T18:57:44.387196] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T18:57:44.734921] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-11-03T18:57:45.534826] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-11-03T18:57:45.720057] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-11-03T18:57:45.958273] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T18:57:46.334866] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-11. [2025-11-03T18:57:47.098013] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T18:57:47.134848] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-11-03T18:57:47.934861] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-11-03T18:57:48.157018] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T18:57:48.591809] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-11 (2.26 seconds). [2025-11-03T18:57:48.593272] [INFO ] [REMOTE ] FLR: Full fetch complete (76966 records). [2025-11-03T18:57:48.593354] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-11-03T18:57:48.739906] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-11. [2025-11-03T18:57:48.994951] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-11-03T18:57:48.995090] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-11-03T18:57:48.996100] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-11-03T18:57:48.996165] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-11-03T18:57:48.997690] [DEBUG] [LOCAL ] FLR: Trimmed 76966 records to 53238 (keeping 200 days of data) [2025-11-03T18:57:49.324678] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-11-03T18:57:49.354274] [DEBUG] [LOCAL ] FLR: Primary data saved (53238 records). [2025-11-03T18:57:49.354369] [INFO ] [MAIN ] FLR: Full history saved. [2025-11-03T18:57:49.354439] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLR took 35.4s. Estimated remaining: 3h 32m 45s. Rate: 7.2 symbols/min [2025-11-03T18:57:49.527104] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:49.527253] [DEBUG] [LOCAL ] FLXR: No existing data file found in primary storage. [2025-11-03T18:57:49.527309] [WARN ] [MAIN ] FLXR: No existing data found, performing full refresh instead. [2025-11-03T18:57:49.527427] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-11-03T18:57:49.527466] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-11-03T18:57:49.527507] [DEBUG] [LOCAL ] FLXR: No primary data file found to delete. [2025-11-03T18:57:49.527538] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-11-03T18:57:49.540219] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-11-03T18:57:49.882465] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:50.334853] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-11-03T18:57:50.760680] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-11 (2.02 seconds). [2025-11-03T18:57:50.762476] [INFO ] [REMOTE ] FLO: Full fetch complete (75460 records). [2025-11-03T18:57:50.762609] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-11-03T18:57:50.895408] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-11-03T18:57:51.137032] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-11-03T18:57:51.245571] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-11-03T18:57:51.245782] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-11-03T18:57:51.246959] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-11-03T18:57:51.247229] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-11-03T18:57:51.250220] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-11-03T18:57:51.262558] [DEBUG] [LOCAL ] FLO: Trimmed 75460 records to 52171 (keeping 200 days of data) [2025-11-03T18:57:51.586115] [DEBUG] [LOCAL ] FLO: Primary data saved (52171 records). [2025-11-03T18:57:51.586258] [INFO ] [MAIN ] FLO: Full history saved. [2025-11-03T18:57:51.586341] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 37.6s. Estimated remaining: 3h 32m 26s. Rate: 7.2 symbols/min [2025-11-03T18:57:51.808081] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:57:51.819836] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T18:57:51.869708] [DEBUG] [LOCAL ] FMC: Loaded 52617 existing records from primary storage. [2025-11-03T18:57:51.870091] [INFO ] [MAIN ] FMC: Loaded 52617 existing records. [2025-11-03T18:57:51.940033] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-11-03T18:57:52.049967] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:57:52.050183] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-11-03T18:57:52.050233] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-11-03T18:57:52.051264] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-11-03T18:57:52.051322] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-11-03T18:57:52.398597] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:57:52.734844] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-11-03T18:57:53.402413] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T18:57:53.444233] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T18:57:53.534838] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-11-03T18:57:54.334870] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-11-03T18:57:54.968578] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T18:57:55.134886] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-11-03T18:57:55.731432] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T18:57:55.934912] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-11-03T18:57:56.459699] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T18:57:56.568801] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-11-03T18:57:56.734969] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-11-03T18:57:57.530205] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T18:57:57.534802] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-11-03T18:57:58.158972] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T18:57:58.334939] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-11-03T18:57:59.134895] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-11-03T18:57:59.620823] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T18:57:59.934921] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-11-03T18:58:00.734857] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-11-03T18:58:01.046592] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-11-03T18:58:01.105716] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T18:58:01.514810] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T18:58:01.534999] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-11-03T18:58:02.334909] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-11-03T18:58:03.139928] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-11-03T18:58:03.158141] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-11-03T18:58:03.736822] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T18:58:03.934850] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-11-03T18:58:04.442763] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T18:58:04.731231] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T18:58:04.736058] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-11-03T18:58:05.534868] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-11-03T18:58:06.111438] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T18:58:06.321402] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T18:58:06.334806] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-11-03T18:58:07.134838] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-11-03T18:58:07.243026] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T18:58:07.934922] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-11-03T18:58:08.570351] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T18:58:08.734903] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-11-03T18:58:09.378226] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T18:58:09.534919] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-11-03T18:58:10.260003] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-11-03T18:58:10.334894] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-11-03T18:58:10.941151] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T18:58:11.134891] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-11-03T18:58:11.721325] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T18:58:11.934907] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-11-03T18:58:12.554807] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T18:58:12.734904] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-11. [2025-11-03T18:58:13.342242] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T18:58:13.534851] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-11-03T18:58:14.019181] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T18:58:14.020246] [INFO ] [REMOTE ] FLXR: Full fetch complete (28595 records). [2025-11-03T18:58:14.020317] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-11-03T18:58:14.340010] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-11-03T18:58:14.422937] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-11-03T18:58:14.423027] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-11-03T18:58:14.423632] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-11-03T18:58:14.423722] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-11-03T18:58:14.424716] [DEBUG] [LOCAL ] FLXR: Trimmed 28595 records to 22054 (keeping 200 days of data) [2025-11-03T18:58:14.558065] [DEBUG] [LOCAL ] FLXR: Primary data saved (22054 records). [2025-11-03T18:58:14.558197] [INFO ] [MAIN ] FLXR: Full history saved. [2025-11-03T18:58:14.558267] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLXR took 25.2s. Estimated remaining: 3h 32m 43s. Rate: 7.2 symbols/min [2025-11-03T18:58:14.752808] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:58:14.759511] [DEBUG] [LOCAL ] FMN: Loaded 5697 existing records from primary storage. [2025-11-03T18:58:14.759774] [INFO ] [MAIN ] FMN: Loaded 5697 existing records. [2025-11-03T18:58:14.955974] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T18:58:14.992166] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:58:14.992917] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-11-03T18:58:14.992997] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-11-03T18:58:14.993248] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-11-03T18:58:14.993308] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-11-03T18:58:15.146549] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-11-03T18:58:15.359524] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:58:15.894746] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-11-03T18:58:15.934811] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-11-03T18:58:16.734826] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-11-03T18:58:16.958300] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-11-03T18:58:17.102362] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T18:58:17.534876] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-11-03T18:58:18.056410] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T18:58:18.059615] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T18:58:18.334906] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-11. [2025-11-03T18:58:19.134883] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-11-03T18:58:19.592813] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T18:58:19.934903] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-11. [2025-11-03T18:58:20.619012] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-11 (2.28 seconds). [2025-11-03T18:58:20.620715] [INFO ] [REMOTE ] FLUT: Full fetch complete (73473 records). [2025-11-03T18:58:20.620901] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-11-03T18:58:20.740049] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-11-03T18:58:21.029348] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-11-03T18:58:21.029442] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-11-03T18:58:21.030359] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-11-03T18:58:21.030430] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-11-03T18:58:21.031990] [DEBUG] [LOCAL ] FLUT: Trimmed 73473 records to 50621 (keeping 200 days of data) [2025-11-03T18:58:21.329912] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-11-03T18:58:21.355469] [DEBUG] [LOCAL ] FLUT: Primary data saved (50621 records). [2025-11-03T18:58:21.355609] [INFO ] [MAIN ] FLUT: Full history saved. [2025-11-03T18:58:21.355728] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLUT took 38.0s. Estimated remaining: 3h 32m 32s. Rate: 7.2 symbols/min [2025-11-03T18:58:21.540113] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-11-03T18:58:21.570533] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:58:21.600186] [DEBUG] [LOCAL ] FMS: Loaded 30521 existing records from primary storage. [2025-11-03T18:58:21.600444] [INFO ] [MAIN ] FMS: Loaded 30521 existing records. [2025-11-03T18:58:21.772100] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:58:21.772345] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-11-03T18:58:21.772393] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-11-03T18:58:21.772932] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-11-03T18:58:21.772988] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-11-03T18:58:22.046907] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-11 (2.11 seconds). [2025-11-03T18:58:22.057932] [INFO ] [REMOTE ] FLS: Full fetch complete (72785 records). [2025-11-03T18:58:22.107415] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-11-03T18:58:22.120598] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-11-03T18:58:22.164021] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:58:22.340160] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-11-03T18:58:22.533670] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-11-03T18:58:22.533765] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-11-03T18:58:22.534699] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-11-03T18:58:22.534762] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-11-03T18:58:22.536150] [DEBUG] [LOCAL ] FLS: Trimmed 72785 records to 50443 (keeping 200 days of data) [2025-11-03T18:58:22.830162] [DEBUG] [LOCAL ] FLS: Primary data saved (50443 records). [2025-11-03T18:58:22.830285] [INFO ] [MAIN ] FLS: Full history saved. [2025-11-03T18:58:22.830944] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLS took 41.0s. Estimated remaining: 3h 32m 11s. Rate: 7.2 symbols/min [2025-11-03T18:58:23.010037] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:58:23.048039] [DEBUG] [LOCAL ] FMX: Loaded 40525 existing records from primary storage. [2025-11-03T18:58:23.048334] [INFO ] [MAIN ] FMX: Loaded 40525 existing records. [2025-11-03T18:58:23.140149] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-11-03T18:58:23.226955] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:58:23.227137] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-11-03T18:58:23.227184] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-11-03T18:58:23.227997] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-11-03T18:58:23.228054] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-11-03T18:58:23.494832] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T18:58:23.537448] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T18:58:23.612948] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:58:23.934874] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-11-03T18:58:24.692621] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T18:58:24.734829] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-11-03T18:58:25.534921] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-11-03T18:58:25.768810] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T18:58:26.334921] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-11-03T18:58:26.553494] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T18:58:26.729902] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T18:58:27.134877] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-11-03T18:58:27.934902] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-11-03T18:58:28.230780] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T18:58:28.734862] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-11-03T18:58:29.196436] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T18:58:29.534843] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-11-03T18:58:29.773874] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T18:58:30.334868] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-11-03T18:58:31.134967] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-11-03T18:58:31.134896] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-11-03T18:58:31.506564] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T18:58:31.507078] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-11-03T18:58:31.934932] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-11-03T18:58:32.734936] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-11. [2025-11-03T18:58:32.976557] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T18:58:33.534944] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-11-03T18:58:33.909453] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-11-03T18:58:34.334899] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-11-03T18:58:35.134925] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-11-03T18:58:35.142888] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-11 (2.41 seconds). [2025-11-03T18:58:35.144607] [INFO ] [REMOTE ] FMC: Full fetch complete (75494 records). [2025-11-03T18:58:35.144774] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-11-03T18:58:35.536687] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-11-03T18:58:35.536898] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-11-03T18:58:35.538073] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-11-03T18:58:35.538152] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-11-03T18:58:35.539624] [DEBUG] [LOCAL ] FMC: Trimmed 75494 records to 51894 (keeping 200 days of data) [2025-11-03T18:58:35.642031] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T18:58:35.875500] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-11-03T18:58:35.903110] [DEBUG] [LOCAL ] FMC: Primary data saved (51894 records). [2025-11-03T18:58:35.903740] [INFO ] [MAIN ] FMC: Full history saved. [2025-11-03T18:58:35.904602] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FMC took 44.3s. Estimated remaining: 3h 32m 11s. Rate: 7.2 symbols/min [2025-11-03T18:58:35.936680] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-11-03T18:58:36.085735] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:58:36.088629] [DEBUG] [LOCAL ] FMY: Loaded 1339 existing records from primary storage. [2025-11-03T18:58:36.088794] [INFO ] [MAIN ] FMY: Loaded 1339 existing records. [2025-11-03T18:58:36.263718] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:58:36.263962] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-11-03T18:58:36.264021] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-11-03T18:58:36.264181] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-11-03T18:58:36.264238] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-11-03T18:58:36.557549] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T18:58:36.639206] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:58:36.734833] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-11-03T18:58:37.037839] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-11-03T18:58:37.534860] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-11-03T18:58:37.822385] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T18:58:38.334865] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-11. [2025-11-03T18:58:39.134829] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-11-03T18:58:39.159475] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T18:58:39.160238] [INFO ] [REMOTE ] FMN: Full fetch complete (9773 records). [2025-11-03T18:58:39.160305] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-11-03T18:58:39.508924] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-11-03T18:58:39.508999] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-11-03T18:58:39.509230] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-11-03T18:58:39.509267] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-11-03T18:58:39.509686] [DEBUG] [LOCAL ] FMN: Trimmed 9773 records to 5618 (keeping 200 days of data) [2025-11-03T18:58:39.542623] [DEBUG] [LOCAL ] FMN: Primary data saved (5618 records). [2025-11-03T18:58:39.542756] [INFO ] [MAIN ] FMN: Full history saved. [2025-11-03T18:58:39.542833] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FMN took 25.0s. Estimated remaining: 3h 31m 55s. Rate: 7.2 symbols/min [2025-11-03T18:58:39.710662] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:58:39.743373] [DEBUG] [LOCAL ] FN: Loaded 37468 existing records from primary storage. [2025-11-03T18:58:39.743662] [INFO ] [MAIN ] FN: Loaded 37468 existing records. [2025-11-03T18:58:39.914630] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:58:39.914875] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-11-03T18:58:39.914921] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-11-03T18:58:39.915488] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-11-03T18:58:39.915544] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-11-03T18:58:39.945345] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-11-03T18:58:40.280357] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:58:40.331788] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T18:58:40.734823] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-11-03T18:58:40.854627] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T18:58:41.534850] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-11-03T18:58:41.799813] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T18:58:42.334823] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-11-03T18:58:42.396210] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T18:58:42.580412] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-11-03T18:58:43.134839] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-11-03T18:58:43.479759] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-11-03T18:58:43.934923] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-11-03T18:58:44.194619] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-11-03T18:58:44.734856] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-11-03T18:58:45.025961] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-11-03T18:58:45.534841] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-11-03T18:58:45.838088] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-11-03T18:58:46.334840] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-11-03T18:58:47.134835] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-11-03T18:58:47.254247] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T18:58:47.934899] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-11-03T18:58:48.432901] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T18:58:48.734878] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-11-03T18:58:49.043108] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T18:58:49.055190] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-11-03T18:58:49.534874] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-11-03T18:58:50.334891] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-11-03T18:58:50.926198] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T18:58:51.134891] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-11-03T18:58:51.514738] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T18:58:51.934847] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-11-03T18:58:51.971967] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T18:58:52.248685] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-11-03T18:58:52.734917] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-11-03T18:58:52.940251] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.21 seconds). [2025-11-03T18:58:53.534918] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-11-03T18:58:54.334852] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-11. [2025-11-03T18:58:54.838624] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T18:58:54.880225] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T18:58:54.880845] [INFO ] [REMOTE ] FMY: Full fetch complete (1935 records). [2025-11-03T18:58:54.880911] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-11-03T18:58:55.140044] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-11-03T18:58:55.244803] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-11-03T18:58:55.244887] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-11-03T18:58:55.244977] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-11-03T18:58:55.245013] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-11-03T18:58:55.245317] [DEBUG] [LOCAL ] FMY: Trimmed 1935 records to 1317 (keeping 200 days of data) [2025-11-03T18:58:55.253743] [DEBUG] [LOCAL ] FMY: Primary data saved (1317 records). [2025-11-03T18:58:55.253800] [INFO ] [MAIN ] FMY: Full history saved. [2025-11-03T18:58:55.253862] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FMY took 19.3s. Estimated remaining: 3h 31m 59s. Rate: 7.2 symbols/min [2025-11-03T18:58:55.417555] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:58:55.466913] [DEBUG] [LOCAL ] FNB: Loaded 53377 existing records from primary storage. [2025-11-03T18:58:55.467202] [INFO ] [MAIN ] FNB: Loaded 53377 existing records. [2025-11-03T18:58:55.639554] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:58:55.639822] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-11-03T18:58:55.639882] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-11-03T18:58:55.640689] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-11-03T18:58:55.640746] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-11-03T18:58:55.946302] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-11-03T18:58:55.985216] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:58:56.461067] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-11-03T18:58:56.734866] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-11-03T18:58:57.343908] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T18:58:57.534849] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-11-03T18:58:58.026848] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T18:58:58.334848] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-11-03T18:58:58.708539] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-11-03T18:58:59.134884] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-11. [2025-11-03T18:58:59.525697] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T18:58:59.934895] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-11-03T18:59:00.616178] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-11 (1.48 seconds). [2025-11-03T18:59:00.617530] [INFO ] [REMOTE ] FMX: Full fetch complete (57902 records). [2025-11-03T18:59:00.617616] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-11-03T18:59:00.740068] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-11-03T18:59:00.999763] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-11-03T18:59:00.999847] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-11-03T18:59:01.000692] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-11-03T18:59:01.000754] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-11-03T18:59:01.001857] [DEBUG] [LOCAL ] FMX: Trimmed 57902 records to 39892 (keeping 200 days of data) [2025-11-03T18:59:01.247553] [DEBUG] [LOCAL ] FMX: Primary data saved (39892 records). [2025-11-03T18:59:01.247740] [INFO ] [MAIN ] FMX: Full history saved. [2025-11-03T18:59:01.248431] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FMX took 38.4s. Estimated remaining: 3h 31m 47s. Rate: 7.2 symbols/min [2025-11-03T18:59:01.421855] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:01.459788] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T18:59:01.511845] [DEBUG] [LOCAL ] FND: Loaded 52791 existing records from primary storage. [2025-11-03T18:59:01.512162] [INFO ] [MAIN ] FND: Loaded 52791 existing records. [2025-11-03T18:59:01.542494] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-11-03T18:59:01.691929] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:01.692138] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-11-03T18:59:01.692185] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-11-03T18:59:01.693013] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-11-03T18:59:01.693072] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-11-03T18:59:02.097601] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:02.254216] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T18:59:02.334875] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-11-03T18:59:02.894667] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T18:59:03.134871] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-11-03T18:59:03.510769] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T18:59:03.934915] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-11. [2025-11-03T18:59:04.408872] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T18:59:04.734918] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-11-03T18:59:05.330135] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T18:59:05.331404] [INFO ] [REMOTE ] FMS: Full fetch complete (43345 records). [2025-11-03T18:59:05.331479] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-11-03T18:59:05.541183] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-11-03T18:59:05.716739] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-11-03T18:59:05.716889] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-11-03T18:59:05.717601] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-11-03T18:59:05.717706] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-11-03T18:59:05.718695] [DEBUG] [LOCAL ] FMS: Trimmed 43345 records to 30145 (keeping 200 days of data) [2025-11-03T18:59:05.910834] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T18:59:05.910025] [DEBUG] [LOCAL ] FMS: Primary data saved (30145 records). [2025-11-03T18:59:05.918212] [INFO ] [MAIN ] FMS: Full history saved. [2025-11-03T18:59:05.918302] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMS took 44.6s. Estimated remaining: 3h 31m 32s. Rate: 7.2 symbols/min [2025-11-03T18:59:06.084774] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:06.126877] [DEBUG] [LOCAL ] FNF: Loaded 49066 existing records from primary storage. [2025-11-03T18:59:06.127253] [INFO ] [MAIN ] FNF: Loaded 49066 existing records. [2025-11-03T18:59:06.301950] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:06.302159] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-11-03T18:59:06.302207] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-11-03T18:59:06.303023] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-11-03T18:59:06.303080] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-11-03T18:59:06.339948] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-11-03T18:59:06.654205] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:06.996566] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-11-03T18:59:07.134822] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-11-03T18:59:07.569933] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T18:59:07.934886] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-11-03T18:59:08.533529] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T18:59:08.734901] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-11-03T18:59:09.279381] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T18:59:09.534912] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-11-03T18:59:10.012130] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T18:59:10.334858] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-11-03T18:59:10.814288] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T18:59:11.134882] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-11-03T18:59:11.242855] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T18:59:11.934908] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-11-03T18:59:12.431264] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T18:59:12.734893] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-11-03T18:59:13.035529] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T18:59:13.534891] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-11-03T18:59:14.103120] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T18:59:14.334877] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-11-03T18:59:14.754332] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T18:59:15.134893] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-11-03T18:59:15.804661] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T18:59:15.934862] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-11-03T18:59:16.420036] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T18:59:16.734839] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-11-03T18:59:17.443999] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T18:59:17.534920] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-11-03T18:59:18.044612] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T18:59:18.334887] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-11-03T18:59:18.868025] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T18:59:19.134871] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-11-03T18:59:19.673123] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T18:59:19.934904] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-11-03T18:59:20.714446] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-11-03T18:59:20.734824] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-11. [2025-11-03T18:59:20.934518] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T18:59:21.534906] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-11-03T18:59:22.334869] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-11. [2025-11-03T18:59:22.911876] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T18:59:22.957700] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-11 (2.22 seconds). [2025-11-03T18:59:22.959132] [INFO ] [REMOTE ] FNB: Full fetch complete (76256 records). [2025-11-03T18:59:22.959225] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-11-03T18:59:23.135251] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-11-03T18:59:23.355728] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-11-03T18:59:23.355816] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-11-03T18:59:23.356714] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-11-03T18:59:23.356776] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-11-03T18:59:23.358265] [DEBUG] [LOCAL ] FNB: Trimmed 76256 records to 52594 (keeping 200 days of data) [2025-11-03T18:59:23.671103] [DEBUG] [LOCAL ] FNB: Primary data saved (52594 records). [2025-11-03T18:59:23.671232] [INFO ] [MAIN ] FNB: Full history saved. [2025-11-03T18:59:23.672110] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FNB took 28.4s. Estimated remaining: 3h 31m 40s. Rate: 7.1 symbols/min [2025-11-03T18:59:23.842693] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:23.887189] [DEBUG] [LOCAL ] FNV: Loaded 46476 existing records from primary storage. [2025-11-03T18:59:23.887511] [INFO ] [MAIN ] FNV: Loaded 46476 existing records. [2025-11-03T18:59:23.949444] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-11-03T18:59:24.069346] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:24.069702] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-11-03T18:59:24.069764] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-11-03T18:59:24.070538] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-11-03T18:59:24.070596] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-11-03T18:59:24.156613] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-11 (1.82 seconds). [2025-11-03T18:59:24.187146] [INFO ] [REMOTE ] FN: Full fetch complete (56812 records). [2025-11-03T18:59:24.187345] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-11-03T18:59:24.741153] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:24.760163] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-11-03T18:59:24.856941] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-11-03T18:59:24.857034] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-11-03T18:59:24.874283] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-11-03T18:59:24.885775] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-11-03T18:59:24.886945] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T18:59:24.899699] [DEBUG] [LOCAL ] FN: Trimmed 56812 records to 36973 (keeping 200 days of data) [2025-11-03T18:59:25.125781] [DEBUG] [LOCAL ] FN: Primary data saved (36973 records). [2025-11-03T18:59:25.125940] [INFO ] [MAIN ] FN: Full history saved. [2025-11-03T18:59:25.126131] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FN took 45.6s. Estimated remaining: 3h 31m 19s. Rate: 7.2 symbols/min [2025-11-03T18:59:25.300532] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:25.335322] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T18:59:25.340242] [DEBUG] [LOCAL ] FOA: Loaded 12832 existing records from primary storage. [2025-11-03T18:59:25.350542] [INFO ] [MAIN ] FOA: Loaded 12832 existing records. [2025-11-03T18:59:25.525365] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:25.525572] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-11-03T18:59:25.525619] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-11-03T18:59:25.525956] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-11-03T18:59:25.526013] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-11-03T18:59:25.539962] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-11-03T18:59:25.884352] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:26.074580] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T18:59:26.334878] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-11-03T18:59:26.838034] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T18:59:27.134876] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-11-03T18:59:27.498053] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T18:59:27.934882] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-11-03T18:59:28.416981] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T18:59:28.679145] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T18:59:28.734872] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-11-03T18:59:29.534888] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-11-03T18:59:29.934185] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T18:59:30.334900] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-11-03T18:59:30.749335] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T18:59:30.947930] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T18:59:31.134913] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-11. [2025-11-03T18:59:31.934895] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-11-03T18:59:32.734944] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-11-03T18:59:33.257754] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-11 (2.12 seconds). [2025-11-03T18:59:33.261377] [INFO ] [REMOTE ] FND: Full fetch complete (75193 records). [2025-11-03T18:59:33.261258] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T18:59:33.261545] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-11-03T18:59:33.484161] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T18:59:33.547188] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-11-03T18:59:33.686485] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-11-03T18:59:33.686576] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-11-03T18:59:33.687603] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-11-03T18:59:33.687707] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-11-03T18:59:33.689241] [DEBUG] [LOCAL ] FND: Trimmed 75193 records to 52023 (keeping 200 days of data) [2025-11-03T18:59:33.992020] [DEBUG] [LOCAL ] FND: Primary data saved (52023 records). [2025-11-03T18:59:33.992159] [INFO ] [MAIN ] FND: Full history saved. [2025-11-03T18:59:33.992902] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FND took 32.7s. Estimated remaining: 3h 31m 12s. Rate: 7.2 symbols/min [2025-11-03T18:59:34.170148] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:34.180147] [DEBUG] [LOCAL ] FOF: Loaded 8225 existing records from primary storage. [2025-11-03T18:59:34.180367] [INFO ] [MAIN ] FOF: Loaded 8225 existing records. [2025-11-03T18:59:34.342704] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-11-03T18:59:34.367237] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:34.367503] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-11-03T18:59:34.367552] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-11-03T18:59:34.367903] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-11-03T18:59:34.367962] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-11-03T18:59:34.728910] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:34.869336] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T18:59:35.103338] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T18:59:35.134895] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-11-03T18:59:35.644420] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T18:59:35.934906] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-11-03T18:59:36.734863] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-11-03T18:59:37.371518] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T18:59:37.534824] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-11-03T18:59:37.935059] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T18:59:37.989166] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-11-03T18:59:38.334859] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-11-03T18:59:38.786034] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T18:59:39.134856] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-11-03T18:59:39.682413] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-11-03T18:59:39.934881] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-11-03T18:59:40.509869] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-11-03T18:59:40.734901] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-11-03T18:59:41.353566] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-11-03T18:59:41.534872] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-11-03T18:59:42.334861] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-11-03T18:59:42.819133] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T18:59:43.134851] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-11-03T18:59:43.510869] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T18:59:43.555236] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T18:59:43.934846] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-11. [2025-11-03T18:59:44.734896] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-11-03T18:59:45.271550] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-11-03T18:59:45.534848] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-11-03T18:59:45.797251] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-11 (1.86 seconds). [2025-11-03T18:59:45.798731] [INFO ] [REMOTE ] FNF: Full fetch complete (69842 records). [2025-11-03T18:59:45.798818] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-11-03T18:59:46.209614] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-11-03T18:59:46.209855] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-11-03T18:59:46.210872] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-11-03T18:59:46.219569] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-11-03T18:59:46.220975] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T18:59:46.226151] [DEBUG] [LOCAL ] FNF: Trimmed 69842 records to 48334 (keeping 200 days of data) [2025-11-03T18:59:46.334874] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-11-03T18:59:46.522581] [DEBUG] [LOCAL ] FNF: Primary data saved (48334 records). [2025-11-03T18:59:46.522717] [INFO ] [MAIN ] FNF: Full history saved. [2025-11-03T18:59:46.522809] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FNF took 40.6s. Estimated remaining: 3h 31m 11s. Rate: 7.2 symbols/min [2025-11-03T18:59:46.698680] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:46.716362] [DEBUG] [LOCAL ] FOR: Loaded 19149 existing records from primary storage. [2025-11-03T18:59:46.716624] [INFO ] [MAIN ] FOR: Loaded 19149 existing records. [2025-11-03T18:59:46.910892] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T18:59:46.916609] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:46.918684] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-11-03T18:59:46.919136] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-11-03T18:59:46.919821] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-11-03T18:59:46.919880] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-11-03T18:59:47.140109] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-11-03T18:59:47.280275] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:47.628409] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-11-03T18:59:47.934861] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-11-03T18:59:48.734869] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-11-03T18:59:49.264556] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T18:59:49.534829] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-11-03T18:59:49.659373] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T18:59:49.971959] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T18:59:50.334864] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-11-03T18:59:50.906353] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T18:59:51.134880] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-11-03T18:59:51.934851] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-11-03T18:59:52.551594] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T18:59:52.562023] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T18:59:52.734846] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-11-03T18:59:53.534861] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-11. [2025-11-03T18:59:54.039987] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T18:59:54.211185] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T18:59:54.212038] [INFO ] [REMOTE ] FOF: Full fetch complete (11901 records). [2025-11-03T18:59:54.212114] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-11-03T18:59:54.339950] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-11-03T18:59:54.600367] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-11-03T18:59:54.600448] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-11-03T18:59:54.600741] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-11-03T18:59:54.600800] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-11-03T18:59:54.601251] [DEBUG] [LOCAL ] FOF: Trimmed 11901 records to 8084 (keeping 200 days of data) [2025-11-03T18:59:54.650559] [DEBUG] [LOCAL ] FOF: Primary data saved (8084 records). [2025-11-03T18:59:54.650715] [INFO ] [MAIN ] FOF: Full history saved. [2025-11-03T18:59:54.650805] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FOF took 20.7s. Estimated remaining: 3h 31m 2s. Rate: 7.2 symbols/min [2025-11-03T18:59:54.826137] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:54.878320] [DEBUG] [LOCAL ] FOUR: Loaded 50391 existing records from primary storage. [2025-11-03T18:59:54.879227] [INFO ] [MAIN ] FOUR: Loaded 50391 existing records. [2025-11-03T18:59:55.069264] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:55.069813] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-11-03T18:59:55.069923] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-11-03T18:59:55.079752] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-11-03T18:59:55.079963] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-11-03T18:59:55.114489] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-11-03T18:59:55.139618] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-11-03T18:59:55.454534] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:55.934874] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-11-03T18:59:56.470441] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T18:59:56.531952] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-11-03T18:59:56.734846] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-11. [2025-11-03T18:59:57.534828] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-11-03T18:59:57.540332] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T18:59:57.541268] [INFO ] [REMOTE ] FOA: Full fetch complete (20269 records). [2025-11-03T18:59:57.541339] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-11-03T18:59:57.900558] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-11-03T18:59:57.900635] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-11-03T18:59:57.901107] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-11-03T18:59:57.901151] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-11-03T18:59:57.901751] [DEBUG] [LOCAL ] FOA: Trimmed 20269 records to 12614 (keeping 200 days of data) [2025-11-03T18:59:57.976827] [DEBUG] [LOCAL ] FOA: Primary data saved (12614 records). [2025-11-03T18:59:57.976956] [INFO ] [MAIN ] FOA: Full history saved. [2025-11-03T18:59:57.977043] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FOA took 32.9s. Estimated remaining: 3h 30m 44s. Rate: 7.2 symbols/min [2025-11-03T18:59:58.152345] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T18:59:58.169639] [DEBUG] [LOCAL ] FPF: Loaded 18791 existing records from primary storage. [2025-11-03T18:59:58.169892] [INFO ] [MAIN ] FPF: Loaded 18791 existing records. [2025-11-03T18:59:58.353677] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-11-03T18:59:58.359182] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T18:59:58.359405] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-11-03T18:59:58.359471] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-11-03T18:59:58.360794] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-11-03T18:59:58.360855] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-11-03T18:59:58.740780] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T18:59:58.813559] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T18:59:59.134859] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-11-03T18:59:59.761755] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T18:59:59.934844] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-11-03T19:00:00.004109] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:00:00.734830] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-11. [2025-11-03T19:00:00.779326] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T19:00:01.534926] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-11-03T19:00:01.978596] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-11 (1.24 seconds). [2025-11-03T19:00:01.980730] [INFO ] [REMOTE ] FNV: Full fetch complete (67020 records). [2025-11-03T19:00:01.980990] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-11-03T19:00:02.341703] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-11-03T19:00:02.404678] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-11-03T19:00:02.404782] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-11-03T19:00:02.405887] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-11-03T19:00:02.405953] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-11-03T19:00:02.407467] [DEBUG] [LOCAL ] FNV: Trimmed 67020 records to 45681 (keeping 200 days of data) [2025-11-03T19:00:02.649988] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T19:00:02.723739] [DEBUG] [LOCAL ] FNV: Primary data saved (45681 records). [2025-11-03T19:00:02.723888] [INFO ] [MAIN ] FNV: Full history saved. [2025-11-03T19:00:02.724966] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FNV took 39.1s. Estimated remaining: 3h 30m 30s. Rate: 7.2 symbols/min [2025-11-03T19:00:02.910514] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:02.929224] [DEBUG] [LOCAL ] FPH: Loaded 19404 existing records from primary storage. [2025-11-03T19:00:02.929506] [INFO ] [MAIN ] FPH: Loaded 19404 existing records. [2025-11-03T19:00:03.118850] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:00:03.119130] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-11-03T19:00:03.119209] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-11-03T19:00:03.119630] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-11-03T19:00:03.119720] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-11-03T19:00:03.140139] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-11-03T19:00:03.497837] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:03.934909] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-11-03T19:00:04.191966] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-11-03T19:00:04.216719] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:00:04.491711] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T19:00:04.734827] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-11-03T19:00:05.534916] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-11-03T19:00:06.282837] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-11-03T19:00:06.334887] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-11-03T19:00:06.772081] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T19:00:07.134920] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-11-03T19:00:07.409609] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T19:00:07.934832] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-11-03T19:00:08.060189] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T19:00:08.734880] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-11-03T19:00:09.282140] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T19:00:09.500018] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T19:00:09.534858] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-11-03T19:00:10.278563] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T19:00:10.334866] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-11-03T19:00:11.128730] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T19:00:11.134807] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-11-03T19:00:11.794717] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T19:00:11.934898] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-11-03T19:00:12.734833] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-11-03T19:00:12.871886] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T19:00:13.534919] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-11-03T19:00:13.589079] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T19:00:14.206305] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T19:00:14.334914] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-11-03T19:00:14.902497] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T19:00:15.134886] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-11. [2025-11-03T19:00:15.844371] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-11 (0.71 seconds). [2025-11-03T19:00:15.845753] [INFO ] [REMOTE ] FOR: Full fetch complete (29285 records). [2025-11-03T19:00:15.845840] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-11-03T19:00:15.940029] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-11-03T19:00:16.293134] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-11-03T19:00:16.293272] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-11-03T19:00:16.294691] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-11-03T19:00:16.294763] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-11-03T19:00:16.296061] [DEBUG] [LOCAL ] FOR: Trimmed 29285 records to 18787 (keeping 200 days of data) [2025-11-03T19:00:16.417676] [DEBUG] [LOCAL ] FOR: Primary data saved (18787 records). [2025-11-03T19:00:16.418093] [INFO ] [MAIN ] FOR: Full history saved. [2025-11-03T19:00:16.418206] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FOR took 29.9s. Estimated remaining: 3h 30m 31s. Rate: 7.2 symbols/min [2025-11-03T19:00:16.639380] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:16.676842] [DEBUG] [LOCAL ] FPI: Loaded 31452 existing records from primary storage. [2025-11-03T19:00:16.677229] [INFO ] [MAIN ] FPI: Loaded 31452 existing records. [2025-11-03T19:00:16.745763] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-11-03T19:00:16.893988] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:00:16.894461] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-11-03T19:00:16.894540] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-11-03T19:00:16.906392] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-11-03T19:00:16.906533] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-11-03T19:00:16.912824] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T19:00:17.322824] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:17.534832] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-11-03T19:00:17.552584] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T19:00:17.608221] [DEBUG] [REMOTE ] FPI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-11-03T19:00:17.608740] [WARN ] [REMOTE ] FPI: No data returned for month 2025-01 [2025-11-03T19:00:17.608858] [FATAL] [REMOTE ] FPI: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:00:17.608923] [FATAL] [MAIN ] FPI: Failed to fetch primary data. [2025-11-03T19:00:17.608977] [WARN ] [MAIN ] FPI: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:00:17.609050] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-11-03T19:00:17.609126] [DEBUG] [LOCAL ] FPI: No primary data file found to delete. [2025-11-03T19:00:17.609176] [INFO ] [LOCAL ] FPI: Starting deletion of derivative data. [2025-11-03T19:00:17.609458] [DEBUG] [LOCAL ] FPI: Deleted derivative data file. [2025-11-03T19:00:17.609577] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FPI took 1.2s. Estimated remaining: 3h 30m 10s. Rate: 7.2 symbols/min [2025-11-03T19:00:17.801805] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:17.847193] [DEBUG] [LOCAL ] FR: Loaded 47086 existing records from primary storage. [2025-11-03T19:00:17.847668] [INFO ] [MAIN ] FR: Loaded 47086 existing records. [2025-11-03T19:00:18.046154] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:00:18.046491] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-11-03T19:00:18.046551] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-11-03T19:00:18.047680] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-11-03T19:00:18.047744] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-11-03T19:00:18.340063] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-11-03T19:00:18.447940] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:19.134891] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-11-03T19:00:19.637731] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T19:00:19.934909] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-11-03T19:00:20.283686] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:00:20.734972] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-11-03T19:00:21.323702] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-11-03T19:00:21.534937] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-11-03T19:00:21.750206] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T19:00:22.340011] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-11-03T19:00:22.350176] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T19:00:23.031710] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-11-03T19:00:23.134904] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-11-03T19:00:23.892058] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T19:00:23.934914] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-11-03T19:00:24.734951] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-11-03T19:00:24.755955] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-11-03T19:00:25.534992] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-11-03T19:00:25.928511] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T19:00:26.324839] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T19:00:26.334788] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-11-03T19:00:27.134911] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-11-03T19:00:27.634575] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T19:00:27.798401] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T19:00:27.935016] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-11-03T19:00:28.734901] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-11-03T19:00:29.331874] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T19:00:29.534863] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-11-03T19:00:29.676128] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T19:00:30.334863] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-11-03T19:00:31.014625] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-11-03T19:00:31.014128] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T19:00:31.134862] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-11-03T19:00:31.925320] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T19:00:31.934814] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-11-03T19:00:32.734853] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-11-03T19:00:33.279352] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T19:00:33.470693] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T19:00:33.534924] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-11-03T19:00:34.334855] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-11. [2025-11-03T19:00:35.034265] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T19:00:35.042750] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-11 (0.71 seconds). [2025-11-03T19:00:35.051683] [INFO ] [REMOTE ] FPF: Full fetch complete (26623 records). [2025-11-03T19:00:35.051874] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-11-03T19:00:35.140000] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-11. [2025-11-03T19:00:35.489838] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-11-03T19:00:35.489951] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-11-03T19:00:35.490864] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-11-03T19:00:35.490948] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-11-03T19:00:35.492066] [DEBUG] [LOCAL ] FPF: Trimmed 26623 records to 18536 (keeping 200 days of data) [2025-11-03T19:00:35.617693] [DEBUG] [LOCAL ] FPF: Primary data saved (18536 records). [2025-11-03T19:00:35.617931] [INFO ] [MAIN ] FPF: Full history saved. [2025-11-03T19:00:35.618060] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FPF took 37.6s. Estimated remaining: 3h 30m 18s. Rate: 7.2 symbols/min [2025-11-03T19:00:35.798612] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:35.816122] [DEBUG] [LOCAL ] FRA: Loaded 13447 existing records from primary storage. [2025-11-03T19:00:35.816440] [INFO ] [MAIN ] FRA: Loaded 13447 existing records. [2025-11-03T19:00:35.939983] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-11-03T19:00:36.058132] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:00:36.058472] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-11-03T19:00:36.058577] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-11-03T19:00:36.059092] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-11-03T19:00:36.059170] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-11-03T19:00:36.524332] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:36.678727] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-11 (1.54 seconds). [2025-11-03T19:00:36.680358] [INFO ] [REMOTE ] FOUR: Full fetch complete (72433 records). [2025-11-03T19:00:36.680486] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-11-03T19:00:36.740147] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-11-03T19:00:37.107812] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-11-03T19:00:37.107955] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-11-03T19:00:37.109160] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-11-03T19:00:37.109308] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-11-03T19:00:37.111056] [DEBUG] [LOCAL ] FOUR: Trimmed 72433 records to 49710 (keeping 200 days of data) [2025-11-03T19:00:37.268168] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T19:00:37.461202] [DEBUG] [LOCAL ] FOUR: Primary data saved (49710 records). [2025-11-03T19:00:37.461362] [INFO ] [MAIN ] FOUR: Full history saved. [2025-11-03T19:00:37.462350] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FOUR took 42.8s. Estimated remaining: 3h 29m 58s. Rate: 7.2 symbols/min [2025-11-03T19:00:37.540014] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-11-03T19:00:37.641973] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:37.659117] [DEBUG] [LOCAL ] FRGE: Loaded 15502 existing records from primary storage. [2025-11-03T19:00:37.659380] [INFO ] [MAIN ] FRGE: Loaded 15502 existing records. [2025-11-03T19:00:37.841896] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:00:37.860683] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-11-03T19:00:37.862790] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T19:00:37.862929] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-11-03T19:00:37.870323] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-11-03T19:00:37.870417] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-11-03T19:00:38.255992] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:38.334918] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-11-03T19:00:38.898134] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T19:00:38.961445] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T19:00:39.134888] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-11-03T19:00:39.797755] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T19:00:39.934881] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-11-03T19:00:40.621452] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T19:00:40.734854] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-11-03T19:00:41.534887] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-11-03T19:00:41.889419] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:00:42.223836] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-11-03T19:00:42.334911] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-11-03T19:00:42.944018] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T19:00:43.134924] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-11-03T19:00:43.934824] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-11-03T19:00:44.194172] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T19:00:44.734904] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-11. [2025-11-03T19:00:44.850629] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T19:00:45.356998] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T19:00:45.357953] [INFO ] [REMOTE ] FPH: Full fetch complete (30633 records). [2025-11-03T19:00:45.358028] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-11-03T19:00:45.539920] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-11-03T19:00:45.728868] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-11-03T19:00:45.728951] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-11-03T19:00:45.729569] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-11-03T19:00:45.729629] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-11-03T19:00:45.730389] [DEBUG] [LOCAL ] FPH: Trimmed 30633 records to 19136 (keeping 200 days of data) [2025-11-03T19:00:45.832891] [DEBUG] [LOCAL ] FPH: Primary data saved (19136 records). [2025-11-03T19:00:45.833025] [INFO ] [MAIN ] FPH: Full history saved. [2025-11-03T19:00:45.833100] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FPH took 43.1s. Estimated remaining: 3h 29m 50s. Rate: 7.2 symbols/min [2025-11-03T19:00:45.999300] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:46.046173] [DEBUG] [LOCAL ] FRO: Loaded 52338 existing records from primary storage. [2025-11-03T19:00:46.046474] [INFO ] [MAIN ] FRO: Loaded 52338 existing records. [2025-11-03T19:00:46.242130] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:00:46.242336] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-11-03T19:00:46.242382] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-11-03T19:00:46.243365] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-11-03T19:00:46.243422] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-11-03T19:00:46.340016] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-11-03T19:00:46.605677] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:46.625321] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T19:00:46.997039] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T19:00:47.134904] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-11-03T19:00:47.927930] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T19:00:47.934813] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-11-03T19:00:48.551741] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:00:48.734926] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-11-03T19:00:49.534883] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-11-03T19:00:49.923894] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:00:50.334863] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-11-03T19:00:51.085282] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T19:00:51.134868] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-11-03T19:00:51.626900] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T19:00:51.934928] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-11-03T19:00:52.653448] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T19:00:52.734837] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-11-03T19:00:52.862756] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T19:00:53.534877] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-11. [2025-11-03T19:00:54.253314] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T19:00:54.334886] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-11-03T19:00:54.497081] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T19:00:54.498540] [INFO ] [REMOTE ] FR: Full fetch complete (67528 records). [2025-11-03T19:00:54.498695] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-11-03T19:00:54.891804] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-11-03T19:00:54.891895] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-11-03T19:00:54.892751] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-11-03T19:00:54.892815] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-11-03T19:00:54.894186] [DEBUG] [LOCAL ] FR: Trimmed 67528 records to 46273 (keeping 200 days of data) [2025-11-03T19:00:55.148895] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-11-03T19:00:55.182152] [DEBUG] [LOCAL ] FR: Primary data saved (46273 records). [2025-11-03T19:00:55.182280] [INFO ] [MAIN ] FR: Full history saved. [2025-11-03T19:00:55.182372] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FR took 37.6s. Estimated remaining: 3h 29m 43s. Rate: 7.2 symbols/min [2025-11-03T19:00:55.358620] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:00:55.358912] [DEBUG] [LOCAL ] FRT: No existing data file found in primary storage. [2025-11-03T19:00:55.358962] [WARN ] [MAIN ] FRT: No existing data found, performing full refresh instead. [2025-11-03T19:00:55.359069] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-11-03T19:00:55.359110] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-11-03T19:00:55.359151] [DEBUG] [LOCAL ] FRT: No primary data file found to delete. [2025-11-03T19:00:55.359183] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-11-03T19:00:55.718880] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:00:55.780423] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T19:00:55.859319] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T19:00:55.934886] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-11-03T19:00:56.734938] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-11-03T19:00:57.388680] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T19:00:57.534927] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-11-03T19:00:57.889202] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:00:58.334910] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-11-03T19:00:58.951824] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T19:00:59.134894] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-11-03T19:00:59.462033] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:00:59.934872] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-11-03T19:01:00.734820] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-11-03T19:01:00.809364] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T19:01:01.033850] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-11-03T19:01:01.534947] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-11-03T19:01:01.981184] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T19:01:02.334907] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-11-03T19:01:03.021298] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T19:01:03.134859] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-11-03T19:01:03.293109] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T19:01:03.934906] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-11. [2025-11-03T19:01:04.513785] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-11 (0.58 seconds). [2025-11-03T19:01:04.514779] [INFO ] [REMOTE ] FRA: Full fetch complete (22145 records). [2025-11-03T19:01:04.514854] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-11-03T19:01:04.740095] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-11-03T19:01:04.892723] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-11-03T19:01:04.892886] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-11-03T19:01:04.893385] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-11-03T19:01:04.893544] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-11-03T19:01:04.907558] [DEBUG] [LOCAL ] FRA: Trimmed 22145 records to 13234 (keeping 200 days of data) [2025-11-03T19:01:04.931909] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-11-03T19:01:05.022179] [DEBUG] [LOCAL ] FRA: Primary data saved (13234 records). [2025-11-03T19:01:05.022326] [INFO ] [MAIN ] FRA: Full history saved. [2025-11-03T19:01:05.022407] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FRA took 29.4s. Estimated remaining: 3h 29m 37s. Rate: 7.2 symbols/min [2025-11-03T19:01:05.202841] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:01:05.235840] [DEBUG] [LOCAL ] FSCO: Loaded 38879 existing records from primary storage. [2025-11-03T19:01:05.236150] [INFO ] [MAIN ] FSCO: Loaded 38879 existing records. [2025-11-03T19:01:05.411140] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:01:05.411403] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-11-03T19:01:05.411451] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-11-03T19:01:05.412159] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-11-03T19:01:05.412220] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-11-03T19:01:05.540135] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-11-03T19:01:05.774156] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:01:05.797725] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T19:01:06.334908] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-11-03T19:01:06.824783] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T19:01:06.968485] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:01:07.134919] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-11-03T19:01:07.857353] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-11-03T19:01:07.934915] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-11-03T19:01:08.734873] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-11-03T19:01:09.540139] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-11-03T19:01:09.568355] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-11-03T19:01:09.850473] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-11-03T19:01:10.300081] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-11-03T19:01:10.334816] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-11-03T19:01:10.913444] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T19:01:11.134841] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-11-03T19:01:11.934931] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-11-03T19:01:12.275748] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T19:01:12.422386] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T19:01:12.734901] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-11-03T19:01:13.534919] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-11-03T19:01:14.224376] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T19:01:14.285036] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T19:01:14.334837] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-11-03T19:01:15.134833] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-11. [2025-11-03T19:01:15.358450] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T19:01:15.836715] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T19:01:15.838587] [INFO ] [REMOTE ] FRGE: Full fetch complete (29252 records). [2025-11-03T19:01:15.838743] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-11-03T19:01:15.940139] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-11. [2025-11-03T19:01:16.348748] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-11-03T19:01:16.348844] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-11-03T19:01:16.349545] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-11-03T19:01:16.349611] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-11-03T19:01:16.350486] [DEBUG] [LOCAL ] FRGE: Trimmed 29252 records to 15026 (keeping 200 days of data) [2025-11-03T19:01:16.449823] [DEBUG] [LOCAL ] FRGE: Primary data saved (15026 records). [2025-11-03T19:01:16.449967] [INFO ] [MAIN ] FRGE: Full history saved. [2025-11-03T19:01:16.450048] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FRGE took 39.0s. Estimated remaining: 3h 29m 34s. Rate: 7.2 symbols/min [2025-11-03T19:01:16.663804] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:01:16.710048] [DEBUG] [LOCAL ] FSK: Loaded 50109 existing records from primary storage. [2025-11-03T19:01:16.710385] [INFO ] [MAIN ] FSK: Loaded 50109 existing records. [2025-11-03T19:01:16.743503] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-11-03T19:01:16.900830] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:01:16.901036] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-11-03T19:01:16.901084] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-11-03T19:01:16.901970] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-11-03T19:01:16.902031] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-11-03T19:01:17.263083] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:01:17.402768] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T19:01:17.404334] [INFO ] [REMOTE ] FRO: Full fetch complete (75274 records). [2025-11-03T19:01:17.404615] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-11-03T19:01:17.540004] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-11-03T19:01:17.885409] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-11-03T19:01:17.885670] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-11-03T19:01:17.886721] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-11-03T19:01:17.886801] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-11-03T19:01:17.888507] [DEBUG] [LOCAL ] FRO: Trimmed 75274 records to 51564 (keeping 200 days of data) [2025-11-03T19:01:18.160191] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T19:01:18.277620] [DEBUG] [LOCAL ] FRO: Primary data saved (51564 records). [2025-11-03T19:01:18.277780] [INFO ] [MAIN ] FRO: Full history saved. [2025-11-03T19:01:18.278743] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FRO took 32.4s. Estimated remaining: 3h 29m 14s. Rate: 7.2 symbols/min [2025-11-03T19:01:18.342799] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-11-03T19:01:18.451754] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:01:18.498407] [DEBUG] [LOCAL ] FSLY: Loaded 51958 existing records from primary storage. [2025-11-03T19:01:18.498727] [INFO ] [MAIN ] FSLY: Loaded 51958 existing records. [2025-11-03T19:01:18.682023] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:01:18.682273] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-11-03T19:01:18.682319] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-11-03T19:01:18.683149] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-11-03T19:01:18.683207] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-11-03T19:01:19.060916] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:01:19.086273] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T19:01:19.134837] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-11-03T19:01:19.498178] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T19:01:19.934868] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-11-03T19:01:20.281189] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T19:01:20.734890] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-11-03T19:01:21.329443] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T19:01:21.534880] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-11-03T19:01:21.853689] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T19:01:22.334835] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-11-03T19:01:22.528135] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T19:01:23.134957] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-11-03T19:01:23.747073] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:01:23.934877] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-11-03T19:01:24.117503] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:01:24.734924] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-11-03T19:01:25.156203] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T19:01:25.534900] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-11-03T19:01:26.066632] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T19:01:26.334859] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-11-03T19:01:26.750992] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T19:01:27.134810] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-11-03T19:01:27.341278] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T19:01:27.934854] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-11-03T19:01:28.542026] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:01:28.734833] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-11-03T19:01:29.165282] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:01:29.534858] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-11-03T19:01:29.744098] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T19:01:30.334849] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-11-03T19:01:30.724670] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:01:31.134857] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-11-03T19:01:31.564557] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T19:01:31.934868] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-11-03T19:01:32.321522] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T19:01:32.734849] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-11. [2025-11-03T19:01:33.113833] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T19:01:33.534854] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-11-03T19:01:33.544518] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:01:33.546384] [INFO ] [REMOTE ] FRT: Full fetch complete (60521 records). [2025-11-03T19:01:33.546510] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-11-03T19:01:33.977417] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-11-03T19:01:33.977509] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-11-03T19:01:33.978337] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-11-03T19:01:33.978400] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-11-03T19:01:33.979630] [DEBUG] [LOCAL ] FRT: Trimmed 60521 records to 41024 (keeping 200 days of data) [2025-11-03T19:01:34.219315] [DEBUG] [LOCAL ] FRT: Primary data saved (41024 records). [2025-11-03T19:01:34.219433] [INFO ] [MAIN ] FRT: Full history saved. [2025-11-03T19:01:34.219497] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRT took 39.0s. Estimated remaining: 3h 29m 19s. Rate: 7.2 symbols/min [2025-11-03T19:01:34.339976] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-11-03T19:01:34.388081] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:01:34.438778] [DEBUG] [LOCAL ] FSM: Loaded 54072 existing records from primary storage. [2025-11-03T19:01:34.439122] [INFO ] [MAIN ] FSM: Loaded 54072 existing records. [2025-11-03T19:01:34.612221] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:01:34.612417] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-11-03T19:01:34.612502] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-11-03T19:01:34.613417] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-11-03T19:01:34.613484] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-11-03T19:01:34.970003] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:01:34.997706] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-11-03T19:01:35.134850] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-11. [2025-11-03T19:01:35.899151] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T19:01:35.934830] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-11-03T19:01:36.054053] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-11 (0.92 seconds). [2025-11-03T19:01:36.055427] [INFO ] [REMOTE ] FSCO: Full fetch complete (55322 records). [2025-11-03T19:01:36.055509] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-11-03T19:01:36.430155] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-11-03T19:01:36.430251] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-11-03T19:01:36.431044] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-11-03T19:01:36.431110] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-11-03T19:01:36.432349] [DEBUG] [LOCAL ] FSCO: Trimmed 55322 records to 38338 (keeping 200 days of data) [2025-11-03T19:01:36.651752] [DEBUG] [LOCAL ] FSCO: Primary data saved (38338 records). [2025-11-03T19:01:36.651887] [INFO ] [MAIN ] FSCO: Full history saved. [2025-11-03T19:01:36.651964] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FSCO took 31.6s. Estimated remaining: 3h 29m 0s. Rate: 7.2 symbols/min [2025-11-03T19:01:36.739981] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-11-03T19:01:36.831076] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:01:36.862744] [DEBUG] [LOCAL ] FSS: Loaded 33268 existing records from primary storage. [2025-11-03T19:01:36.863065] [INFO ] [MAIN ] FSS: Loaded 33268 existing records. [2025-11-03T19:01:37.052240] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:01:37.052557] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-11-03T19:01:37.052698] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-11-03T19:01:37.053504] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-11-03T19:01:37.053564] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-11-03T19:01:37.440915] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T19:01:37.509635] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:01:37.534838] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-11-03T19:01:37.868793] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T19:01:38.334833] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-11-03T19:01:38.503679] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T19:01:39.134859] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-11-03T19:01:39.810844] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-11-03T19:01:39.935110] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-11-03T19:01:40.360170] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:01:40.734970] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-11-03T19:01:41.377844] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T19:01:41.534896] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-11-03T19:01:42.164601] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T19:01:42.335114] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-11-03T19:01:42.869040] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T19:01:43.134917] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-11-03T19:01:43.835632] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T19:01:43.934850] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-11-03T19:01:44.468777] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-11-03T19:01:44.734912] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-11-03T19:01:45.305489] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T19:01:45.542298] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-11-03T19:01:45.546145] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T19:01:46.334869] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-11. [2025-11-03T19:01:47.117909] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-11-03T19:01:47.134864] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-11-03T19:01:47.452824] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T19:01:47.454804] [INFO ] [REMOTE ] FSK: Full fetch complete (72243 records). [2025-11-03T19:01:47.454931] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-11-03T19:01:47.869700] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-11-03T19:01:47.869785] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-11-03T19:01:47.870741] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-11-03T19:01:47.870803] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-11-03T19:01:47.872176] [DEBUG] [LOCAL ] FSK: Trimmed 72243 records to 49338 (keeping 200 days of data) [2025-11-03T19:01:47.960057] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-11-03T19:01:48.173430] [DEBUG] [LOCAL ] FSK: Primary data saved (49338 records). [2025-11-03T19:01:48.173852] [INFO ] [MAIN ] FSK: Full history saved. [2025-11-03T19:01:48.174873] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FSK took 31.7s. Estimated remaining: 3h 28m 57s. Rate: 7.2 symbols/min [2025-11-03T19:01:48.346746] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:01:48.355676] [DEBUG] [LOCAL ] FT: Loaded 6799 existing records from primary storage. [2025-11-03T19:01:48.355895] [INFO ] [MAIN ] FT: Loaded 6799 existing records. [2025-11-03T19:01:48.540388] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:01:48.560012] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:01:48.568156] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-11-03T19:01:48.568245] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-11-03T19:01:48.569129] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-11-03T19:01:48.569190] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-11-03T19:01:48.740036] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-11-03T19:01:48.924861] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:01:49.270734] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T19:01:49.534852] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-11-03T19:01:49.953498] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-11-03T19:01:50.139937] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T19:01:50.334883] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-11-03T19:01:50.772525] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T19:01:51.134894] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-11-03T19:01:51.934859] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-11-03T19:01:52.468913] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:01:52.467130] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-11-03T19:01:52.734846] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-11-03T19:01:53.534869] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-11-03T19:01:54.155582] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T19:01:54.334871] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-11-03T19:01:54.891728] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T19:01:55.134877] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-11-03T19:01:55.788349] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-11-03T19:01:55.934910] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-11-03T19:01:56.204673] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T19:01:56.428685] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-11-03T19:01:56.734875] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-11-03T19:01:57.534920] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-11-03T19:01:57.843186] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:01:57.971276] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T19:01:58.334927] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-11-03T19:01:58.669287] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-11-03T19:01:59.134903] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-11. [2025-11-03T19:01:59.934892] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-11-03T19:02:00.236395] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:02:00.237992] [INFO ] [REMOTE ] FSLY: Full fetch complete (74857 records). [2025-11-03T19:02:00.238114] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-11-03T19:02:00.633620] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-11-03T19:02:00.633729] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-11-03T19:02:00.634618] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-11-03T19:02:00.634691] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-11-03T19:02:00.636116] [DEBUG] [LOCAL ] FSLY: Trimmed 74857 records to 51207 (keeping 200 days of data) [2025-11-03T19:02:00.742311] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-11-03T19:02:00.957949] [DEBUG] [LOCAL ] FSLY: Primary data saved (51207 records). [2025-11-03T19:02:00.958141] [INFO ] [MAIN ] FSLY: Full history saved. [2025-11-03T19:02:00.958993] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FSLY took 42.7s. Estimated remaining: 3h 28m 57s. Rate: 7.2 symbols/min [2025-11-03T19:02:01.181135] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:01.207574] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:02:01.227634] [DEBUG] [LOCAL ] FTHY: Loaded 12074 existing records from primary storage. [2025-11-03T19:02:01.227945] [INFO ] [MAIN ] FTHY: Loaded 12074 existing records. [2025-11-03T19:02:01.458665] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:01.458958] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-11-03T19:02:01.459016] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-11-03T19:02:01.459402] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-11-03T19:02:01.459471] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-11-03T19:02:01.543484] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-11-03T19:02:01.852086] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:02.199581] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-11-03T19:02:02.334889] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-11-03T19:02:02.907345] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-11-03T19:02:03.100536] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T19:02:03.134821] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-11-03T19:02:03.934895] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-11-03T19:02:04.501206] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T19:02:04.620485] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T19:02:04.734849] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-11-03T19:02:05.534863] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-11-03T19:02:05.625205] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T19:02:05.894425] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-11-03T19:02:06.334863] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-11. [2025-11-03T19:02:07.134911] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-11-03T19:02:07.570864] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-11 (1.24 seconds). [2025-11-03T19:02:07.572362] [INFO ] [REMOTE ] FSM: Full fetch complete (77271 records). [2025-11-03T19:02:07.572458] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-11-03T19:02:07.777326] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-11-03T19:02:07.939179] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-11-03T19:02:07.978986] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-11-03T19:02:07.979063] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-11-03T19:02:07.979985] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-11-03T19:02:07.980048] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-11-03T19:02:07.981602] [DEBUG] [LOCAL ] FSM: Trimmed 77271 records to 53294 (keeping 200 days of data) [2025-11-03T19:02:08.279693] [DEBUG] [LOCAL ] FSM: Primary data saved (53294 records). [2025-11-03T19:02:08.279848] [INFO ] [MAIN ] FSM: Full history saved. [2025-11-03T19:02:08.279986] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSM took 34.1s. Estimated remaining: 3h 28m 46s. Rate: 7.2 symbols/min [2025-11-03T19:02:08.446584] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:08.493572] [DEBUG] [LOCAL ] FTI: Loaded 54069 existing records from primary storage. [2025-11-03T19:02:08.494014] [INFO ] [MAIN ] FTI: Loaded 54069 existing records. [2025-11-03T19:02:08.608890] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T19:02:08.696718] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:08.696923] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-11-03T19:02:08.696971] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-11-03T19:02:08.697894] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-11-03T19:02:08.697951] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-11-03T19:02:08.739965] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-11-03T19:02:09.056999] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:09.291901] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T19:02:09.534848] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-11. [2025-11-03T19:02:10.017668] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-11 (0.48 seconds). [2025-11-03T19:02:10.018407] [INFO ] [REMOTE ] FT: Full fetch complete (9421 records). [2025-11-03T19:02:10.018475] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-11-03T19:02:10.339977] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-11-03T19:02:10.380102] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-11-03T19:02:10.380175] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-11-03T19:02:10.380425] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-11-03T19:02:10.380466] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-11-03T19:02:10.380909] [DEBUG] [LOCAL ] FT: Trimmed 9421 records to 6750 (keeping 200 days of data) [2025-11-03T19:02:10.419172] [DEBUG] [LOCAL ] FT: Primary data saved (6750 records). [2025-11-03T19:02:10.419269] [INFO ] [MAIN ] FT: Full history saved. [2025-11-03T19:02:10.419341] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FT took 22.2s. Estimated remaining: 3h 28m 27s. Rate: 7.2 symbols/min [2025-11-03T19:02:10.586485] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:10.618767] [DEBUG] [LOCAL ] FTK: Loaded 33716 existing records from primary storage. [2025-11-03T19:02:10.619067] [INFO ] [MAIN ] FTK: Loaded 33716 existing records. [2025-11-03T19:02:10.798107] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:10.798432] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-11-03T19:02:10.798563] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-11-03T19:02:10.799188] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-11-03T19:02:10.799245] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-11-03T19:02:10.906320] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-11-03T19:02:11.137126] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-11-03T19:02:11.163933] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:11.934898] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-11-03T19:02:12.402785] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T19:02:12.610135] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-11-03T19:02:12.734847] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-11-03T19:02:13.494020] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-11-03T19:02:13.534805] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-11-03T19:02:14.233984] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T19:02:14.334821] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-11-03T19:02:15.134871] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-11-03T19:02:15.578730] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T19:02:15.934817] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-11-03T19:02:15.973589] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T19:02:16.734842] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-11-03T19:02:17.441910] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T19:02:17.534887] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-11-03T19:02:17.721922] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T19:02:18.334874] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-11-03T19:02:18.890027] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T19:02:19.134860] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-11-03T19:02:19.149823] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-11-03T19:02:19.934877] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-11-03T19:02:20.409772] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:02:20.734854] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-11-03T19:02:20.862894] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T19:02:21.534830] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-11. [2025-11-03T19:02:21.716210] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T19:02:22.334956] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-11-03T19:02:22.572723] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-11 (1.04 seconds). [2025-11-03T19:02:22.574262] [INFO ] [REMOTE ] FSS: Full fetch complete (48795 records). [2025-11-03T19:02:22.574337] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-11-03T19:02:22.929040] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-11-03T19:02:22.997345] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-11-03T19:02:22.997441] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-11-03T19:02:22.998152] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-11-03T19:02:22.998214] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-11-03T19:02:22.999285] [DEBUG] [LOCAL ] FSS: Trimmed 48795 records to 32715 (keeping 200 days of data) [2025-11-03T19:02:23.157604] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-11-03T19:02:23.207720] [DEBUG] [LOCAL ] FSS: Primary data saved (32715 records). [2025-11-03T19:02:23.207870] [INFO ] [MAIN ] FSS: Full history saved. [2025-11-03T19:02:23.207952] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FSS took 46.6s. Estimated remaining: 3h 28m 26s. Rate: 7.2 symbols/min [2025-11-03T19:02:23.379395] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:23.418729] [DEBUG] [LOCAL ] FTS: Loaded 42909 existing records from primary storage. [2025-11-03T19:02:23.419070] [INFO ] [MAIN ] FTS: Loaded 42909 existing records. [2025-11-03T19:02:23.602618] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:23.602825] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-11-03T19:02:23.602887] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-11-03T19:02:23.603821] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-11-03T19:02:23.603889] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-11-03T19:02:23.951304] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-11-03T19:02:24.007213] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:24.286163] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:02:24.486112] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T19:02:24.734895] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-11-03T19:02:25.534895] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-11-03T19:02:25.725596] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T19:02:26.210634] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T19:02:26.335103] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-11-03T19:02:27.134857] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-11-03T19:02:27.705933] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T19:02:27.934878] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-11-03T19:02:28.183059] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T19:02:28.580322] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-11-03T19:02:28.734865] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-11-03T19:02:29.534876] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-11-03T19:02:29.861453] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:02:30.334863] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-11-03T19:02:30.767600] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T19:02:31.134907] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-11-03T19:02:31.451102] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T19:02:31.700732] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T19:02:31.934863] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-11-03T19:02:32.478348] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-11-03T19:02:32.734832] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-11-03T19:02:33.534850] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-11-03T19:02:34.000945] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:02:34.334855] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-11. [2025-11-03T19:02:34.599779] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T19:02:34.858205] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-11 (0.52 seconds). [2025-11-03T19:02:34.859067] [INFO ] [REMOTE ] FTHY: Full fetch complete (17143 records). [2025-11-03T19:02:34.859139] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-11-03T19:02:35.139991] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-11-03T19:02:35.243232] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-11-03T19:02:35.243311] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-11-03T19:02:35.243699] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-11-03T19:02:35.243760] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-11-03T19:02:35.244266] [DEBUG] [LOCAL ] FTHY: Trimmed 17143 records to 11711 (keeping 200 days of data) [2025-11-03T19:02:35.318090] [DEBUG] [LOCAL ] FTHY: Primary data saved (11711 records). [2025-11-03T19:02:35.318262] [INFO ] [MAIN ] FTHY: Full history saved. [2025-11-03T19:02:35.318366] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FTHY took 34.4s. Estimated remaining: 3h 28m 24s. Rate: 7.1 symbols/min [2025-11-03T19:02:35.494079] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:35.541813] [DEBUG] [LOCAL ] FTV: Loaded 53781 existing records from primary storage. [2025-11-03T19:02:35.542138] [INFO ] [MAIN ] FTV: Loaded 53781 existing records. [2025-11-03T19:02:35.731211] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:35.731414] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-11-03T19:02:35.731469] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-11-03T19:02:35.732483] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-11-03T19:02:35.732545] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-11-03T19:02:35.939969] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-11-03T19:02:36.116099] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:36.141890] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T19:02:36.734848] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-11-03T19:02:37.545404] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-11-03T19:02:37.553532] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T19:02:37.979480] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T19:02:38.334915] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-11-03T19:02:38.406983] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T19:02:39.134914] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-11-03T19:02:39.558263] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T19:02:39.934896] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-11-03T19:02:40.235481] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:02:40.734867] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-11-03T19:02:41.416919] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T19:02:41.534837] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-11-03T19:02:41.729409] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-11-03T19:02:42.334906] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-11-03T19:02:42.779737] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T19:02:43.134923] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-11-03T19:02:43.538729] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T19:02:43.934911] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-11-03T19:02:44.498805] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T19:02:44.734823] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-11. [2025-11-03T19:02:44.878867] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T19:02:45.534903] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-11. [2025-11-03T19:02:46.025221] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-11 (1.29 seconds). [2025-11-03T19:02:46.026741] [INFO ] [REMOTE ] FTI: Full fetch complete (77338 records). [2025-11-03T19:02:46.026831] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-11-03T19:02:46.340141] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-11-03T19:02:46.450906] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-11-03T19:02:46.451147] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-11-03T19:02:46.452200] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-11-03T19:02:46.452267] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-11-03T19:02:46.453737] [DEBUG] [LOCAL ] FTI: Trimmed 77338 records to 53290 (keeping 200 days of data) [2025-11-03T19:02:46.523429] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:02:46.558882] [INFO ] [REMOTE ] FTK: Full fetch complete (44449 records). [2025-11-03T19:02:46.562698] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-11-03T19:02:47.159767] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-11-03T19:02:47.176421] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-11-03T19:02:47.177677] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-11-03T19:02:47.179614] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-11-03T19:02:47.180091] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-11-03T19:02:47.194446] [DEBUG] [LOCAL ] FTI: Primary data saved (53290 records). [2025-11-03T19:02:47.194356] [DEBUG] [LOCAL ] FTK: Trimmed 44449 records to 33542 (keeping 200 days of data) [2025-11-03T19:02:47.194699] [INFO ] [MAIN ] FTI: Full history saved. [2025-11-03T19:02:47.194846] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FTI took 38.9s. Estimated remaining: 3h 28m 22s. Rate: 7.1 symbols/min [2025-11-03T19:02:47.384314] [DEBUG] [LOCAL ] FTK: Primary data saved (33542 records). [2025-11-03T19:02:47.384474] [INFO ] [MAIN ] FTK: Full history saved. [2025-11-03T19:02:47.384553] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FTK took 37.0s. Estimated remaining: 3h 27m 60s. Rate: 7.2 symbols/min [2025-11-03T19:02:47.833514] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T19:02:47.934854] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-11-03T19:02:48.232540] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T19:02:48.734844] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-11-03T19:02:49.165009] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:02:49.534912] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-11-03T19:02:49.850204] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T19:02:50.334898] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-11-03T19:02:50.877225] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:02:51.134909] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-11-03T19:02:51.620749] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T19:02:51.934855] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-11. [2025-11-03T19:02:52.391660] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T19:02:52.734887] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-11-03T19:02:52.808908] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:02:52.810842] [INFO ] [REMOTE ] FTS: Full fetch complete (61074 records). [2025-11-03T19:02:52.810999] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-11-03T19:02:53.242089] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-11-03T19:02:53.242225] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-11-03T19:02:53.243055] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-11-03T19:02:53.243118] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-11-03T19:02:53.244553] [DEBUG] [LOCAL ] FTS: Trimmed 61074 records to 42334 (keeping 200 days of data) [2025-11-03T19:02:53.494188] [DEBUG] [LOCAL ] FTS: Primary data saved (42334 records). [2025-11-03T19:02:53.494320] [INFO ] [MAIN ] FTS: Full history saved. [2025-11-03T19:02:53.494421] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTS took 30.3s. Estimated remaining: 3h 27m 47s. Rate: 7.2 symbols/min [2025-11-03T19:02:54.029566] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T19:02:54.040997] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-11-03T19:02:55.389835] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T19:02:55.402448] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-11. [2025-11-03T19:02:56.407458] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T19:02:56.409478] [INFO ] [REMOTE ] FTV: Full fetch complete (76668 records). [2025-11-03T19:02:56.409639] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-11-03T19:02:56.812977] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-11-03T19:02:56.813069] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-11-03T19:02:56.814019] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-11-03T19:02:56.814090] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-11-03T19:02:56.815570] [DEBUG] [LOCAL ] FTV: Trimmed 76668 records to 53020 (keeping 200 days of data) [2025-11-03T19:02:57.134845] [DEBUG] [LOCAL ] FTV: Primary data saved (53020 records). [2025-11-03T19:02:57.134985] [INFO ] [MAIN ] FTV: Full history saved. [2025-11-03T19:02:57.135730] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTV took 21.8s. Estimated remaining: 3h 27m 31s. Rate: 7.2 symbols/min [2025-11-03T19:02:57.698085] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:57.776242] [INFO ] [MAIN ] FTW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:57.803173] [DEBUG] [LOCAL ] FTW: No existing data file found in primary storage. [2025-11-03T19:02:57.860269] [WARN ] [MAIN ] FTW: No existing data found, performing full refresh instead. [2025-11-03T19:02:57.863610] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:57.866558] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:02:57.866886] [INFO ] [MAIN ] FTW: Wiping existing primary data before full refresh. [2025-11-03T19:02:57.867088] [INFO ] [LOCAL ] FTW: Starting deletion of primary data. [2025-11-03T19:02:57.869074] [DEBUG] [LOCAL ] FTW: No primary data file found to delete. [2025-11-03T19:02:57.869363] [INFO ] [MAIN ] FTW: Starting full primary refresh. [2025-11-03T19:02:57.900713] [DEBUG] [LOCAL ] FTWO: Loaded 1959 existing records from primary storage. [2025-11-03T19:02:57.917602] [INFO ] [MAIN ] FTWO: Loaded 1959 existing records. [2025-11-03T19:02:58.165857] [DEBUG] [LOCAL ] FUBO: Loaded 54494 existing records from primary storage. [2025-11-03T19:02:58.198453] [INFO ] [MAIN ] FUBO: Loaded 54494 existing records. [2025-11-03T19:02:58.354114] [DEBUG] [LOCAL ] FUL: Loaded 32065 existing records from primary storage. [2025-11-03T19:02:58.455120] [INFO ] [MAIN ] FUL: Loaded 32065 existing records. [2025-11-03T19:02:58.449868] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:58.527793] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-11-03T19:02:58.574083] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-11-03T19:02:58.588278] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-11-03T19:02:58.588433] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-11-03T19:02:58.812485] [INFO ] [REMOTE ] FTW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:58.866350] [INFO ] [REMOTE ] FTW: Fetching primary data for 2025-01. [2025-11-03T19:02:58.959073] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:58.985680] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-11-03T19:02:58.991344] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-11-03T19:02:59.033788] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:02:59.052540] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-11-03T19:02:59.082577] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-11-03T19:02:59.082680] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-11-03T19:02:59.107132] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-11-03T19:02:59.123308] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-11-03T19:02:59.151479] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-11-03T19:02:59.237096] [DEBUG] [REMOTE ] FTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:02:59.286909] [WARN ] [REMOTE ] FTW: No data returned for month 2025-01 [2025-11-03T19:02:59.390676] [FATAL] [REMOTE ] FTW: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:02:59.491398] [FATAL] [MAIN ] FTW: Failed to fetch primary data. [2025-11-03T19:02:59.587175] [WARN ] [MAIN ] FTW: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:02:59.624533] [INFO ] [LOCAL ] FTW: Starting deletion of primary data. [2025-11-03T19:02:59.639773] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:02:59.682232] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-11-03T19:02:59.737944] [DEBUG] [LOCAL ] FTW: No primary data file found to delete. [2025-11-03T19:02:59.838719] [INFO ] [LOCAL ] FTW: Starting deletion of derivative data. [2025-11-03T19:02:59.858397] [DEBUG] [LOCAL ] FTW: No derivative data file found to delete. [2025-11-03T19:02:59.889775] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTW took 2.8s. Estimated remaining: 3h 27m 13s. Rate: 7.2 symbols/min [2025-11-03T19:03:00.206201] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:00.314278] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-11-03T19:03:00.349843] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:00.350776] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-11-03T19:03:00.354017] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:00.356775] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-11-03T19:03:00.356387] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-11-03T19:03:00.406361] [DEBUG] [LOCAL ] FUN: Loaded 52877 existing records from primary storage. [2025-11-03T19:03:00.406708] [INFO ] [MAIN ] FUN: Loaded 52877 existing records. [2025-11-03T19:03:00.582453] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:00.582694] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-11-03T19:03:00.582752] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-11-03T19:03:00.583485] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-11-03T19:03:00.583542] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-11-03T19:03:00.914446] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T19:03:00.922236] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-11-03T19:03:00.963984] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:00.964530] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-11-03T19:03:01.464507] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-11-03T19:03:01.466285] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-11-03T19:03:01.573684] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T19:03:01.580869] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-11-03T19:03:01.748961] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-11-03T19:03:02.008994] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T19:03:02.334855] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-11-03T19:03:02.561686] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-11-03T19:03:02.586584] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-11-03T19:03:02.774410] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:03:03.134877] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-11-03T19:03:03.934874] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-11-03T19:03:04.427294] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:03:04.734917] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-11-03T19:03:04.921244] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T19:03:05.534870] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-11-03T19:03:05.948311] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T19:03:06.334919] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-11-03T19:03:06.582967] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-11-03T19:03:07.134836] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-11-03T19:03:07.182093] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-11-03T19:03:07.582749] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-11-03T19:03:07.934911] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-11-03T19:03:08.215843] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-11-03T19:03:08.734844] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-11-03T19:03:09.534854] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-11-03T19:03:10.339973] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-11-03T19:03:10.364128] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-11-03T19:03:10.428481] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T19:03:10.667796] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T19:03:11.134909] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-11-03T19:03:11.461311] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-11-03T19:03:11.934928] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-11-03T19:03:12.734867] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-11-03T19:03:13.231997] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T19:03:13.534853] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-11-03T19:03:13.661147] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T19:03:14.334897] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-11-03T19:03:15.134845] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-11. [2025-11-03T19:03:15.180280] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T19:03:15.327621] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T19:03:15.549115] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-11 (0.41 seconds). [2025-11-03T19:03:15.550058] [INFO ] [REMOTE ] FTWO: Full fetch complete (3260 records). [2025-11-03T19:03:15.550131] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-11-03T19:03:15.930601] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-11-03T19:03:15.930717] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-11-03T19:03:15.930847] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-11-03T19:03:15.930888] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-11-03T19:03:15.931315] [DEBUG] [LOCAL ] FTWO: Trimmed 3260 records to 1952 (keeping 200 days of data) [2025-11-03T19:03:15.937981] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-11-03T19:03:15.944391] [DEBUG] [LOCAL ] FTWO: Primary data saved (1952 records). [2025-11-03T19:03:15.945486] [INFO ] [MAIN ] FTWO: Full history saved. [2025-11-03T19:03:15.945587] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FTWO took 18.8s. Estimated remaining: 3h 27m 18s. Rate: 7.2 symbols/min [2025-11-03T19:03:16.141284] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:16.160841] [DEBUG] [LOCAL ] FVR: Loaded 20674 existing records from primary storage. [2025-11-03T19:03:16.161093] [INFO ] [MAIN ] FVR: Loaded 20674 existing records. [2025-11-03T19:03:16.333252] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:16.333470] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-11-03T19:03:16.333517] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-11-03T19:03:16.333989] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-11-03T19:03:16.334045] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-11-03T19:03:16.678199] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:16.734896] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-11-03T19:03:17.421508] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-11-03T19:03:17.534871] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-11-03T19:03:17.773020] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-11-03T19:03:18.334899] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-11-03T19:03:18.454621] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T19:03:19.134870] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-11-03T19:03:19.874007] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T19:03:19.934816] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-11-03T19:03:19.992162] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-11-03T19:03:20.667823] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T19:03:20.734845] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-11-03T19:03:21.449464] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-11-03T19:03:21.534857] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-11-03T19:03:22.334863] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-11-03T19:03:22.634695] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:03:23.134918] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-11-03T19:03:23.934836] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-11-03T19:03:24.016074] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T19:03:24.101556] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T19:03:24.722381] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T19:03:24.734805] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-11-03T19:03:25.518103] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T19:03:25.534820] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-11-03T19:03:26.225598] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-11-03T19:03:26.334859] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-11-03T19:03:27.057242] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T19:03:27.134867] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-11-03T19:03:27.934865] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-11-03T19:03:28.648537] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T19:03:28.734835] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-11-03T19:03:28.839858] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-11-03T19:03:29.534888] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-11. [2025-11-03T19:03:30.064729] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:03:30.328991] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T19:03:30.330071] [INFO ] [REMOTE ] FUL: Full fetch complete (47841 records). [2025-11-03T19:03:30.330141] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-11-03T19:03:30.341726] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-11-03T19:03:30.715552] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-11-03T19:03:30.715633] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-11-03T19:03:30.716470] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-11-03T19:03:30.716533] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-11-03T19:03:30.717538] [DEBUG] [LOCAL ] FUL: Trimmed 47841 records to 31350 (keeping 200 days of data) [2025-11-03T19:03:30.902145] [DEBUG] [LOCAL ] FUL: Primary data saved (31350 records). [2025-11-03T19:03:30.902269] [INFO ] [MAIN ] FUL: Full history saved. [2025-11-03T19:03:30.902350] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FUL took 33.8s. Estimated remaining: 3h 27m 20s. Rate: 7.2 symbols/min [2025-11-03T19:03:31.072296] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:31.108137] [DEBUG] [LOCAL ] FVRR: Loaded 41100 existing records from primary storage. [2025-11-03T19:03:31.108423] [INFO ] [MAIN ] FVRR: Loaded 41100 existing records. [2025-11-03T19:03:31.140009] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-11-03T19:03:31.290198] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:31.290400] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-11-03T19:03:31.290448] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-11-03T19:03:31.291273] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-11-03T19:03:31.291329] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-11-03T19:03:31.653134] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:31.752853] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T19:03:31.934853] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-11-03T19:03:32.558002] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T19:03:32.720941] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T19:03:32.734813] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-11-03T19:03:33.534853] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-11. [2025-11-03T19:03:34.134731] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-11 (0.60 seconds). [2025-11-03T19:03:34.135828] [INFO ] [REMOTE ] FVR: Full fetch complete (29139 records). [2025-11-03T19:03:34.135905] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-11-03T19:03:34.339680] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-11-03T19:03:34.546609] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-11-03T19:03:34.546750] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-11-03T19:03:34.547495] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-11-03T19:03:34.547636] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-11-03T19:03:34.548747] [DEBUG] [LOCAL ] FVR: Trimmed 29139 records to 20320 (keeping 200 days of data) [2025-11-03T19:03:34.704593] [DEBUG] [LOCAL ] FVR: Primary data saved (20320 records). [2025-11-03T19:03:34.704875] [INFO ] [MAIN ] FVR: Full history saved. [2025-11-03T19:03:34.704985] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FVR took 18.8s. Estimated remaining: 3h 27m 4s. Rate: 7.2 symbols/min [2025-11-03T19:03:34.749481] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-11-03T19:03:34.886280] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:34.889207] [DEBUG] [LOCAL ] FXED: Loaded 1232 existing records from primary storage. [2025-11-03T19:03:34.889343] [INFO ] [MAIN ] FXED: Loaded 1232 existing records. [2025-11-03T19:03:35.066479] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:35.066725] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-11-03T19:03:35.066778] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-11-03T19:03:35.066944] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-11-03T19:03:35.067002] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-11-03T19:03:35.140090] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-11-03T19:03:35.442017] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:35.540531] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:03:35.934864] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-11-03T19:03:36.217020] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-11-03T19:03:36.368348] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T19:03:36.734934] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-11-03T19:03:37.534865] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-11-03T19:03:38.060717] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T19:03:38.334905] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-11-03T19:03:38.658447] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T19:03:39.134929] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-11-03T19:03:39.382125] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-11-03T19:03:39.717937] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T19:03:39.934882] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-11-03T19:03:40.174578] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-11-03T19:03:40.734908] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-11. [2025-11-03T19:03:41.534881] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-11-03T19:03:41.820324] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-11-03T19:03:42.236532] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-11 (1.50 seconds). [2025-11-03T19:03:42.238183] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-11-03T19:03:42.238353] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-11-03T19:03:42.340010] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-11-03T19:03:42.679973] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-11-03T19:03:42.680125] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-11-03T19:03:42.681102] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-11-03T19:03:42.681172] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-11-03T19:03:42.682730] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 53714 (keeping 200 days of data) [2025-11-03T19:03:43.003602] [DEBUG] [LOCAL ] FUBO: Primary data saved (53714 records). [2025-11-03T19:03:43.003791] [INFO ] [MAIN ] FUBO: Full history saved. [2025-11-03T19:03:43.003893] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUBO took 45.9s. Estimated remaining: 3h 26m 56s. Rate: 7.2 symbols/min [2025-11-03T19:03:43.140080] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-11-03T19:03:43.189893] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:43.237200] [DEBUG] [LOCAL ] G: Loaded 50779 existing records from primary storage. [2025-11-03T19:03:43.237663] [INFO ] [MAIN ] G: Loaded 50779 existing records. [2025-11-03T19:03:43.415091] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:43.415331] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-11-03T19:03:43.415380] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-11-03T19:03:43.416560] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-11-03T19:03:43.416619] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-11-03T19:03:43.800001] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:43.837487] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T19:03:43.934883] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-11-03T19:03:44.163514] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-11-03T19:03:44.614498] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T19:03:44.734887] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-11-03T19:03:45.534883] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-11-03T19:03:45.773675] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-11-03T19:03:45.992511] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T19:03:46.334872] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-11-03T19:03:47.134926] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-11-03T19:03:47.504348] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T19:03:47.934887] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-11-03T19:03:48.221823] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-11-03T19:03:48.565388] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T19:03:48.734859] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-11-03T19:03:49.026855] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-11-03T19:03:49.534944] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-11-03T19:03:50.334893] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-11-03T19:03:50.596204] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T19:03:51.134908] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-11-03T19:03:51.656223] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T19:03:51.934885] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-11-03T19:03:52.235956] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-11-03T19:03:52.279474] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T19:03:52.734942] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-11-03T19:03:53.015542] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.28 seconds). [2025-11-03T19:03:53.534921] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-11. [2025-11-03T19:03:53.854610] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-11 (0.32 seconds). [2025-11-03T19:03:53.855245] [INFO ] [REMOTE ] FXED: Full fetch complete (1774 records). [2025-11-03T19:03:53.855311] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-11-03T19:03:54.201806] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-11-03T19:03:54.201884] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-11-03T19:03:54.201968] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-11-03T19:03:54.202005] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-11-03T19:03:54.202307] [DEBUG] [LOCAL ] FXED: Trimmed 1774 records to 1205 (keeping 200 days of data) [2025-11-03T19:03:54.209955] [DEBUG] [LOCAL ] FXED: Primary data saved (1205 records). [2025-11-03T19:03:54.210012] [INFO ] [MAIN ] FXED: Full history saved. [2025-11-03T19:03:54.210074] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FXED took 19.5s. Estimated remaining: 3h 26m 52s. Rate: 7.2 symbols/min [2025-11-03T19:03:54.339996] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-11. [2025-11-03T19:03:54.382792] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:54.406370] [DEBUG] [LOCAL ] GAB: Loaded 27147 existing records from primary storage. [2025-11-03T19:03:54.406605] [INFO ] [MAIN ] GAB: Loaded 27147 existing records. [2025-11-03T19:03:54.590347] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:54.590587] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-11-03T19:03:54.590681] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-11-03T19:03:54.591697] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-11-03T19:03:54.591758] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-11-03T19:03:54.939036] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:55.134841] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-11-03T19:03:55.533733] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T19:03:55.535242] [INFO ] [REMOTE ] FUN: Full fetch complete (73939 records). [2025-11-03T19:03:55.535373] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-11-03T19:03:55.929462] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-11-03T19:03:55.929627] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-11-03T19:03:55.930722] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-11-03T19:03:55.930904] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-11-03T19:03:55.932311] [DEBUG] [LOCAL ] FUN: Trimmed 73939 records to 52256 (keeping 200 days of data) [2025-11-03T19:03:55.979387] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-11-03T19:03:56.046375] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T19:03:56.252631] [DEBUG] [LOCAL ] FUN: Primary data saved (52256 records). [2025-11-03T19:03:56.252789] [INFO ] [MAIN ] FUN: Full history saved. [2025-11-03T19:03:56.252870] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FUN took 56.3s. Estimated remaining: 3h 26m 33s. Rate: 7.2 symbols/min [2025-11-03T19:03:56.417732] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:03:56.422617] [DEBUG] [LOCAL ] GAM: Loaded 3740 existing records from primary storage. [2025-11-03T19:03:56.422811] [INFO ] [MAIN ] GAM: Loaded 3740 existing records. [2025-11-03T19:03:56.601144] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:03:56.601396] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-11-03T19:03:56.601456] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-11-03T19:03:56.601702] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-11-03T19:03:56.601759] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-11-03T19:03:56.743809] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-11-03T19:03:56.965018] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:03:57.159566] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T19:03:57.500933] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T19:03:57.534841] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-11-03T19:03:57.934852] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-11-03T19:03:58.334925] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-11-03T19:03:59.134866] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-11-03T19:03:59.597220] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T19:03:59.911128] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-11-03T19:03:59.934815] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-11-03T19:04:00.734869] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-11-03T19:04:01.168534] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T19:04:01.534886] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-11-03T19:04:02.154724] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-11-03T19:04:02.334844] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-11-03T19:04:02.516416] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:04:03.134860] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-11-03T19:04:03.247754] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T19:04:03.545582] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T19:04:03.934924] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-11-03T19:04:04.734885] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-11-03T19:04:05.213343] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-11-03T19:04:05.333243] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T19:04:05.534857] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-11-03T19:04:06.334892] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-11-03T19:04:06.728849] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-11-03T19:04:07.140610] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-11-03T19:04:07.152089] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T19:04:07.934874] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-11-03T19:04:08.293631] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T19:04:08.734869] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-11-03T19:04:09.192903] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T19:04:09.348807] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T19:04:09.534884] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-11-03T19:04:09.904837] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T19:04:10.334858] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-11-03T19:04:11.134882] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-11-03T19:04:11.535603] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T19:04:11.934937] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-11-03T19:04:12.258223] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T19:04:12.295237] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T19:04:12.734938] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-11-03T19:04:13.154276] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-11-03T19:04:13.534899] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-11-03T19:04:14.334933] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-11-03T19:04:14.785259] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T19:04:14.788955] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-11-03T19:04:15.134901] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-11. [2025-11-03T19:04:15.934874] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-11-03T19:04:16.267565] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T19:04:16.269102] [INFO ] [REMOTE ] FVRR: Full fetch complete (59344 records). [2025-11-03T19:04:16.269208] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-11-03T19:04:16.386101] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-11-03T19:04:16.679038] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-11-03T19:04:16.679118] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-11-03T19:04:16.679930] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-11-03T19:04:16.679993] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-11-03T19:04:16.681102] [DEBUG] [LOCAL ] FVRR: Trimmed 59344 records to 40654 (keeping 200 days of data) [2025-11-03T19:04:16.738400] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-11-03T19:04:16.920778] [DEBUG] [LOCAL ] FVRR: Primary data saved (40654 records). [2025-11-03T19:04:16.920931] [INFO ] [MAIN ] FVRR: Full history saved. [2025-11-03T19:04:16.921892] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVRR took 46.0s. Estimated remaining: 3h 26m 45s. Rate: 7.1 symbols/min [2025-11-03T19:04:17.109366] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:04:17.176123] [DEBUG] [LOCAL ] GAP: Loaded 54433 existing records from primary storage. [2025-11-03T19:04:17.176533] [INFO ] [MAIN ] GAP: Loaded 54433 existing records. [2025-11-03T19:04:17.369202] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:04:17.369422] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-11-03T19:04:17.369472] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-11-03T19:04:17.370377] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-11-03T19:04:17.370438] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-11-03T19:04:17.536826] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-11-03T19:04:17.754062] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:04:17.770774] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:04:17.958906] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T19:04:18.334853] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-11-03T19:04:19.134912] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-11-03T19:04:19.611791] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T19:04:19.923001] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T19:04:19.934811] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-11-03T19:04:20.734855] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-11-03T19:04:20.884368] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-11-03T19:04:21.534873] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-11-03T19:04:22.078076] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-11-03T19:04:22.334863] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-11. [2025-11-03T19:04:22.755093] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-11 (0.42 seconds). [2025-11-03T19:04:22.755775] [INFO ] [REMOTE ] GAM: Full fetch complete (6397 records). [2025-11-03T19:04:22.755841] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-11-03T19:04:23.155984] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-11-03T19:04:23.156144] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-11-03T19:04:23.155727] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-11-03T19:04:23.160525] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-11-03T19:04:23.160877] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-11-03T19:04:23.163330] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-11-03T19:04:23.175169] [DEBUG] [LOCAL ] GAM: Trimmed 6397 records to 3697 (keeping 200 days of data) [2025-11-03T19:04:23.199115] [DEBUG] [LOCAL ] GAM: Primary data saved (3697 records). [2025-11-03T19:04:23.199216] [INFO ] [MAIN ] GAM: Full history saved. [2025-11-03T19:04:23.199296] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. GAM took 26.9s. Estimated remaining: 3h 26m 33s. Rate: 7.2 symbols/min [2025-11-03T19:04:23.376978] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:04:23.395428] [DEBUG] [LOCAL ] GATX: Loaded 17958 existing records from primary storage. [2025-11-03T19:04:23.395712] [INFO ] [MAIN ] GATX: Loaded 17958 existing records. [2025-11-03T19:04:23.578507] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:04:23.578807] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-11-03T19:04:23.578864] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-11-03T19:04:23.579332] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-11-03T19:04:23.579391] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-11-03T19:04:23.947057] [INFO ] [REMOTE ] G: Fetching primary data for 2025-11. [2025-11-03T19:04:23.953829] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:04:23.970680] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T19:04:24.734826] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-11-03T19:04:24.933284] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:04:24.934829] [INFO ] [REMOTE ] G: Full fetch complete (72509 records). [2025-11-03T19:04:24.934917] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-11-03T19:04:25.348868] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-11-03T19:04:25.348963] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-11-03T19:04:25.349966] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-11-03T19:04:25.350036] [DEBUG] [LOCAL ] G: Saving primary data. [2025-11-03T19:04:25.351561] [DEBUG] [LOCAL ] G: Trimmed 72509 records to 50130 (keeping 200 days of data) [2025-11-03T19:04:25.560570] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-11. [2025-11-03T19:04:25.662036] [DEBUG] [LOCAL ] G: Primary data saved (50130 records). [2025-11-03T19:04:25.662193] [INFO ] [MAIN ] G: Full history saved. [2025-11-03T19:04:25.662288] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. G took 42.7s. Estimated remaining: 3h 26m 15s. Rate: 7.2 symbols/min [2025-11-03T19:04:25.849741] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:04:25.862294] [DEBUG] [LOCAL ] GBAB: Loaded 12389 existing records from primary storage. [2025-11-03T19:04:25.862553] [INFO ] [MAIN ] GBAB: Loaded 12389 existing records. [2025-11-03T19:04:26.062949] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:04:26.063250] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-11-03T19:04:26.063324] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-11-03T19:04:26.063725] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-11-03T19:04:26.063784] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-11-03T19:04:26.306189] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-11 (0.75 seconds). [2025-11-03T19:04:26.355423] [INFO ] [REMOTE ] GAB: Full fetch complete (39230 records). [2025-11-03T19:04:26.367789] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-11-03T19:04:26.342577] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-11-03T19:04:26.538258] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:04:26.678977] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-11-03T19:04:26.909158] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-11-03T19:04:26.909238] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-11-03T19:04:26.909858] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-11-03T19:04:26.909918] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-11-03T19:04:26.910755] [DEBUG] [LOCAL ] GAB: Trimmed 39230 records to 26588 (keeping 200 days of data) [2025-11-03T19:04:27.059627] [DEBUG] [LOCAL ] GAB: Primary data saved (26588 records). [2025-11-03T19:04:27.059767] [INFO ] [MAIN ] GAB: Full history saved. [2025-11-03T19:04:27.059845] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. GAB took 32.8s. Estimated remaining: 3h 25m 55s. Rate: 7.2 symbols/min [2025-11-03T19:04:27.140020] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-11-03T19:04:27.182938] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T19:04:27.243938] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:04:27.279024] [DEBUG] [LOCAL ] GBCI: Loaded 41725 existing records from primary storage. [2025-11-03T19:04:27.279353] [INFO ] [MAIN ] GBCI: Loaded 41725 existing records. [2025-11-03T19:04:27.454063] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:04:27.454275] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-11-03T19:04:27.454329] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-11-03T19:04:27.455046] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-11-03T19:04:27.455102] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-11-03T19:04:27.810659] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:04:27.884301] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T19:04:27.934811] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-11-03T19:04:28.734864] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-11-03T19:04:28.945826] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T19:04:29.343219] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T19:04:29.534926] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-11-03T19:04:30.116694] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T19:04:30.334916] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-11-03T19:04:31.134878] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-11-03T19:04:31.776386] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T19:04:31.891026] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T19:04:31.934871] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-11-03T19:04:32.734903] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-11-03T19:04:33.447997] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T19:04:33.468723] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-11-03T19:04:33.534863] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-11-03T19:04:34.191393] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T19:04:34.334900] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-11-03T19:04:35.134921] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-11-03T19:04:35.730307] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T19:04:35.934885] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-11-03T19:04:35.955266] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-11-03T19:04:36.734848] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-11-03T19:04:37.448779] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T19:04:37.534842] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-11-03T19:04:37.819588] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T19:04:38.334871] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-11-03T19:04:38.867358] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T19:04:39.081569] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-11-03T19:04:39.134819] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-11-03T19:04:39.934893] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-11-03T19:04:40.640129] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T19:04:40.662060] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-11-03T19:04:40.734878] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-11-03T19:04:41.362605] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-11-03T19:04:41.534870] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-11-03T19:04:42.334878] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-11-03T19:04:42.648539] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T19:04:43.134885] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-11-03T19:04:43.711090] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T19:04:43.934887] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-11. [2025-11-03T19:04:44.264245] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T19:04:44.734851] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-11-03T19:04:45.008490] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-11 (1.07 seconds). [2025-11-03T19:04:45.010029] [INFO ] [REMOTE ] GAP: Full fetch complete (77817 records). [2025-11-03T19:04:45.010147] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-11-03T19:04:45.461949] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-11-03T19:04:45.462061] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-11-03T19:04:45.463064] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-11-03T19:04:45.463131] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-11-03T19:04:45.464680] [DEBUG] [LOCAL ] GAP: Trimmed 77817 records to 53653 (keeping 200 days of data) [2025-11-03T19:04:45.555293] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-11-03T19:04:45.788242] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T19:04:45.816615] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-11-03T19:04:45.816876] [INFO ] [MAIN ] GAP: Full history saved. [2025-11-03T19:04:45.817784] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GAP took 28.9s. Estimated remaining: 3h 26m 4s. Rate: 7.2 symbols/min [2025-11-03T19:04:45.988773] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:04:45.988944] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-11-03T19:04:45.988991] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-11-03T19:04:45.989099] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-11-03T19:04:45.989141] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-11-03T19:04:45.989183] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-11-03T19:04:45.989215] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-11-03T19:04:46.335785] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-11-03T19:04:46.337871] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:04:46.634782] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T19:04:46.791812] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-11-03T19:04:47.134975] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-11-03T19:04:47.395118] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-11-03T19:04:47.934938] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-11-03T19:04:48.120290] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-11-03T19:04:48.734891] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-11-03T19:04:49.446278] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:04:49.534860] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-11-03T19:04:50.275028] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-11-03T19:04:50.334854] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-11-03T19:04:51.113336] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-11-03T19:04:51.134932] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-11-03T19:04:51.668020] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-11-03T19:04:51.934852] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-10. [2025-11-03T19:04:52.519505] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-11-03T19:04:52.734876] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-11-03T19:04:53.534911] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-11-03T19:04:53.871153] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T19:04:54.334924] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-11-03T19:04:54.454557] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T19:04:55.134863] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-11. [2025-11-03T19:04:55.541989] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T19:04:55.748283] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-11 (0.61 seconds). [2025-11-03T19:04:55.749613] [INFO ] [REMOTE ] GBAB: Full fetch complete (18516 records). [2025-11-03T19:04:55.749771] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-11-03T19:04:55.939249] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-11-03T19:04:56.140387] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-11-03T19:04:56.140519] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-11-03T19:04:56.141134] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-11-03T19:04:56.141202] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-11-03T19:04:56.142269] [DEBUG] [LOCAL ] GBAB: Trimmed 18516 records to 12279 (keeping 200 days of data) [2025-11-03T19:04:56.223204] [DEBUG] [LOCAL ] GBAB: Primary data saved (12279 records). [2025-11-03T19:04:56.223405] [INFO ] [MAIN ] GBAB: Full history saved. [2025-11-03T19:04:56.223510] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. GBAB took 30.6s. Estimated remaining: 3h 25m 59s. Rate: 7.2 symbols/min [2025-11-03T19:04:56.408333] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:04:56.445921] [DEBUG] [LOCAL ] GBTG: Loaded 40376 existing records from primary storage. [2025-11-03T19:04:56.446342] [INFO ] [MAIN ] GBTG: Loaded 40376 existing records. [2025-11-03T19:04:56.630320] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:04:56.630633] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-11-03T19:04:56.630725] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-11-03T19:04:56.631604] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-11-03T19:04:56.631717] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-11-03T19:04:56.736307] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-11-03T19:04:57.021319] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:04:57.063934] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-11-03T19:04:57.100840] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T19:04:57.534917] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-11-03T19:04:57.822271] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-11-03T19:04:58.334908] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-11-03T19:04:59.054617] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-11-03T19:04:59.134840] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-11. [2025-11-03T19:04:59.934833] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-11-03T19:04:59.960839] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-11 (0.83 seconds). [2025-11-03T19:04:59.962002] [INFO ] [REMOTE ] GATX: Full fetch complete (25181 records). [2025-11-03T19:04:59.962076] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-11-03T19:05:00.349722] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-11-03T19:05:00.349838] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-11-03T19:05:00.350793] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-11-03T19:05:00.350866] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-11-03T19:05:00.351795] [DEBUG] [LOCAL ] GATX: Trimmed 25181 records to 17634 (keeping 200 days of data) [2025-11-03T19:05:00.463920] [DEBUG] [LOCAL ] GATX: Primary data saved (17634 records). [2025-11-03T19:05:00.464057] [INFO ] [MAIN ] GATX: Full history saved. [2025-11-03T19:05:00.464133] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GATX took 37.3s. Estimated remaining: 3h 25m 44s. Rate: 7.2 symbols/min [2025-11-03T19:05:00.630288] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:00.655050] [DEBUG] [LOCAL ] GBX: Loaded 28154 existing records from primary storage. [2025-11-03T19:05:00.655297] [INFO ] [MAIN ] GBX: Loaded 28154 existing records. [2025-11-03T19:05:00.744316] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-11-03T19:05:00.833243] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:00.833430] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-11-03T19:05:00.833483] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-11-03T19:05:00.834055] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-11-03T19:05:00.834113] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-11-03T19:05:01.198180] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:01.332962] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T19:05:01.407369] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-11-03T19:05:01.534891] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-11-03T19:05:02.334873] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-11-03T19:05:03.134924] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-11-03T19:05:03.196808] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-11-03T19:05:03.310505] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T19:05:03.349726] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-11-03T19:05:03.934876] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-11-03T19:05:04.177041] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-11-03T19:05:04.734903] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-11-03T19:05:05.048095] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-11-03T19:05:05.534863] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-11-03T19:05:06.334874] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-11. [2025-11-03T19:05:06.484332] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T19:05:07.134883] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-11-03T19:05:07.304193] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T19:05:07.305619] [INFO ] [REMOTE ] GBCI: Full fetch complete (59528 records). [2025-11-03T19:05:07.305794] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-11-03T19:05:07.717767] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-11-03T19:05:07.717852] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-11-03T19:05:07.718707] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-11-03T19:05:07.718770] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-11-03T19:05:07.719950] [DEBUG] [LOCAL ] GBCI: Trimmed 59528 records to 41260 (keeping 200 days of data) [2025-11-03T19:05:07.935707] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-11-03T19:05:07.968977] [DEBUG] [LOCAL ] GBCI: Primary data saved (41260 records). [2025-11-03T19:05:07.969109] [INFO ] [MAIN ] GBCI: Full history saved. [2025-11-03T19:05:07.969193] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GBCI took 40.9s. Estimated remaining: 3h 25m 34s. Rate: 7.2 symbols/min [2025-11-03T19:05:08.141763] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:08.162460] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T19:05:08.206607] [DEBUG] [LOCAL ] GCI: Loaded 44280 existing records from primary storage. [2025-11-03T19:05:08.207000] [INFO ] [MAIN ] GCI: Loaded 44280 existing records. [2025-11-03T19:05:08.409905] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:08.410173] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-11-03T19:05:08.410248] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-11-03T19:05:08.411035] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-11-03T19:05:08.411096] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-11-03T19:05:08.737970] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-11-03T19:05:08.795578] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:08.889805] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T19:05:09.024019] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-11-03T19:05:09.534879] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-11-03T19:05:10.334878] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-11-03T19:05:10.682928] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-11-03T19:05:11.134962] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-11-03T19:05:11.253091] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T19:05:11.934885] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-11-03T19:05:12.187167] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T19:05:12.734867] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-11-03T19:05:13.070178] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T19:05:13.534865] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-11-03T19:05:13.807991] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T19:05:14.334876] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-11-03T19:05:14.462100] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T19:05:15.134910] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-11-03T19:05:15.403044] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-11-03T19:05:15.437949] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:05:15.934873] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-11-03T19:05:16.655368] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T19:05:16.734832] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-11-03T19:05:17.534876] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-11-03T19:05:17.853528] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-11-03T19:05:18.334849] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-11. [2025-11-03T19:05:18.601473] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T19:05:18.707124] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-11 (0.37 seconds). [2025-11-03T19:05:18.707976] [INFO ] [REMOTE ] GBLI: Full fetch complete (1255 records). [2025-11-03T19:05:18.708059] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-11-03T19:05:18.911888] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-11-03T19:05:18.912196] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:05:18.912288] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:05:18.912375] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-11-03T19:05:18.912453] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-11-03T19:05:18.912492] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-11-03T19:05:18.912536] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-11-03T19:05:18.912605] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GBLI took 33.1s. Estimated remaining: 3h 25m 30s. Rate: 7.2 symbols/min [2025-11-03T19:05:19.118570] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:19.134853] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-11-03T19:05:19.147028] [DEBUG] [LOCAL ] GCO: Loaded 21932 existing records from primary storage. [2025-11-03T19:05:19.147437] [INFO ] [MAIN ] GCO: Loaded 21932 existing records. [2025-11-03T19:05:19.341231] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:19.341529] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-11-03T19:05:19.341585] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-11-03T19:05:19.342224] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-11-03T19:05:19.342288] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-11-03T19:05:19.762019] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:19.934860] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-11-03T19:05:20.343351] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:05:20.734881] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-11-03T19:05:20.753443] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-11-03T19:05:21.534939] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-11-03T19:05:21.793101] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T19:05:22.313469] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-11-03T19:05:22.334809] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-11-03T19:05:23.086084] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T19:05:23.134869] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-11-03T19:05:23.934921] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-11-03T19:05:24.001277] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T19:05:24.734913] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-11-03T19:05:25.025142] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T19:05:25.534935] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-11-03T19:05:25.951134] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T19:05:26.334907] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-11-03T19:05:26.515168] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T19:05:27.134821] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-11-03T19:05:27.339177] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T19:05:27.934945] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-11. [2025-11-03T19:05:28.306847] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T19:05:28.734848] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-11-03T19:05:28.755045] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T19:05:28.756255] [INFO ] [REMOTE ] GBX: Full fetch complete (42775 records). [2025-11-03T19:05:28.756336] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-11-03T19:05:29.128372] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-11-03T19:05:29.128449] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-11-03T19:05:29.129107] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-11-03T19:05:29.129167] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-11-03T19:05:29.130030] [DEBUG] [LOCAL ] GBX: Trimmed 42775 records to 27463 (keeping 200 days of data) [2025-11-03T19:05:29.285333] [DEBUG] [LOCAL ] GBX: Primary data saved (27463 records). [2025-11-03T19:05:29.285451] [INFO ] [MAIN ] GBX: Full history saved. [2025-11-03T19:05:29.285524] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBX took 28.8s. Estimated remaining: 3h 25m 24s. Rate: 7.2 symbols/min [2025-11-03T19:05:29.453492] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:29.472421] [DEBUG] [LOCAL ] GCTS: Loaded 20490 existing records from primary storage. [2025-11-03T19:05:29.472734] [INFO ] [MAIN ] GCTS: Loaded 20490 existing records. [2025-11-03T19:05:29.540171] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-11-03T19:05:29.665285] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:29.665495] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-11-03T19:05:29.665544] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-11-03T19:05:29.666061] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-11-03T19:05:29.666121] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-11-03T19:05:30.042088] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:30.067792] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:05:30.334858] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-11-03T19:05:30.639045] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T19:05:30.997122] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-11-03T19:05:31.134871] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-11-03T19:05:31.938068] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-11-03T19:05:31.941454] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-11-03T19:05:32.734896] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-11-03T19:05:33.131669] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-11-03T19:05:33.406419] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T19:05:33.534905] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-11-03T19:05:34.334852] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-11-03T19:05:34.554301] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T19:05:34.965583] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-11-03T19:05:35.134849] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-11-03T19:05:35.784922] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-11-03T19:05:35.934848] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-11-03T19:05:36.734843] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-11-03T19:05:36.837119] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-11-03T19:05:37.534896] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-11-03T19:05:38.015387] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T19:05:38.334941] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-11-03T19:05:38.626493] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T19:05:39.134885] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-11-03T19:05:39.501257] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T19:05:39.934884] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-11-03T19:05:40.153733] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T19:05:40.734840] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-11-03T19:05:40.799818] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:05:41.537382] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-11-03T19:05:41.545440] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T19:05:42.334863] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-11-03T19:05:42.680269] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T19:05:43.060443] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T19:05:43.134857] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-11-03T19:05:43.843764] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T19:05:43.934864] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-11-03T19:05:44.597992] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T19:05:44.734873] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-11-03T19:05:45.534906] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-11-03T19:05:45.951358] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T19:05:46.334826] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-11-03T19:05:46.398288] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T19:05:47.122843] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T19:05:47.134815] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-11. [2025-11-03T19:05:47.934892] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-11. [2025-11-03T19:05:48.076372] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T19:05:48.078109] [INFO ] [REMOTE ] GBTG: Full fetch complete (56931 records). [2025-11-03T19:05:48.078228] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-11-03T19:05:48.488274] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-11-03T19:05:48.488398] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-11-03T19:05:48.489815] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-11-03T19:05:48.489894] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-11-03T19:05:48.491593] [DEBUG] [LOCAL ] GBTG: Trimmed 56931 records to 39763 (keeping 200 days of data) [2025-11-03T19:05:48.729754] [DEBUG] [LOCAL ] GBTG: Primary data saved (39763 records). [2025-11-03T19:05:48.729956] [INFO ] [MAIN ] GBTG: Full history saved. [2025-11-03T19:05:48.730056] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBTG took 52.5s. Estimated remaining: 3h 25m 34s. Rate: 7.1 symbols/min [2025-11-03T19:05:48.735596] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-11-03T19:05:48.924266] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:48.934257] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-11 (1.00 seconds). [2025-11-03T19:05:48.940206] [DEBUG] [LOCAL ] GCV: Loaded 8074 existing records from primary storage. [2025-11-03T19:05:48.940493] [INFO ] [MAIN ] GCV: Loaded 8074 existing records. [2025-11-03T19:05:48.939900] [INFO ] [REMOTE ] GCI: Full fetch complete (63586 records). [2025-11-03T19:05:48.945864] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-11-03T19:05:49.384311] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:49.405423] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-11-03T19:05:49.433581] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-11-03T19:05:49.457308] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-11-03T19:05:49.457476] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-11-03T19:05:49.539023] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-11-03T19:05:49.745831] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-11-03T19:05:49.772053] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-11-03T19:05:49.815555] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-11-03T19:05:49.822874] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-11-03T19:05:49.870511] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-11-03T19:05:49.903061] [DEBUG] [LOCAL ] GCI: Trimmed 63586 records to 43651 (keeping 200 days of data) [2025-11-03T19:05:50.062892] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:50.223248] [DEBUG] [LOCAL ] GCI: Primary data saved (43651 records). [2025-11-03T19:05:50.223404] [INFO ] [MAIN ] GCI: Full history saved. [2025-11-03T19:05:50.224138] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GCI took 42.3s. Estimated remaining: 3h 25m 14s. Rate: 7.1 symbols/min [2025-11-03T19:05:50.337041] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-11-03T19:05:50.349917] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T19:05:50.417138] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:50.460560] [DEBUG] [LOCAL ] GD: Loaded 46959 existing records from primary storage. [2025-11-03T19:05:50.460882] [INFO ] [MAIN ] GD: Loaded 46959 existing records. [2025-11-03T19:05:50.647539] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:50.647817] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-11-03T19:05:50.647865] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-11-03T19:05:50.648848] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-11-03T19:05:50.648907] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-11-03T19:05:50.836720] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-11-03T19:05:51.024025] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:51.134876] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-11-03T19:05:51.531005] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T19:05:51.934859] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-11-03T19:05:52.734970] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-11-03T19:05:53.180064] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T19:05:53.300891] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T19:05:53.534843] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-11-03T19:05:54.334862] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-11-03T19:05:54.769280] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T19:05:54.833010] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T19:05:55.134931] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-11-03T19:05:55.573239] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T19:05:55.934904] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-11-03T19:05:56.374029] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-11-03T19:05:56.734860] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-11. [2025-11-03T19:05:57.356573] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T19:05:57.357504] [INFO ] [REMOTE ] GCTS: Full fetch complete (26870 records). [2025-11-03T19:05:57.357576] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-11-03T19:05:57.540348] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-11. [2025-11-03T19:05:57.723695] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-11-03T19:05:57.723777] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-11-03T19:05:57.724290] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-11-03T19:05:57.724329] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-11-03T19:05:57.725000] [DEBUG] [LOCAL ] GCTS: Trimmed 26870 records to 20298 (keeping 200 days of data) [2025-11-03T19:05:57.834304] [DEBUG] [LOCAL ] GCTS: Primary data saved (20298 records). [2025-11-03T19:05:57.834420] [INFO ] [MAIN ] GCTS: Full history saved. [2025-11-03T19:05:57.834499] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GCTS took 28.5s. Estimated remaining: 3h 25m 5s. Rate: 7.1 symbols/min [2025-11-03T19:05:58.007184] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:58.049809] [DEBUG] [LOCAL ] GDDY: Loaded 50122 existing records from primary storage. [2025-11-03T19:05:58.050109] [INFO ] [MAIN ] GDDY: Loaded 50122 existing records. [2025-11-03T19:05:58.224962] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:58.227288] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-11-03T19:05:58.227219] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-11 (0.69 seconds). [2025-11-03T19:05:58.227444] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-11-03T19:05:58.228446] [INFO ] [REMOTE ] GCO: Full fetch complete (34128 records). [2025-11-03T19:05:58.228523] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-11-03T19:05:58.262191] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-11-03T19:05:58.298502] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-11-03T19:05:58.341812] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-11-03T19:05:58.934096] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-11-03T19:05:58.992750] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-11-03T19:05:58.998180] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-11-03T19:05:58.997213] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:58.998512] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-11-03T19:05:58.992573] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T19:05:59.002862] [DEBUG] [LOCAL ] GCO: Trimmed 34128 records to 21336 (keeping 200 days of data) [2025-11-03T19:05:59.121278] [DEBUG] [LOCAL ] GCO: Primary data saved (21336 records). [2025-11-03T19:05:59.121397] [INFO ] [MAIN ] GCO: Full history saved. [2025-11-03T19:05:59.121471] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GCO took 40.2s. Estimated remaining: 3h 24m 45s. Rate: 7.2 symbols/min [2025-11-03T19:05:59.150456] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-11-03T19:05:59.290253] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:05:59.295025] [DEBUG] [LOCAL ] GDIV: Loaded 3436 existing records from primary storage. [2025-11-03T19:05:59.295198] [INFO ] [MAIN ] GDIV: Loaded 3436 existing records. [2025-11-03T19:05:59.471106] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:05:59.471296] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-11-03T19:05:59.471343] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-11-03T19:05:59.471555] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-11-03T19:05:59.471613] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-11-03T19:05:59.792428] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-11-03T19:05:59.849016] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:05:59.934907] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-11-03T19:06:00.294115] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-11-03T19:06:00.734872] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-11-03T19:06:01.534941] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-11-03T19:06:02.334875] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-11-03T19:06:02.760240] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T19:06:02.775103] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T19:06:02.812397] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-11-03T19:06:03.134874] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-11-03T19:06:03.522730] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-11-03T19:06:03.934891] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-11-03T19:06:04.316953] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T19:06:04.734855] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-11-03T19:06:05.534917] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-11-03T19:06:05.916727] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-11-03T19:06:06.164701] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T19:06:06.334856] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-11-03T19:06:07.134861] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-11-03T19:06:07.639775] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-11-03T19:06:07.680629] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-11-03T19:06:07.934886] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-11-03T19:06:08.458325] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-11-03T19:06:08.734847] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-11. [2025-11-03T19:06:09.187881] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-11 (0.45 seconds). [2025-11-03T19:06:09.188800] [INFO ] [REMOTE ] GCV: Full fetch complete (10351 records). [2025-11-03T19:06:09.188873] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-11-03T19:06:09.540527] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-11-03T19:06:09.590854] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-11-03T19:06:09.591000] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-11-03T19:06:09.591528] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-11-03T19:06:09.591772] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-11-03T19:06:09.592936] [DEBUG] [LOCAL ] GCV: Trimmed 10351 records to 7878 (keeping 200 days of data) [2025-11-03T19:06:09.652232] [DEBUG] [LOCAL ] GCV: Primary data saved (7878 records). [2025-11-03T19:06:09.652417] [INFO ] [MAIN ] GCV: Full history saved. [2025-11-03T19:06:09.652541] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCV took 20.9s. Estimated remaining: 3h 24m 40s. Rate: 7.2 symbols/min [2025-11-03T19:06:09.848452] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:06:09.852832] [DEBUG] [LOCAL ] GDL: Loaded 2544 existing records from primary storage. [2025-11-03T19:06:09.853030] [INFO ] [MAIN ] GDL: Loaded 2544 existing records. [2025-11-03T19:06:10.031743] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:06:10.032001] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-11-03T19:06:10.032048] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-11-03T19:06:10.032274] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-11-03T19:06:10.032331] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-11-03T19:06:10.340046] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-11-03T19:06:10.393461] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:06:10.731341] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T19:06:10.791090] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T19:06:11.134869] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-11-03T19:06:11.934888] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-11-03T19:06:12.279031] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-11-03T19:06:12.349453] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T19:06:12.734852] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-11-03T19:06:13.534830] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-11-03T19:06:13.874807] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-11-03T19:06:14.047528] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T19:06:14.334854] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-11-03T19:06:14.642757] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-11-03T19:06:15.134852] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-11-03T19:06:15.934861] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-11-03T19:06:16.337745] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T19:06:16.378291] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T19:06:16.734847] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-11-03T19:06:17.534851] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-11-03T19:06:17.880525] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T19:06:17.993515] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:06:18.334884] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-11-03T19:06:18.693174] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-11-03T19:06:19.134871] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-11-03T19:06:19.456725] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-11-03T19:06:19.934879] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-11-03T19:06:20.221678] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:06:20.734881] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-11-03T19:06:21.054848] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-11-03T19:06:21.534853] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-11-03T19:06:21.862360] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-11-03T19:06:22.334858] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-11-03T19:06:22.719593] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-11-03T19:06:23.134881] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-11-03T19:06:23.480619] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-11-03T19:06:23.934860] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-11-03T19:06:24.734862] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-11-03T19:06:25.099859] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T19:06:25.227402] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:06:25.534933] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-11-03T19:06:26.334863] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-11-03T19:06:27.073535] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T19:06:27.134827] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-11. [2025-11-03T19:06:27.571480] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T19:06:27.934867] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-11-03T19:06:28.296491] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T19:06:28.301876] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T19:06:28.303202] [INFO ] [REMOTE ] GD: Full fetch complete (69488 records). [2025-11-03T19:06:28.303293] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-11-03T19:06:28.729892] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-11-03T19:06:28.730003] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-11-03T19:06:28.731148] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-11-03T19:06:28.731217] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-11-03T19:06:28.732623] [DEBUG] [LOCAL ] GD: Trimmed 69488 records to 46225 (keeping 200 days of data) [2025-11-03T19:06:28.734876] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-11-03T19:06:29.024299] [DEBUG] [LOCAL ] GD: Primary data saved (46225 records). [2025-11-03T19:06:29.024423] [INFO ] [MAIN ] GD: Full history saved. [2025-11-03T19:06:29.024501] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GD took 38.8s. Estimated remaining: 3h 24m 49s. Rate: 7.1 symbols/min [2025-11-03T19:06:29.195352] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:06:29.202845] [DEBUG] [LOCAL ] GDO: Loaded 5846 existing records from primary storage. [2025-11-03T19:06:29.203050] [INFO ] [MAIN ] GDO: Loaded 5846 existing records. [2025-11-03T19:06:29.386943] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:06:29.387150] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-11-03T19:06:29.387201] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-11-03T19:06:29.387456] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-11-03T19:06:29.387516] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-11-03T19:06:29.539952] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-11. [2025-11-03T19:06:29.754246] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:06:30.027061] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-11 (0.49 seconds). [2025-11-03T19:06:30.027934] [INFO ] [REMOTE ] GDL: Full fetch complete (3463 records). [2025-11-03T19:06:30.028059] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-11-03T19:06:30.232459] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T19:06:30.339913] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-11. [2025-11-03T19:06:30.429989] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-11-03T19:06:30.430061] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-11-03T19:06:30.430181] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-11-03T19:06:30.430220] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-11-03T19:06:30.430557] [DEBUG] [LOCAL ] GDL: Trimmed 3463 records to 2339 (keeping 200 days of data) [2025-11-03T19:06:30.444425] [DEBUG] [LOCAL ] GDL: Primary data saved (2339 records). [2025-11-03T19:06:30.444527] [INFO ] [MAIN ] GDL: Full history saved. [2025-11-03T19:06:30.444600] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GDL took 20.8s. Estimated remaining: 3h 24m 30s. Rate: 7.1 symbols/min [2025-11-03T19:06:30.615238] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:06:30.648423] [DEBUG] [LOCAL ] GDOT: Loaded 37727 existing records from primary storage. [2025-11-03T19:06:30.648884] [INFO ] [MAIN ] GDOT: Loaded 37727 existing records. [2025-11-03T19:06:30.764348] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-11 (0.42 seconds). [2025-11-03T19:06:30.770748] [INFO ] [REMOTE ] GDIV: Full fetch complete (5362 records). [2025-11-03T19:06:30.781097] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-11-03T19:06:30.958270] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:06:30.986485] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-11-03T19:06:31.007280] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-11-03T19:06:31.101224] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-11-03T19:06:31.112504] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-11-03T19:06:31.150497] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-11-03T19:06:31.376486] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-11-03T19:06:31.384863] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-11-03T19:06:31.385995] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-11-03T19:06:31.401063] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-11-03T19:06:31.469779] [DEBUG] [LOCAL ] GDIV: Trimmed 5362 records to 3331 (keeping 200 days of data) [2025-11-03T19:06:31.554401] [DEBUG] [LOCAL ] GDIV: Primary data saved (3331 records). [2025-11-03T19:06:31.574879] [INFO ] [MAIN ] GDIV: Full history saved. [2025-11-03T19:06:31.601708] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GDIV took 32.5s. Estimated remaining: 3h 24m 10s. Rate: 7.2 symbols/min [2025-11-03T19:06:31.647474] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:06:31.773437] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T19:06:31.836453] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:06:31.853514] [DEBUG] [LOCAL ] GDV: Loaded 18916 existing records from primary storage. [2025-11-03T19:06:31.853777] [INFO ] [MAIN ] GDV: Loaded 18916 existing records. [2025-11-03T19:06:31.939931] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-11-03T19:06:32.056211] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:06:32.056457] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-11-03T19:06:32.056517] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-11-03T19:06:32.057015] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-11-03T19:06:32.057084] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-11-03T19:06:32.419790] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:06:32.486914] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-11-03T19:06:32.734848] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-11-03T19:06:33.534862] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-11-03T19:06:33.628450] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T19:06:34.334894] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-11-03T19:06:34.782388] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T19:06:35.123761] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-11-03T19:06:35.134814] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-11-03T19:06:35.934898] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-11-03T19:06:36.300240] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:06:36.701686] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:06:36.734816] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-11-03T19:06:37.512435] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T19:06:37.534831] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-11-03T19:06:38.238066] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T19:06:38.334847] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-11-03T19:06:39.134836] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-11-03T19:06:39.176173] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T19:06:39.934987] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-11-03T19:06:40.379888] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:06:40.734821] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-11-03T19:06:41.009441] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T19:06:41.534967] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-11-03T19:06:42.005516] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-11-03T19:06:42.212764] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T19:06:42.334866] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-11-03T19:06:43.071738] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T19:06:43.134824] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-11-03T19:06:43.798561] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-11-03T19:06:43.934834] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-11-03T19:06:44.735197] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-11-03T19:06:44.737527] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-11-03T19:06:45.194159] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T19:06:45.534907] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-11-03T19:06:45.940596] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T19:06:46.334866] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-11-03T19:06:46.790840] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T19:06:47.134915] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-11-03T19:06:47.541083] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-11-03T19:06:47.934871] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-11-03T19:06:48.392824] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-11-03T19:06:48.734969] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-11-03T19:06:49.398785] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-11-03T19:06:49.534922] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-11-03T19:06:50.263552] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T19:06:50.334835] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-11-03T19:06:51.032565] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T19:06:51.134894] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-11-03T19:06:51.934875] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-11. [2025-11-03T19:06:52.123126] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T19:06:52.571621] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T19:06:52.572966] [INFO ] [REMOTE ] GDV: Full fetch complete (28072 records). [2025-11-03T19:06:52.573050] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-11-03T19:06:52.740052] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-11-03T19:06:52.982987] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-11-03T19:06:52.983097] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-11-03T19:06:52.984066] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-11-03T19:06:52.984148] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-11-03T19:06:52.985336] [DEBUG] [LOCAL ] GDV: Trimmed 28072 records to 18516 (keeping 200 days of data) [2025-11-03T19:06:53.101150] [DEBUG] [LOCAL ] GDV: Primary data saved (18516 records). [2025-11-03T19:06:53.101310] [INFO ] [MAIN ] GDV: Full history saved. [2025-11-03T19:06:53.101436] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GDV took 21.5s. Estimated remaining: 3h 24m 22s. Rate: 7.1 symbols/min [2025-11-03T19:06:53.278843] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:06:53.328754] [DEBUG] [LOCAL ] GE: Loaded 54463 existing records from primary storage. [2025-11-03T19:06:53.329072] [INFO ] [MAIN ] GE: Loaded 54463 existing records. [2025-11-03T19:06:53.500239] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:06:53.500467] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-11-03T19:06:53.500514] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-11-03T19:06:53.501422] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-11-03T19:06:53.501479] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-11-03T19:06:53.543190] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-11-03T19:06:53.858111] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:06:54.061864] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-11-03T19:06:54.229781] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T19:06:54.334865] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-11-03T19:06:54.741336] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-11-03T19:06:55.134877] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-11-03T19:06:55.934893] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-11-03T19:06:56.451559] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T19:06:56.734882] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-11. [2025-11-03T19:06:56.898723] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T19:06:57.534873] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-11-03T19:06:57.871736] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:06:57.873292] [INFO ] [REMOTE ] GDDY: Full fetch complete (72086 records). [2025-11-03T19:06:57.873391] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-11-03T19:06:58.279840] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-11-03T19:06:58.279931] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-11-03T19:06:58.280906] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-11-03T19:06:58.280977] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-11-03T19:06:58.282438] [DEBUG] [LOCAL ] GDDY: Trimmed 72086 records to 49415 (keeping 200 days of data) [2025-11-03T19:06:58.340391] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-11-03T19:06:58.578885] [DEBUG] [LOCAL ] GDDY: Primary data saved (49415 records). [2025-11-03T19:06:58.579021] [INFO ] [MAIN ] GDDY: Full history saved. [2025-11-03T19:06:58.579101] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDDY took 1m 1s. Estimated remaining: 3h 24m 9s. Rate: 7.1 symbols/min [2025-11-03T19:06:58.751372] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:06:58.770663] [DEBUG] [LOCAL ] GEF: Loaded 20833 existing records from primary storage. [2025-11-03T19:06:58.770916] [INFO ] [MAIN ] GEF: Loaded 20833 existing records. [2025-11-03T19:06:58.978764] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:06:58.979199] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-11-03T19:06:58.979479] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-11-03T19:06:58.980078] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-11-03T19:06:58.980148] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-11-03T19:06:59.139941] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-11. [2025-11-03T19:06:59.357008] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:06:59.394280] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-11-03T19:06:59.493191] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:06:59.826896] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-11 (0.69 seconds). [2025-11-03T19:06:59.827674] [INFO ] [REMOTE ] GDO: Full fetch complete (8413 records). [2025-11-03T19:06:59.827743] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-11-03T19:06:59.939953] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-11-03T19:07:00.194199] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-11-03T19:07:00.194278] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-11-03T19:07:00.194500] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-11-03T19:07:00.194540] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-11-03T19:07:00.194993] [DEBUG] [LOCAL ] GDO: Trimmed 8413 records to 5803 (keeping 200 days of data) [2025-11-03T19:07:00.230250] [DEBUG] [LOCAL ] GDO: Primary data saved (5803 records). [2025-11-03T19:07:00.230385] [INFO ] [MAIN ] GDO: Full history saved. [2025-11-03T19:07:00.230466] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDO took 31.2s. Estimated remaining: 3h 23m 50s. Rate: 7.2 symbols/min [2025-11-03T19:07:00.397712] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:07:00.426774] [DEBUG] [LOCAL ] GEL: Loaded 31075 existing records from primary storage. [2025-11-03T19:07:00.427050] [INFO ] [MAIN ] GEL: Loaded 31075 existing records. [2025-11-03T19:07:00.644672] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:07:00.644937] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-11-03T19:07:00.645005] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-11-03T19:07:00.645637] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-11-03T19:07:00.645733] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-11-03T19:07:00.740690] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-11-03T19:07:01.031061] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:07:01.055059] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T19:07:01.534890] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-11-03T19:07:02.306286] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-11-03T19:07:02.334850] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-11-03T19:07:02.525893] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T19:07:03.134873] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-11-03T19:07:03.517742] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T19:07:03.934948] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-11-03T19:07:04.023103] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T19:07:04.734910] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-11-03T19:07:05.512287] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-11-03T19:07:05.534827] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-11-03T19:07:05.822079] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T19:07:06.334851] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-11-03T19:07:07.022164] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T19:07:07.144865] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-11-03T19:07:07.150944] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T19:07:07.894383] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T19:07:07.934818] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-11-03T19:07:08.731415] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-11-03T19:07:08.735776] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-11-03T19:07:09.534925] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-11-03T19:07:10.219419] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T19:07:10.334873] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-11-03T19:07:10.417965] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-11-03T19:07:11.134846] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-11. [2025-11-03T19:07:11.198251] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:07:11.934855] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-11-03T19:07:12.045789] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T19:07:12.046934] [INFO ] [REMOTE ] GDOT: Full fetch complete (53682 records). [2025-11-03T19:07:12.047010] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-11-03T19:07:12.430179] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-11-03T19:07:12.430260] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-11-03T19:07:12.431005] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-11-03T19:07:12.431066] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-11-03T19:07:12.432133] [DEBUG] [LOCAL ] GDOT: Trimmed 53682 records to 37171 (keeping 200 days of data) [2025-11-03T19:07:12.645255] [DEBUG] [LOCAL ] GDOT: Primary data saved (37171 records). [2025-11-03T19:07:12.645395] [INFO ] [MAIN ] GDOT: Full history saved. [2025-11-03T19:07:12.645470] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GDOT took 42.2s. Estimated remaining: 3h 23m 48s. Rate: 7.1 symbols/min [2025-11-03T19:07:12.743755] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-11-03T19:07:12.842967] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:07:12.892766] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T19:07:12.918203] [DEBUG] [LOCAL ] GENI: Loaded 53633 existing records from primary storage. [2025-11-03T19:07:12.918527] [INFO ] [MAIN ] GENI: Loaded 53633 existing records. [2025-11-03T19:07:13.093757] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:07:13.093966] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-11-03T19:07:13.094013] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-11-03T19:07:13.094928] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-11-03T19:07:13.094984] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-11-03T19:07:13.470569] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:07:13.510993] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-11-03T19:07:13.534823] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-11-03T19:07:14.334864] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-11-03T19:07:14.820546] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T19:07:15.134863] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-11-03T19:07:15.934860] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-11-03T19:07:15.999604] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-11-03T19:07:16.345827] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T19:07:16.734905] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-11-03T19:07:17.176436] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T19:07:17.534857] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-11-03T19:07:18.024772] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:07:18.334169] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T19:07:18.340576] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-11-03T19:07:19.134875] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-11-03T19:07:19.934835] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-11-03T19:07:20.029870] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-11-03T19:07:20.383119] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:07:20.734846] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-11-03T19:07:20.829429] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T19:07:21.534924] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-11-03T19:07:21.984850] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:07:22.334939] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-11-03T19:07:22.463958] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T19:07:23.134923] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-11-03T19:07:23.934860] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-11-03T19:07:24.202433] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-11-03T19:07:24.278383] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T19:07:24.734875] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-11-03T19:07:25.266047] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:07:25.520020] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T19:07:25.534822] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-11-03T19:07:26.334866] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-11-03T19:07:26.414041] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T19:07:27.134907] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-11-03T19:07:27.321809] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T19:07:27.934890] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-11. [2025-11-03T19:07:28.480225] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T19:07:28.506751] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T19:07:28.507745] [INFO ] [REMOTE ] GEF: Full fetch complete (29404 records). [2025-11-03T19:07:28.507816] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-11-03T19:07:28.740020] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-11-03T19:07:28.881832] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-11-03T19:07:28.881909] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-11-03T19:07:28.882461] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-11-03T19:07:28.882501] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-11-03T19:07:28.883240] [DEBUG] [LOCAL ] GEF: Trimmed 29404 records to 20586 (keeping 200 days of data) [2025-11-03T19:07:29.006449] [DEBUG] [LOCAL ] GEF: Primary data saved (20586 records). [2025-11-03T19:07:29.006596] [INFO ] [MAIN ] GEF: Full history saved. [2025-11-03T19:07:29.006714] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GEF took 30.4s. Estimated remaining: 3h 23m 52s. Rate: 7.1 symbols/min [2025-11-03T19:07:29.172162] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:07:29.218428] [DEBUG] [LOCAL ] GEO: Loaded 52272 existing records from primary storage. [2025-11-03T19:07:29.218821] [INFO ] [MAIN ] GEO: Loaded 52272 existing records. [2025-11-03T19:07:29.400248] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:07:29.400538] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-11-03T19:07:29.400592] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-11-03T19:07:29.401698] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-11-03T19:07:29.401757] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-11-03T19:07:29.544157] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-11-03T19:07:29.759117] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:07:30.145435] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T19:07:30.334868] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-11-03T19:07:31.134840] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-11-03T19:07:31.225601] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-11-03T19:07:31.609955] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T19:07:31.934882] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-11-03T19:07:32.134031] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T19:07:32.734855] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-11-03T19:07:33.534886] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-11-03T19:07:34.017453] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-11-03T19:07:34.334831] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-11. [2025-11-03T19:07:34.413207] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-11-03T19:07:34.865871] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T19:07:35.134838] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-11. [2025-11-03T19:07:35.934824] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-11-03T19:07:35.988530] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-11 (1.65 seconds). [2025-11-03T19:07:35.990070] [INFO ] [REMOTE ] GE: Full fetch complete (77852 records). [2025-11-03T19:07:35.990167] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-11-03T19:07:36.367498] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-11 (1.23 seconds). [2025-11-03T19:07:36.393344] [INFO ] [REMOTE ] GENI: Full fetch complete (76088 records). [2025-11-03T19:07:36.393535] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-11-03T19:07:36.393714] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-11-03T19:07:36.393631] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-11-03T19:07:36.395063] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-11-03T19:07:36.395218] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-11-03T19:07:36.497938] [DEBUG] [LOCAL ] GE: Trimmed 77852 records to 53683 (keeping 200 days of data) [2025-11-03T19:07:36.741137] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-11-03T19:07:37.027972] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-11-03T19:07:37.029509] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-11-03T19:07:37.033479] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-11-03T19:07:37.033565] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-11-03T19:07:37.038051] [DEBUG] [LOCAL ] GENI: Trimmed 76088 records to 52861 (keeping 200 days of data) [2025-11-03T19:07:37.454525] [DEBUG] [LOCAL ] GENI: Primary data saved (52861 records). [2025-11-03T19:07:37.456668] [INFO ] [MAIN ] GENI: Full history saved. [2025-11-03T19:07:37.456837] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GENI took 24.8s. Estimated remaining: 3h 23m 44s. Rate: 7.1 symbols/min [2025-11-03T19:07:37.519388] [DEBUG] [LOCAL ] GE: Primary data saved (53683 records). [2025-11-03T19:07:37.562123] [INFO ] [MAIN ] GE: Full history saved. [2025-11-03T19:07:37.571332] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-11-03T19:07:37.569015] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GE took 44.5s. Estimated remaining: 3h 23m 22s. Rate: 7.1 symbols/min [2025-11-03T19:07:37.672547] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-11-03T19:07:37.821817] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:07:37.927889] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:07:37.937233] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T19:07:37.979753] [DEBUG] [LOCAL ] GES: Loaded 37766 existing records from primary storage. [2025-11-03T19:07:37.980042] [INFO ] [MAIN ] GES: Loaded 37766 existing records. [2025-11-03T19:07:38.093931] [DEBUG] [LOCAL ] GETY: Loaded 35551 existing records from primary storage. [2025-11-03T19:07:38.105077] [INFO ] [MAIN ] GETY: Loaded 35551 existing records. [2025-11-03T19:07:38.289768] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:07:38.300220] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-11-03T19:07:38.300285] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-11-03T19:07:38.346613] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-11-03T19:07:38.351385] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:07:38.351538] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-11-03T19:07:38.351686] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-11-03T19:07:38.372522] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-11-03T19:07:38.409624] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-11-03T19:07:38.435733] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-11-03T19:07:38.447267] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-11-03T19:07:39.040549] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:07:39.111224] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:07:39.134862] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-11-03T19:07:39.209439] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T19:07:39.238725] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T19:07:39.934855] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-11-03T19:07:40.410722] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T19:07:40.734950] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-11. [2025-11-03T19:07:41.411104] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T19:07:41.412566] [INFO ] [REMOTE ] GEL: Full fetch complete (47746 records). [2025-11-03T19:07:41.412704] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-11-03T19:07:41.539694] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-11-03T19:07:41.790247] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-11-03T19:07:41.889187] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-11-03T19:07:41.889273] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-11-03T19:07:41.889987] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-11-03T19:07:41.890049] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-11-03T19:07:41.891149] [DEBUG] [LOCAL ] GEL: Trimmed 47746 records to 30807 (keeping 200 days of data) [2025-11-03T19:07:42.078703] [DEBUG] [LOCAL ] GEL: Primary data saved (30807 records). [2025-11-03T19:07:42.078846] [INFO ] [MAIN ] GEL: Full history saved. [2025-11-03T19:07:42.078940] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GEL took 41.8s. Estimated remaining: 3h 23m 8s. Rate: 7.2 symbols/min [2025-11-03T19:07:42.263081] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:07:42.313343] [DEBUG] [LOCAL ] GEV: Loaded 53749 existing records from primary storage. [2025-11-03T19:07:42.313722] [INFO ] [MAIN ] GEV: Loaded 53749 existing records. [2025-11-03T19:07:42.340074] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-11-03T19:07:42.511707] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:07:42.511921] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-11-03T19:07:42.511969] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-11-03T19:07:42.512920] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-11-03T19:07:42.512977] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-11-03T19:07:42.868414] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:07:43.134863] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-11-03T19:07:43.212100] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-11-03T19:07:43.453292] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:07:43.934896] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-11-03T19:07:44.475525] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T19:07:44.734887] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-11-03T19:07:45.113017] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T19:07:45.534923] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-11-03T19:07:46.334938] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-11-03T19:07:46.508150] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-11-03T19:07:46.779868] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T19:07:47.134840] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-11-03T19:07:47.628111] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:07:47.934857] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-11-03T19:07:48.451031] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T19:07:48.734855] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-11-03T19:07:49.241497] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T19:07:49.534895] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-11-03T19:07:49.775333] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T19:07:50.334854] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-11-03T19:07:50.525108] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T19:07:51.134858] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-11-03T19:07:51.365857] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T19:07:51.934894] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-11-03T19:07:52.734846] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-11-03T19:07:52.775717] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-11-03T19:07:53.025871] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T19:07:53.534919] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-11-03T19:07:53.623198] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T19:07:54.334856] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-11-03T19:07:55.134870] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-11-03T19:07:55.262638] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-11-03T19:07:55.478544] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T19:07:55.934862] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-11-03T19:07:56.707860] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T19:07:56.735477] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-11-03T19:07:56.739685] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T19:07:57.534857] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-11-03T19:07:58.334828] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-11-03T19:07:58.439530] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-11-03T19:07:58.721812] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T19:07:59.134862] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-11-03T19:07:59.371026] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:07:59.934925] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-11-03T19:08:00.167315] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T19:08:00.734901] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-11-03T19:08:01.244631] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T19:08:01.534876] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-11-03T19:08:02.334865] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-11-03T19:08:02.576129] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-11-03T19:08:02.681701] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T19:08:03.134945] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-11-03T19:08:03.500940] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T19:08:03.934889] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-11. [2025-11-03T19:08:04.620871] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T19:08:04.734875] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-11-03T19:08:04.929321] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:08:04.932363] [INFO ] [REMOTE ] GETY: Full fetch complete (54976 records). [2025-11-03T19:08:04.932481] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-11-03T19:08:05.309599] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-11-03T19:08:05.309697] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-11-03T19:08:05.310461] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-11-03T19:08:05.310505] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-11-03T19:08:05.311868] [DEBUG] [LOCAL ] GETY: Trimmed 54976 records to 35039 (keeping 200 days of data) [2025-11-03T19:08:05.502544] [DEBUG] [LOCAL ] GETY: Primary data saved (35039 records). [2025-11-03T19:08:05.502711] [INFO ] [MAIN ] GETY: Full history saved. [2025-11-03T19:08:05.502800] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GETY took 27.9s. Estimated remaining: 3h 23m 23s. Rate: 7.1 symbols/min [2025-11-03T19:08:05.544733] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-11-03T19:08:05.671949] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:05.675741] [DEBUG] [LOCAL ] GF: Loaded 2537 existing records from primary storage. [2025-11-03T19:08:05.675885] [INFO ] [MAIN ] GF: Loaded 2537 existing records. [2025-11-03T19:08:05.868851] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:05.871188] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-11-03T19:08:05.872312] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:08:05.871591] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-11-03T19:08:05.875104] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-11-03T19:08:05.880146] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-11-03T19:08:06.246745] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:06.334829] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-11-03T19:08:07.134931] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-11. [2025-11-03T19:08:07.299705] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-11-03T19:08:07.363185] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T19:08:07.934907] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-11. [2025-11-03T19:08:08.237405] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:08:08.239133] [INFO ] [REMOTE ] GEO: Full fetch complete (75335 records). [2025-11-03T19:08:08.239255] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-11-03T19:08:08.641263] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-11-03T19:08:08.641339] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-11-03T19:08:08.642236] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-11-03T19:08:08.642297] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-11-03T19:08:08.643597] [DEBUG] [LOCAL ] GEO: Trimmed 75335 records to 51520 (keeping 200 days of data) [2025-11-03T19:08:08.734874] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-11-03T19:08:08.744930] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:08:08.749466] [INFO ] [REMOTE ] GES: Full fetch complete (57669 records). [2025-11-03T19:08:08.750170] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-11-03T19:08:09.287773] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-11-03T19:08:09.287905] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-11-03T19:08:09.289583] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-11-03T19:08:09.290140] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-11-03T19:08:09.300372] [DEBUG] [LOCAL ] GES: Trimmed 57669 records to 36961 (keeping 200 days of data) [2025-11-03T19:08:09.516743] [DEBUG] [LOCAL ] GEO: Primary data saved (51520 records). [2025-11-03T19:08:09.526866] [INFO ] [MAIN ] GEO: Full history saved. [2025-11-03T19:08:09.528879] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GEO took 40.5s. Estimated remaining: 3h 23m 8s. Rate: 7.1 symbols/min [2025-11-03T19:08:09.585406] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-11-03T19:08:09.813382] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:09.831563] [DEBUG] [LOCAL ] GES: Primary data saved (36961 records). [2025-11-03T19:08:09.831755] [INFO ] [MAIN ] GES: Full history saved. [2025-11-03T19:08:09.831860] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GES took 32.4s. Estimated remaining: 3h 22m 47s. Rate: 7.2 symbols/min [2025-11-03T19:08:10.014124] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-11-03T19:08:10.015256] [DEBUG] [LOCAL ] GFF: Loaded 29081 existing records from primary storage. [2025-11-03T19:08:10.019420] [INFO ] [MAIN ] GFF: Loaded 29081 existing records. [2025-11-03T19:08:10.089333] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:10.235588] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:10.235863] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-11-03T19:08:10.235912] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-11-03T19:08:10.236423] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-11-03T19:08:10.236499] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-11-03T19:08:10.340257] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-11-03T19:08:10.506844] [DEBUG] [LOCAL ] GFI: Loaded 53891 existing records from primary storage. [2025-11-03T19:08:10.528725] [INFO ] [MAIN ] GFI: Loaded 53891 existing records. [2025-11-03T19:08:10.723719] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:10.832808] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:10.829734] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T19:08:10.835125] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-11-03T19:08:10.835268] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-11-03T19:08:10.836189] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-11-03T19:08:10.836247] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-11-03T19:08:11.135575] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-11-03T19:08:11.228817] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-11-03T19:08:11.234267] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:11.680085] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-11-03T19:08:11.934846] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-11-03T19:08:12.734867] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-11-03T19:08:13.303696] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T19:08:13.534856] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-11-03T19:08:13.869514] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-11-03T19:08:13.968995] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-11-03T19:08:14.334829] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-11-03T19:08:15.134868] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-11-03T19:08:15.290740] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:08:15.934936] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-11-03T19:08:16.305293] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-11-03T19:08:16.734906] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-11-03T19:08:17.126852] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-11-03T19:08:17.534959] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-11-03T19:08:17.554070] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T19:08:18.334903] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-11-03T19:08:19.051482] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T19:08:19.134808] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-11-03T19:08:19.354730] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T19:08:19.934871] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-11-03T19:08:20.564368] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T19:08:20.734898] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-11-03T19:08:21.534923] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-11-03T19:08:21.963115] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-11-03T19:08:22.010581] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-11-03T19:08:22.232291] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T19:08:22.334851] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-11-03T19:08:22.652786] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-11-03T19:08:23.134875] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-11-03T19:08:23.934936] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-11. [2025-11-03T19:08:24.734842] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-11-03T19:08:24.782245] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T19:08:25.534902] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-11-03T19:08:25.621978] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-11 (1.69 seconds). [2025-11-03T19:08:25.623510] [INFO ] [REMOTE ] GEV: Full fetch complete (77059 records). [2025-11-03T19:08:25.623627] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-11-03T19:08:26.031971] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-11-03T19:08:26.032088] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-11-03T19:08:26.033080] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-11-03T19:08:26.033157] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-11-03T19:08:26.056308] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T19:08:26.064150] [DEBUG] [LOCAL ] GEV: Trimmed 77059 records to 52980 (keeping 200 days of data) [2025-11-03T19:08:26.354980] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-11-03T19:08:26.403662] [DEBUG] [LOCAL ] GEV: Primary data saved (52980 records). [2025-11-03T19:08:26.403758] [INFO ] [MAIN ] GEV: Full history saved. [2025-11-03T19:08:26.404631] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GEV took 44.3s. Estimated remaining: 3h 22m 51s. Rate: 7.1 symbols/min [2025-11-03T19:08:26.970211] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T19:08:27.134865] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-11-03T19:08:27.369819] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T19:08:27.934927] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-11-03T19:08:28.617376] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T19:08:28.734875] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-11-03T19:08:28.795964] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:08:29.534848] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-11-03T19:08:30.334820] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-11-03T19:08:30.452788] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-11-03T19:08:30.479193] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T19:08:30.730310] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T19:08:31.134876] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-11-03T19:08:31.934868] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-11-03T19:08:32.127970] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T19:08:32.221238] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T19:08:32.734863] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-11-03T19:08:33.534973] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-11. [2025-11-03T19:08:33.844789] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-11 (0.31 seconds). [2025-11-03T19:08:33.845432] [INFO ] [REMOTE ] GF: Full fetch complete (4797 records). [2025-11-03T19:08:33.845499] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-11-03T19:08:34.218205] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-11-03T19:08:34.218435] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-11-03T19:08:34.218803] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-11-03T19:08:34.218977] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-11-03T19:08:34.219489] [DEBUG] [LOCAL ] GF: Trimmed 4797 records to 2500 (keeping 200 days of data) [2025-11-03T19:08:34.235212] [DEBUG] [LOCAL ] GF: Primary data saved (2500 records). [2025-11-03T19:08:34.235389] [INFO ] [MAIN ] GF: Full history saved. [2025-11-03T19:08:34.235536] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GF took 28.7s. Estimated remaining: 3h 22m 42s. Rate: 7.1 symbols/min [2025-11-03T19:08:34.275366] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-11-03T19:08:34.334911] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-11-03T19:08:35.134955] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-11-03T19:08:35.902227] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-11-03T19:08:35.934828] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-11-03T19:08:35.986474] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T19:08:36.734948] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-11-03T19:08:37.591043] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-11-03T19:08:37.603877] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-11. [2025-11-03T19:08:37.620797] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T19:08:38.334909] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-11. [2025-11-03T19:08:39.030762] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-11 (1.43 seconds). [2025-11-03T19:08:39.032301] [INFO ] [REMOTE ] GFI: Full fetch complete (77074 records). [2025-11-03T19:08:39.032414] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-11-03T19:08:39.108823] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-11 (0.77 seconds). [2025-11-03T19:08:39.150425] [INFO ] [REMOTE ] GFF: Full fetch complete (43253 records). [2025-11-03T19:08:39.171555] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-11-03T19:08:39.780183] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-11-03T19:08:39.791416] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-11-03T19:08:39.792824] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-11-03T19:08:39.798506] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-11-03T19:08:39.852302] [DEBUG] [LOCAL ] GFI: Trimmed 77074 records to 53114 (keeping 200 days of data) [2025-11-03T19:08:39.883602] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-11-03T19:08:39.883959] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-11-03T19:08:39.884401] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-11-03T19:08:39.884459] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-11-03T19:08:39.973008] [DEBUG] [LOCAL ] GFF: Trimmed 43253 records to 28512 (keeping 200 days of data) [2025-11-03T19:08:40.352104] [DEBUG] [LOCAL ] GFF: Primary data saved (28512 records). [2025-11-03T19:08:40.367492] [INFO ] [MAIN ] GFF: Full history saved. [2025-11-03T19:08:40.375900] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GFF took 30.8s. Estimated remaining: 3h 22m 30s. Rate: 7.1 symbols/min [2025-11-03T19:08:40.375766] [DEBUG] [LOCAL ] GFI: Primary data saved (53114 records). [2025-11-03T19:08:40.376124] [INFO ] [MAIN ] GFI: Full history saved. [2025-11-03T19:08:40.376288] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GFI took 30.5s. Estimated remaining: 3h 22m 8s. Rate: 7.2 symbols/min [2025-11-03T19:08:40.972045] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:41.076193] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:41.083686] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:41.085899] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:08:41.099024] [DEBUG] [LOCAL ] GFR: Loaded 6941 existing records from primary storage. [2025-11-03T19:08:41.099414] [INFO ] [MAIN ] GFR: Loaded 6941 existing records. [2025-11-03T19:08:41.270577] [DEBUG] [LOCAL ] GGG: Loaded 40957 existing records from primary storage. [2025-11-03T19:08:41.282085] [INFO ] [MAIN ] GGG: Loaded 40957 existing records. [2025-11-03T19:08:41.408831] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:41.415790] [DEBUG] [LOCAL ] GFL: Loaded 47928 existing records from primary storage. [2025-11-03T19:08:41.455444] [DEBUG] [LOCAL ] GGB: Loaded 52315 existing records from primary storage. [2025-11-03T19:08:41.455716] [INFO ] [MAIN ] GFL: Loaded 47928 existing records. [2025-11-03T19:08:41.461407] [INFO ] [MAIN ] GGB: Loaded 52315 existing records. [2025-11-03T19:08:41.509813] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-11-03T19:08:41.525676] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-11-03T19:08:41.645156] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-11-03T19:08:41.712317] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-11-03T19:08:41.951639] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:42.013374] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-11-03T19:08:42.050869] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:42.064958] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:08:42.070248] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-11-03T19:08:42.093320] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-11-03T19:08:42.080933] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-11-03T19:08:42.112775] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-11-03T19:08:42.129604] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-11-03T19:08:42.139824] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-11-03T19:08:42.132556] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-11-03T19:08:42.187118] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-11-03T19:08:42.206128] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-11-03T19:08:42.206020] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-11-03T19:08:42.261546] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-11-03T19:08:42.906315] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:43.015715] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-11-03T19:08:43.402599] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:43.480715] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-11-03T19:08:43.486065] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:43.499952] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:08:43.494606] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-11-03T19:08:43.500934] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-11-03T19:08:43.674121] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-11-03T19:08:43.676506] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-11-03T19:08:44.253446] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T19:08:44.256021] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-11-03T19:08:44.635680] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T19:08:44.645491] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-11-03T19:08:44.684375] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T19:08:44.696827] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-11-03T19:08:44.725729] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T19:08:44.734889] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-11-03T19:08:45.534868] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-11-03T19:08:45.799912] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T19:08:45.835909] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T19:08:46.334974] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-11-03T19:08:46.707890] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T19:08:46.923000] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T19:08:47.134862] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-11-03T19:08:47.934886] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-11-03T19:08:48.213094] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:08:48.734946] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-11-03T19:08:49.164359] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T19:08:49.257025] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-11-03T19:08:49.534935] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-11-03T19:08:50.334885] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-11-03T19:08:50.793356] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:08:51.134869] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-11-03T19:08:51.697059] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T19:08:51.934886] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-11-03T19:08:52.530395] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T19:08:52.734871] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-11-03T19:08:53.122347] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:08:53.123103] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T19:08:53.534851] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-11-03T19:08:54.334858] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-11-03T19:08:54.564160] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T19:08:55.134860] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-11-03T19:08:55.574852] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T19:08:55.665774] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:08:55.934889] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-11-03T19:08:56.734871] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-11-03T19:08:57.290907] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T19:08:57.534865] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-11-03T19:08:57.840477] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:08:58.334846] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-11-03T19:08:58.726052] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:08:59.134906] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-11-03T19:08:59.403922] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T19:08:59.934844] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-11-03T19:09:00.243884] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T19:09:00.734864] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-11-03T19:09:01.261815] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:09:01.534880] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-11-03T19:09:01.942909] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:09:01.983705] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T19:09:02.334907] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-11-03T19:09:03.134894] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-11-03T19:09:03.596023] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-11-03T19:09:03.715954] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T19:09:03.934877] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-11-03T19:09:04.734846] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-11-03T19:09:05.187899] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:09:05.188554] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-11-03T19:09:05.534914] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-11. [2025-11-03T19:09:05.945202] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-11 (0.41 seconds). [2025-11-03T19:09:05.945894] [INFO ] [REMOTE ] GFR: Full fetch complete (11720 records). [2025-11-03T19:09:05.945961] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-11-03T19:09:06.311548] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-11-03T19:09:06.311619] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-11-03T19:09:06.311905] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-11-03T19:09:06.311957] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-11-03T19:09:06.312366] [DEBUG] [LOCAL ] GFR: Trimmed 11720 records to 6787 (keeping 200 days of data) [2025-11-03T19:09:06.339181] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-11-03T19:09:06.350554] [DEBUG] [LOCAL ] GFR: Primary data saved (6787 records). [2025-11-03T19:09:06.350626] [INFO ] [MAIN ] GFR: Full history saved. [2025-11-03T19:09:06.350744] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFR took 26.0s. Estimated remaining: 3h 22m 28s. Rate: 7.1 symbols/min [2025-11-03T19:09:06.522304] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:06.535986] [DEBUG] [LOCAL ] GGT: Loaded 14636 existing records from primary storage. [2025-11-03T19:09:06.536210] [INFO ] [MAIN ] GGT: Loaded 14636 existing records. [2025-11-03T19:09:06.712134] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:06.712342] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-11-03T19:09:06.712388] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-11-03T19:09:06.712745] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-11-03T19:09:06.712807] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-11-03T19:09:07.062211] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:07.134837] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-11-03T19:09:07.728578] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T19:09:07.934824] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-11-03T19:09:08.118577] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T19:09:08.445154] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T19:09:08.734836] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-11-03T19:09:09.534846] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-11-03T19:09:10.002215] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T19:09:10.041922] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-11-03T19:09:10.334864] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-11-03T19:09:11.014017] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-11-03T19:09:11.134843] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-11-03T19:09:11.722936] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T19:09:11.934862] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-11-03T19:09:12.734906] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-11. [2025-11-03T19:09:13.039834] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:09:13.534877] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-11-03T19:09:13.675633] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T19:09:13.677089] [INFO ] [REMOTE ] GFL: Full fetch complete (69672 records). [2025-11-03T19:09:13.677171] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-11-03T19:09:14.086040] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-11-03T19:09:14.086150] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-11-03T19:09:14.087171] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-11-03T19:09:14.087237] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-11-03T19:09:14.088617] [DEBUG] [LOCAL ] GFL: Trimmed 69672 records to 47252 (keeping 200 days of data) [2025-11-03T19:09:14.345507] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-11-03T19:09:14.371804] [DEBUG] [LOCAL ] GFL: Primary data saved (47252 records). [2025-11-03T19:09:14.371896] [INFO ] [MAIN ] GFL: Full history saved. [2025-11-03T19:09:14.371972] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GFL took 34.0s. Estimated remaining: 3h 22m 19s. Rate: 7.1 symbols/min [2025-11-03T19:09:14.545493] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:14.549347] [DEBUG] [LOCAL ] GGZ: Loaded 2309 existing records from primary storage. [2025-11-03T19:09:14.549498] [INFO ] [MAIN ] GGZ: Loaded 2309 existing records. [2025-11-03T19:09:14.753475] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:14.754042] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-11-03T19:09:14.754127] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-11-03T19:09:14.754386] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-11-03T19:09:14.754450] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-11-03T19:09:15.135915] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-11-03T19:09:15.186383] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:15.192395] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-11-03T19:09:15.658439] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T19:09:15.931897] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T19:09:15.935864] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-11-03T19:09:16.340253] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-11-03T19:09:16.734942] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-11-03T19:09:17.534962] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-11. [2025-11-03T19:09:18.328963] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T19:09:18.340101] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-11-03T19:09:18.463154] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T19:09:18.464466] [INFO ] [REMOTE ] GGG: Full fetch complete (59781 records). [2025-11-03T19:09:18.464542] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-11-03T19:09:18.862606] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-11-03T19:09:18.862748] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-11-03T19:09:18.863607] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-11-03T19:09:18.863685] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-11-03T19:09:18.864886] [DEBUG] [LOCAL ] GGG: Trimmed 59781 records to 40329 (keeping 200 days of data) [2025-11-03T19:09:19.103965] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T19:09:19.126228] [DEBUG] [LOCAL ] GGG: Primary data saved (40329 records). [2025-11-03T19:09:19.126328] [INFO ] [MAIN ] GGG: Full history saved. [2025-11-03T19:09:19.126405] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GGG took 38.7s. Estimated remaining: 3h 22m 5s. Rate: 7.1 symbols/min [2025-11-03T19:09:19.139914] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-11-03T19:09:19.299068] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:19.303087] [DEBUG] [LOCAL ] GHC: Loaded 3031 existing records from primary storage. [2025-11-03T19:09:19.303221] [INFO ] [MAIN ] GHC: Loaded 3031 existing records. [2025-11-03T19:09:19.476430] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:19.476596] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-11-03T19:09:19.476662] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-11-03T19:09:19.476867] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-11-03T19:09:19.476923] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-11-03T19:09:19.636616] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T19:09:19.830396] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:19.934819] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-11-03T19:09:20.293486] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-11-03T19:09:20.734818] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-11-03T19:09:21.195532] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-11-03T19:09:21.534919] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-11. [2025-11-03T19:09:22.334882] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-11-03T19:09:22.712277] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-11-03T19:09:22.717861] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-11 (1.18 seconds). [2025-11-03T19:09:22.719256] [INFO ] [REMOTE ] GGB: Full fetch complete (74371 records). [2025-11-03T19:09:22.719340] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-11-03T19:09:23.140187] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-11-03T19:09:23.140309] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-11-03T19:09:23.141344] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-11-03T19:09:23.140021] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-11-03T19:09:23.142211] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-11-03T19:09:23.143794] [DEBUG] [LOCAL ] GGB: Trimmed 74371 records to 51603 (keeping 200 days of data) [2025-11-03T19:09:23.435462] [DEBUG] [LOCAL ] GGB: Primary data saved (51603 records). [2025-11-03T19:09:23.435594] [INFO ] [MAIN ] GGB: Full history saved. [2025-11-03T19:09:23.435693] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GGB took 43.0s. Estimated remaining: 3h 21m 50s. Rate: 7.1 symbols/min [2025-11-03T19:09:23.545251] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-11-03T19:09:23.616235] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:23.621084] [DEBUG] [LOCAL ] GHG: Loaded 3320 existing records from primary storage. [2025-11-03T19:09:23.621247] [INFO ] [MAIN ] GHG: Loaded 3320 existing records. [2025-11-03T19:09:23.800271] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:23.800497] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-11-03T19:09:23.800546] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-11-03T19:09:23.800753] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-11-03T19:09:23.800810] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-11-03T19:09:23.940022] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-11-03T19:09:24.156110] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:24.375018] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-11-03T19:09:24.734909] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-11-03T19:09:25.124730] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-11-03T19:09:25.534900] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-11-03T19:09:26.139240] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-11-03T19:09:26.334879] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-11-03T19:09:26.676579] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-11-03T19:09:27.134929] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-11-03T19:09:27.721942] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-11-03T19:09:27.934984] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-11-03T19:09:28.223010] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-11-03T19:09:28.734893] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-11-03T19:09:29.092520] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-11-03T19:09:29.534956] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-11-03T19:09:30.175442] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T19:09:30.334823] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-11-03T19:09:31.091943] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T19:09:31.134815] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-11. [2025-11-03T19:09:31.899589] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-11 (0.76 seconds). [2025-11-03T19:09:31.900407] [INFO ] [REMOTE ] GGT: Full fetch complete (19298 records). [2025-11-03T19:09:31.900477] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-11-03T19:09:31.940069] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-11-03T19:09:32.269123] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-11-03T19:09:32.269205] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-11-03T19:09:32.269633] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-11-03T19:09:32.269727] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-11-03T19:09:32.270296] [DEBUG] [LOCAL ] GGT: Trimmed 19298 records to 14579 (keeping 200 days of data) [2025-11-03T19:09:32.352192] [DEBUG] [LOCAL ] GGT: Primary data saved (14579 records). [2025-11-03T19:09:32.352316] [INFO ] [MAIN ] GGT: Full history saved. [2025-11-03T19:09:32.352439] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGT took 26.0s. Estimated remaining: 3h 21m 42s. Rate: 7.1 symbols/min [2025-11-03T19:09:32.528197] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:32.537427] [DEBUG] [LOCAL ] GHI: Loaded 8355 existing records from primary storage. [2025-11-03T19:09:32.537622] [INFO ] [MAIN ] GHI: Loaded 8355 existing records. [2025-11-03T19:09:32.659306] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T19:09:32.720232] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:32.720392] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-11-03T19:09:32.720438] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-11-03T19:09:32.720725] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-11-03T19:09:32.720803] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-11-03T19:09:32.740923] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-11-03T19:09:33.091402] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:33.534913] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-11-03T19:09:33.835918] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-11-03T19:09:33.922258] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T19:09:34.334884] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-11-03T19:09:34.628592] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T19:09:35.134854] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-11-03T19:09:35.465023] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-11-03T19:09:35.934864] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-11-03T19:09:36.279952] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-11-03T19:09:36.734945] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-11-03T19:09:37.040459] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-11-03T19:09:37.534881] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-11-03T19:09:38.100486] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-11-03T19:09:38.334878] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-11-03T19:09:38.722114] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-11-03T19:09:39.134872] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-11-03T19:09:39.496604] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-11-03T19:09:39.934886] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-11-03T19:09:40.222781] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-11-03T19:09:40.734969] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-11-03T19:09:41.170204] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T19:09:41.534880] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-11-03T19:09:41.850155] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-11-03T19:09:42.334874] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-11-03T19:09:42.716166] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-11-03T19:09:43.134848] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-11-03T19:09:43.603050] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-11-03T19:09:43.934868] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-11-03T19:09:44.244036] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-11-03T19:09:44.734856] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-11-03T19:09:45.168124] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T19:09:45.534860] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-11-03T19:09:46.034174] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-11-03T19:09:46.334851] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-11-03T19:09:46.725079] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-11-03T19:09:47.134882] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-11-03T19:09:47.621886] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T19:09:47.934842] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-11-03T19:09:48.444793] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-11-03T19:09:48.734849] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-11-03T19:09:49.123824] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T19:09:49.534853] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-11-03T19:09:50.043222] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T19:09:50.334855] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-11-03T19:09:50.729139] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T19:09:51.134845] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-11. [2025-11-03T19:09:51.637215] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-11 (0.50 seconds). [2025-11-03T19:09:51.637916] [INFO ] [REMOTE ] GHG: Full fetch complete (4287 records). [2025-11-03T19:09:51.637986] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-11-03T19:09:51.939948] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-11-03T19:09:51.994126] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-11-03T19:09:51.994261] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-11-03T19:09:51.994396] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-11-03T19:09:51.994436] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-11-03T19:09:51.994838] [DEBUG] [LOCAL ] GHG: Trimmed 4287 records to 3287 (keeping 200 days of data) [2025-11-03T19:09:52.014027] [DEBUG] [LOCAL ] GHG: Primary data saved (3287 records). [2025-11-03T19:09:52.014132] [INFO ] [MAIN ] GHG: Full history saved. [2025-11-03T19:09:52.014208] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GHG took 28.6s. Estimated remaining: 3h 21m 51s. Rate: 7.1 symbols/min [2025-11-03T19:09:52.181978] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:52.187803] [DEBUG] [LOCAL ] GHLD: Loaded 4448 existing records from primary storage. [2025-11-03T19:09:52.187989] [INFO ] [MAIN ] GHLD: Loaded 4448 existing records. [2025-11-03T19:09:52.373422] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:52.373666] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-11-03T19:09:52.373736] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-11-03T19:09:52.373926] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-11-03T19:09:52.374004] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-11-03T19:09:52.659024] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T19:09:52.737153] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:52.737213] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-11-03T19:09:53.247032] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T19:09:53.534866] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-11-03T19:09:53.831380] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-11-03T19:09:54.334850] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-11-03T19:09:54.627694] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T19:09:55.134860] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-11. [2025-11-03T19:09:55.576761] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-11 (0.44 seconds). [2025-11-03T19:09:55.577966] [INFO ] [REMOTE ] GHC: Full fetch complete (3927 records). [2025-11-03T19:09:55.578064] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-11-03T19:09:55.944959] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-11-03T19:09:55.951606] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-11-03T19:09:55.951944] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-11-03T19:09:55.953394] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-11-03T19:09:55.953462] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-11-03T19:09:55.953923] [DEBUG] [LOCAL ] GHC: Trimmed 3927 records to 3152 (keeping 200 days of data) [2025-11-03T19:09:55.975529] [DEBUG] [LOCAL ] GHC: Primary data saved (3152 records). [2025-11-03T19:09:55.975679] [INFO ] [MAIN ] GHC: Full history saved. [2025-11-03T19:09:55.975778] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GHC took 36.8s. Estimated remaining: 3h 21m 36s. Rate: 7.1 symbols/min [2025-11-03T19:09:56.151445] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:09:56.165876] [DEBUG] [LOCAL ] GHM: Loaded 14541 existing records from primary storage. [2025-11-03T19:09:56.166112] [INFO ] [MAIN ] GHM: Loaded 14541 existing records. [2025-11-03T19:09:56.356632] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:09:56.357108] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-11-03T19:09:56.357179] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-11-03T19:09:56.357552] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-11-03T19:09:56.357611] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-11-03T19:09:56.481927] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T19:09:56.738469] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-11-03T19:09:56.769839] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:09:57.011830] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-11-03T19:09:57.534871] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-11-03T19:09:57.850618] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-11-03T19:09:58.334901] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-11-03T19:09:59.010991] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-11-03T19:09:59.134866] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-11-03T19:09:59.483870] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T19:09:59.934852] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-11-03T19:10:00.225538] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:10:00.734868] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-11. [2025-11-03T19:10:01.097794] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-11 (0.36 seconds). [2025-11-03T19:10:01.098432] [INFO ] [REMOTE ] GGZ: Full fetch complete (3644 records). [2025-11-03T19:10:01.098498] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-11-03T19:10:01.478336] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-11-03T19:10:01.478420] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-11-03T19:10:01.478550] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-11-03T19:10:01.478587] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-11-03T19:10:01.478971] [DEBUG] [LOCAL ] GGZ: Trimmed 3644 records to 2240 (keeping 200 days of data) [2025-11-03T19:10:01.492421] [DEBUG] [LOCAL ] GGZ: Primary data saved (2240 records). [2025-11-03T19:10:01.492512] [INFO ] [MAIN ] GGZ: Full history saved. [2025-11-03T19:10:01.492586] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GGZ took 47.1s. Estimated remaining: 3h 21m 23s. Rate: 7.1 symbols/min [2025-11-03T19:10:01.539976] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-11. [2025-11-03T19:10:01.673459] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:01.692874] [DEBUG] [LOCAL ] GHY: Loaded 20844 existing records from primary storage. [2025-11-03T19:10:01.693134] [INFO ] [MAIN ] GHY: Loaded 20844 existing records. [2025-11-03T19:10:01.913876] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:01.914084] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-11-03T19:10:01.914130] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-11-03T19:10:01.914723] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-11-03T19:10:01.914781] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-11-03T19:10:02.281858] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-11 (0.74 seconds). [2025-11-03T19:10:02.310331] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:02.312243] [INFO ] [REMOTE ] GHI: Full fetch complete (11628 records). [2025-11-03T19:10:02.312371] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-11-03T19:10:02.342825] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-11-03T19:10:02.688483] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-11-03T19:10:02.688568] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-11-03T19:10:02.689048] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-11-03T19:10:02.689113] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-11-03T19:10:02.689699] [DEBUG] [LOCAL ] GHI: Trimmed 11628 records to 8373 (keeping 200 days of data) [2025-11-03T19:10:02.741549] [DEBUG] [LOCAL ] GHI: Primary data saved (8373 records). [2025-11-03T19:10:02.741720] [INFO ] [MAIN ] GHI: Full history saved. [2025-11-03T19:10:02.741814] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GHI took 30.4s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-11-03T19:10:02.915981] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:02.946509] [DEBUG] [LOCAL ] GIB: Loaded 31325 existing records from primary storage. [2025-11-03T19:10:02.946823] [INFO ] [MAIN ] GIB: Loaded 31325 existing records. [2025-11-03T19:10:03.135376] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-11-03T19:10:03.139476] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:03.148893] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T19:10:03.149021] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-11-03T19:10:03.153494] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-11-03T19:10:03.154153] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-11-03T19:10:03.154212] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-11-03T19:10:03.530394] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:03.646236] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-11-03T19:10:03.934850] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-11-03T19:10:04.734823] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-11-03T19:10:04.937884] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T19:10:05.534857] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-11-03T19:10:05.653518] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T19:10:06.294858] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T19:10:06.334819] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-11-03T19:10:07.049813] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T19:10:07.134818] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-11-03T19:10:07.775043] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T19:10:07.934825] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-11-03T19:10:08.734851] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-11-03T19:10:09.028971] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T19:10:09.534897] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-11-03T19:10:09.764249] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T19:10:10.101430] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T19:10:10.334918] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-11-03T19:10:11.134919] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-11-03T19:10:11.256597] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-11-03T19:10:11.706734] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T19:10:11.934903] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-11-03T19:10:12.575194] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-11-03T19:10:12.734882] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-11-03T19:10:13.172449] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T19:10:13.534889] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-11-03T19:10:14.297507] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T19:10:14.334861] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-11-03T19:10:14.966243] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:10:15.134878] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-11-03T19:10:15.934852] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-11-03T19:10:15.993369] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T19:10:16.334546] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T19:10:16.734882] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-11-03T19:10:17.534847] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-11-03T19:10:17.709410] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T19:10:18.229676] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T19:10:18.334873] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-11-03T19:10:19.014565] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T19:10:19.134888] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-11-03T19:10:19.857401] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T19:10:19.934902] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-11-03T19:10:20.584714] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-11-03T19:10:20.734885] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-11-03T19:10:21.534882] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-11-03T19:10:21.837579] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T19:10:22.053585] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-11-03T19:10:22.334861] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-11-03T19:10:23.134831] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-11-03T19:10:23.234078] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-11-03T19:10:23.853473] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T19:10:23.934943] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-11-03T19:10:24.734862] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-11. [2025-11-03T19:10:24.769317] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T19:10:25.334841] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-11 (0.60 seconds). [2025-11-03T19:10:25.335772] [INFO ] [REMOTE ] GHM: Full fetch complete (22028 records). [2025-11-03T19:10:25.335863] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-11-03T19:10:25.542330] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-11-03T19:10:25.726114] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-11-03T19:10:25.726197] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-11-03T19:10:25.726679] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-11-03T19:10:25.726742] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-11-03T19:10:25.727437] [DEBUG] [LOCAL ] GHM: Trimmed 22028 records to 14465 (keeping 200 days of data) [2025-11-03T19:10:25.809751] [DEBUG] [LOCAL ] GHM: Primary data saved (14465 records). [2025-11-03T19:10:25.809897] [INFO ] [MAIN ] GHM: Full history saved. [2025-11-03T19:10:25.809983] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GHM took 29.8s. Estimated remaining: 3h 21m 18s. Rate: 7.1 symbols/min [2025-11-03T19:10:25.981911] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:25.996199] [DEBUG] [LOCAL ] GIC: Loaded 13374 existing records from primary storage. [2025-11-03T19:10:25.996503] [INFO ] [MAIN ] GIC: Loaded 13374 existing records. [2025-11-03T19:10:26.194026] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:26.194301] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-11-03T19:10:26.194376] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-11-03T19:10:26.194830] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-11-03T19:10:26.194904] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-11-03T19:10:26.347595] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-11-03T19:10:26.575593] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:26.596545] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T19:10:26.910523] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T19:10:27.134906] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-11-03T19:10:27.513818] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-11-03T19:10:27.934869] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-11-03T19:10:28.566828] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-11-03T19:10:28.734865] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-11-03T19:10:29.324745] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-11-03T19:10:29.534875] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-11. [2025-11-03T19:10:30.188702] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T19:10:30.189973] [INFO ] [REMOTE ] GHY: Full fetch complete (31661 records). [2025-11-03T19:10:30.190073] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-11-03T19:10:30.340012] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-11. [2025-11-03T19:10:30.593913] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-11-03T19:10:30.593994] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-11-03T19:10:30.594635] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-11-03T19:10:30.594724] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-11-03T19:10:30.595613] [DEBUG] [LOCAL ] GHY: Trimmed 31661 records to 20391 (keeping 200 days of data) [2025-11-03T19:10:30.725116] [DEBUG] [LOCAL ] GHY: Primary data saved (20391 records). [2025-11-03T19:10:30.725237] [INFO ] [MAIN ] GHY: Full history saved. [2025-11-03T19:10:30.725312] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHY took 29.2s. Estimated remaining: 3h 21m 4s. Rate: 7.1 symbols/min [2025-11-03T19:10:30.905061] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:30.901969] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-11 (0.56 seconds). [2025-11-03T19:10:30.906269] [INFO ] [REMOTE ] GHLD: Full fetch complete (5279 records). [2025-11-03T19:10:30.906343] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-11-03T19:10:31.138159] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-11-03T19:10:31.243212] [DEBUG] [LOCAL ] GIL: Loaded 44535 existing records from primary storage. [2025-11-03T19:10:31.263067] [INFO ] [MAIN ] GIL: Loaded 44535 existing records. [2025-11-03T19:10:31.493452] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-11-03T19:10:31.511608] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-11-03T19:10:31.523222] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-11-03T19:10:31.533912] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-11-03T19:10:31.555384] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:31.555605] [DEBUG] [LOCAL ] GHLD: Trimmed 5279 records to 4427 (keeping 200 days of data) [2025-11-03T19:10:31.556426] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-11-03T19:10:31.556556] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-11-03T19:10:31.569448] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-11-03T19:10:31.573008] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-11-03T19:10:31.775168] [DEBUG] [LOCAL ] GHLD: Primary data saved (4427 records). [2025-11-03T19:10:31.825477] [INFO ] [MAIN ] GHLD: Full history saved. [2025-11-03T19:10:31.859345] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GHLD took 39.8s. Estimated remaining: 3h 20m 45s. Rate: 7.1 symbols/min [2025-11-03T19:10:31.944222] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-11-03T19:10:32.108029] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:32.184700] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:32.206271] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T19:10:32.261183] [DEBUG] [LOCAL ] GIS: Loaded 54455 existing records from primary storage. [2025-11-03T19:10:32.261561] [INFO ] [MAIN ] GIS: Loaded 54455 existing records. [2025-11-03T19:10:32.442174] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:32.442409] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-11-03T19:10:32.442456] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-11-03T19:10:32.443435] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-11-03T19:10:32.443492] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-11-03T19:10:32.736627] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-11-03T19:10:32.808300] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:32.823393] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-11-03T19:10:33.534863] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-11-03T19:10:33.887392] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:10:34.274358] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-11-03T19:10:34.334816] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-11-03T19:10:34.926986] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-11-03T19:10:35.134900] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-11-03T19:10:35.934917] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-11-03T19:10:36.473632] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:10:36.734918] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-11-03T19:10:36.869041] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-11-03T19:10:37.211760] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T19:10:37.534844] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-11-03T19:10:38.121332] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T19:10:38.334933] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-11-03T19:10:39.038235] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T19:10:39.134936] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-11-03T19:10:39.754255] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T19:10:39.934853] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-11-03T19:10:40.550907] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T19:10:40.734867] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-11-03T19:10:41.534833] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-11-03T19:10:41.679486] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T19:10:42.334923] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-11. [2025-11-03T19:10:42.696771] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:10:42.857831] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-11 (0.52 seconds). [2025-11-03T19:10:42.858760] [INFO ] [REMOTE ] GIC: Full fetch complete (19922 records). [2025-11-03T19:10:42.858831] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-11-03T19:10:43.140074] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-11-03T19:10:43.230092] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-11-03T19:10:43.230168] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-11-03T19:10:43.230571] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-11-03T19:10:43.230609] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-11-03T19:10:43.231141] [DEBUG] [LOCAL ] GIC: Trimmed 19922 records to 13224 (keeping 200 days of data) [2025-11-03T19:10:43.307332] [DEBUG] [LOCAL ] GIC: Primary data saved (13224 records). [2025-11-03T19:10:43.307513] [INFO ] [MAIN ] GIC: Full history saved. [2025-11-03T19:10:43.307590] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GIC took 17.5s. Estimated remaining: 3h 20m 41s. Rate: 7.1 symbols/min [2025-11-03T19:10:43.473744] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:43.511054] [DEBUG] [LOCAL ] GKOS: Loaded 43144 existing records from primary storage. [2025-11-03T19:10:43.511379] [INFO ] [MAIN ] GKOS: Loaded 43144 existing records. [2025-11-03T19:10:43.696071] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:43.696497] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-11-03T19:10:43.696557] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-11-03T19:10:43.697322] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-11-03T19:10:43.697409] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-11-03T19:10:43.940043] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-11-03T19:10:44.058032] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:44.141561] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T19:10:44.734886] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-11. [2025-11-03T19:10:45.365290] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T19:10:45.534857] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-11-03T19:10:45.540476] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:10:45.541952] [INFO ] [REMOTE ] GIB: Full fetch complete (46746 records). [2025-11-03T19:10:45.542036] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-11-03T19:10:45.935308] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-11-03T19:10:45.935466] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-11-03T19:10:45.936219] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-11-03T19:10:45.936287] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-11-03T19:10:45.937402] [DEBUG] [LOCAL ] GIB: Trimmed 46746 records to 30852 (keeping 200 days of data) [2025-11-03T19:10:46.124783] [DEBUG] [LOCAL ] GIB: Primary data saved (30852 records). [2025-11-03T19:10:46.124919] [INFO ] [MAIN ] GIB: Full history saved. [2025-11-03T19:10:46.125001] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GIB took 43.4s. Estimated remaining: 3h 20m 24s. Rate: 7.1 symbols/min [2025-11-03T19:10:46.299037] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:10:46.335995] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-11-03T19:10:46.338017] [DEBUG] [LOCAL ] GL: Loaded 37656 existing records from primary storage. [2025-11-03T19:10:46.338323] [INFO ] [MAIN ] GL: Loaded 37656 existing records. [2025-11-03T19:10:46.557726] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:10:46.558035] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-11-03T19:10:46.558115] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-11-03T19:10:46.558967] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-11-03T19:10:46.559028] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-11-03T19:10:46.951290] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T19:10:46.956472] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:10:47.134853] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-11-03T19:10:47.903913] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-11-03T19:10:47.934821] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-11-03T19:10:48.146781] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T19:10:48.734894] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-11-03T19:10:49.405209] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:10:49.534852] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-11-03T19:10:49.697963] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T19:10:50.334857] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-11-03T19:10:50.907065] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T19:10:51.134878] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-11-03T19:10:51.288843] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-11-03T19:10:51.934918] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-11-03T19:10:52.601050] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T19:10:52.734872] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-11-03T19:10:52.902494] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T19:10:53.534962] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-11-03T19:10:54.222631] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-11-03T19:10:54.334842] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-11-03T19:10:54.695510] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T19:10:55.134857] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-11-03T19:10:55.898716] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T19:10:55.934805] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-11-03T19:10:56.155558] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T19:10:56.734916] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-11-03T19:10:57.534833] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-11-03T19:10:57.781898] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-11-03T19:10:57.834601] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T19:10:58.334866] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-11-03T19:10:58.745295] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:10:59.134884] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-11-03T19:10:59.525842] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T19:10:59.934850] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-11-03T19:11:00.212837] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T19:11:00.734850] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-11-03T19:11:01.055538] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T19:11:01.534859] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-11-03T19:11:01.734324] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T19:11:02.334856] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-11. [2025-11-03T19:11:02.713212] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T19:11:03.134850] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-11-03T19:11:03.693087] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-11 (1.36 seconds). [2025-11-03T19:11:03.694594] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-11-03T19:11:03.694737] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-11-03T19:11:03.939981] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-11-03T19:11:04.090975] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-11-03T19:11:04.091055] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-11-03T19:11:04.091962] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-11-03T19:11:04.092024] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-11-03T19:11:04.093374] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53677 (keeping 200 days of data) [2025-11-03T19:11:04.415849] [DEBUG] [LOCAL ] GIS: Primary data saved (53677 records). [2025-11-03T19:11:04.416062] [INFO ] [MAIN ] GIS: Full history saved. [2025-11-03T19:11:04.416280] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GIS took 32.5s. Estimated remaining: 3h 20m 31s. Rate: 7.1 symbols/min [2025-11-03T19:11:04.590145] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:04.615203] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T19:11:04.661229] [DEBUG] [LOCAL ] GLOB: Loaded 48768 existing records from primary storage. [2025-11-03T19:11:04.661511] [INFO ] [MAIN ] GLOB: Loaded 48768 existing records. [2025-11-03T19:11:04.739958] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-11-03T19:11:04.838679] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:04.838871] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-11-03T19:11:04.838919] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-11-03T19:11:04.839713] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-11-03T19:11:04.839771] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-11-03T19:11:05.199559] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:05.224599] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T19:11:05.534854] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-11-03T19:11:06.020244] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T19:11:06.334860] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-11-03T19:11:06.652438] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-11-03T19:11:07.134922] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-11-03T19:11:07.349790] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T19:11:07.934926] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-11-03T19:11:08.242739] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-11-03T19:11:08.734853] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-11-03T19:11:09.176121] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:11:09.534837] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-11-03T19:11:09.684058] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T19:11:10.334888] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-11-03T19:11:10.613131] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T19:11:11.134914] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-11-03T19:11:11.519096] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T19:11:11.934870] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-11-03T19:11:12.087140] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T19:11:12.734867] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-11. [2025-11-03T19:11:13.100538] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:11:13.534918] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-11-03T19:11:13.872317] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:11:13.873824] [INFO ] [REMOTE ] GIL: Full fetch complete (62927 records). [2025-11-03T19:11:13.873936] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-11-03T19:11:14.274128] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-11-03T19:11:14.274217] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-11-03T19:11:14.275050] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-11-03T19:11:14.275128] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-11-03T19:11:14.276480] [DEBUG] [LOCAL ] GIL: Trimmed 62927 records to 43941 (keeping 200 days of data) [2025-11-03T19:11:14.338033] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-11-03T19:11:14.538462] [DEBUG] [LOCAL ] GIL: Primary data saved (43941 records). [2025-11-03T19:11:14.538592] [INFO ] [MAIN ] GIL: Full history saved. [2025-11-03T19:11:14.539279] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIL took 43.8s. Estimated remaining: 3h 20m 25s. Rate: 7.1 symbols/min [2025-11-03T19:11:14.732725] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:14.761760] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T19:11:14.775073] [DEBUG] [LOCAL ] GLP: Loaded 9170 existing records from primary storage. [2025-11-03T19:11:14.775693] [INFO ] [MAIN ] GLP: Loaded 9170 existing records. [2025-11-03T19:11:14.950318] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:14.950551] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-11-03T19:11:14.950597] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-11-03T19:11:14.950859] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-11-03T19:11:14.950914] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-11-03T19:11:15.136388] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-11-03T19:11:15.334678] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:15.434345] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T19:11:15.934889] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-11-03T19:11:16.159089] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T19:11:16.734928] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-11-03T19:11:16.993587] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T19:11:17.534957] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-11-03T19:11:17.882088] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T19:11:18.334884] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-11-03T19:11:18.671926] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T19:11:19.134879] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-11. [2025-11-03T19:11:19.590330] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T19:11:19.934873] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-11-03T19:11:20.006948] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:11:20.008346] [INFO ] [REMOTE ] GL: Full fetch complete (54871 records). [2025-11-03T19:11:20.008431] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-11-03T19:11:20.391054] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-11-03T19:11:20.391137] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-11-03T19:11:20.391889] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-11-03T19:11:20.391950] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-11-03T19:11:20.393175] [DEBUG] [LOCAL ] GL: Trimmed 54871 records to 37187 (keeping 200 days of data) [2025-11-03T19:11:20.616474] [DEBUG] [LOCAL ] GL: Primary data saved (37187 records). [2025-11-03T19:11:20.616606] [INFO ] [MAIN ] GL: Full history saved. [2025-11-03T19:11:20.617467] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GL took 34.5s. Estimated remaining: 3h 20m 13s. Rate: 7.1 symbols/min [2025-11-03T19:11:20.740101] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-11-03T19:11:20.787901] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:20.836551] [DEBUG] [LOCAL ] GLW: Loaded 54415 existing records from primary storage. [2025-11-03T19:11:20.836887] [INFO ] [MAIN ] GLW: Loaded 54415 existing records. [2025-11-03T19:11:21.019427] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:21.019745] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-11-03T19:11:21.019799] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-11-03T19:11:21.020687] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-11-03T19:11:21.020745] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-11-03T19:11:21.394363] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:21.401804] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-11-03T19:11:21.440976] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T19:11:21.534815] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-11-03T19:11:22.334896] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-11-03T19:11:22.706796] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:11:23.134868] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-11-03T19:11:23.832121] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-11-03T19:11:23.934850] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-11-03T19:11:24.430441] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T19:11:24.734899] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-11-03T19:11:25.205917] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T19:11:25.534845] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-11-03T19:11:26.021471] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T19:11:26.334928] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-11-03T19:11:26.773627] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T19:11:26.839128] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T19:11:27.134900] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-11-03T19:11:27.646726] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T19:11:27.934907] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-11-03T19:11:28.734860] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-11-03T19:11:29.112088] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T19:11:29.270267] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T19:11:29.534863] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-11-03T19:11:30.055247] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-11-03T19:11:30.334877] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-11-03T19:11:31.134923] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-11. [2025-11-03T19:11:31.790263] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T19:11:31.934905] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-11-03T19:11:32.126274] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:11:32.127632] [INFO ] [REMOTE ] GKOS: Full fetch complete (61029 records). [2025-11-03T19:11:32.127752] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-11-03T19:11:32.507407] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-11-03T19:11:32.507540] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-11-03T19:11:32.508420] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-11-03T19:11:32.508489] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-11-03T19:11:32.509775] [DEBUG] [LOCAL ] GKOS: Trimmed 61029 records to 42499 (keeping 200 days of data) [2025-11-03T19:11:32.738930] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-11-03T19:11:32.784114] [DEBUG] [LOCAL ] GKOS: Primary data saved (42499 records). [2025-11-03T19:11:32.784262] [INFO ] [MAIN ] GKOS: Full history saved. [2025-11-03T19:11:32.784348] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GKOS took 49.5s. Estimated remaining: 3h 20m 10s. Rate: 7.1 symbols/min [2025-11-03T19:11:32.972231] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:33.018845] [DEBUG] [LOCAL ] GM: Loaded 54509 existing records from primary storage. [2025-11-03T19:11:33.019174] [INFO ] [MAIN ] GM: Loaded 54509 existing records. [2025-11-03T19:11:33.198378] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:33.198727] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-11-03T19:11:33.198869] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-11-03T19:11:33.199756] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-11-03T19:11:33.199814] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-11-03T19:11:33.436416] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T19:11:33.535196] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-11-03T19:11:33.594883] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:33.635499] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-11-03T19:11:34.334868] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-11-03T19:11:34.925433] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T19:11:35.134895] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-11-03T19:11:35.594425] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T19:11:35.934859] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-11-03T19:11:36.741129] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-11. [2025-11-03T19:11:36.760100] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-11-03T19:11:37.278011] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:11:37.534857] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-11-03T19:11:37.888038] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-11 (1.15 seconds). [2025-11-03T19:11:37.890118] [INFO ] [REMOTE ] GLOB: Full fetch complete (67107 records). [2025-11-03T19:11:37.890268] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-11-03T19:11:38.277456] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-11-03T19:11:38.277538] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-11-03T19:11:38.278391] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-11-03T19:11:38.278456] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-11-03T19:11:38.279856] [DEBUG] [LOCAL ] GLOB: Trimmed 67107 records to 48191 (keeping 200 days of data) [2025-11-03T19:11:38.337553] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-11-03T19:11:38.558301] [DEBUG] [LOCAL ] GLOB: Primary data saved (48191 records). [2025-11-03T19:11:38.558428] [INFO ] [MAIN ] GLOB: Full history saved. [2025-11-03T19:11:38.558503] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GLOB took 34.1s. Estimated remaining: 3h 19m 58s. Rate: 7.1 symbols/min [2025-11-03T19:11:38.725986] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:38.777719] [DEBUG] [LOCAL ] GME: Loaded 54554 existing records from primary storage. [2025-11-03T19:11:38.778035] [INFO ] [MAIN ] GME: Loaded 54554 existing records. [2025-11-03T19:11:38.963094] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:38.963380] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-11-03T19:11:38.963487] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-11-03T19:11:38.964430] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-11-03T19:11:38.964492] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-11-03T19:11:39.146302] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-11-03T19:11:39.182548] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-11-03T19:11:39.393228] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:39.641873] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-11-03T19:11:39.888841] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-11-03T19:11:39.934868] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-11-03T19:11:40.734858] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-11-03T19:11:41.537016] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-11-03T19:11:41.543108] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T19:11:42.334928] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-11-03T19:11:42.762206] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-11-03T19:11:42.831986] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T19:11:43.134836] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-11-03T19:11:43.233573] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-11-03T19:11:43.670735] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T19:11:43.934917] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-11-03T19:11:44.487918] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T19:11:44.734882] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-11-03T19:11:45.534880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-11-03T19:11:46.334913] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-11. [2025-11-03T19:11:46.466742] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-11-03T19:11:46.866975] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-11 (0.53 seconds). [2025-11-03T19:11:46.870917] [INFO ] [REMOTE ] GLP: Full fetch complete (14127 records). [2025-11-03T19:11:46.871010] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-11-03T19:11:47.146006] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-11-03T19:11:47.297755] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-11-03T19:11:47.297914] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-11-03T19:11:47.298313] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-11-03T19:11:47.298392] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-11-03T19:11:47.299299] [DEBUG] [LOCAL ] GLP: Trimmed 14127 records to 9064 (keeping 200 days of data) [2025-11-03T19:11:47.370875] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-11-03T19:11:47.391730] [DEBUG] [LOCAL ] GLP: Primary data saved (9064 records). [2025-11-03T19:11:47.391833] [INFO ] [MAIN ] GLP: Full history saved. [2025-11-03T19:11:47.391905] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GLP took 32.9s. Estimated remaining: 3h 19m 50s. Rate: 7.1 symbols/min [2025-11-03T19:11:47.556155] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:47.598950] [DEBUG] [LOCAL ] GMED: Loaded 48725 existing records from primary storage. [2025-11-03T19:11:47.599255] [INFO ] [MAIN ] GMED: Loaded 48725 existing records. [2025-11-03T19:11:47.774806] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:47.775057] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-11-03T19:11:47.775168] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-11-03T19:11:47.775924] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-11-03T19:11:47.775981] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-11-03T19:11:47.945195] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-11-03T19:11:48.131612] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:48.734858] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-11-03T19:11:49.184589] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-11-03T19:11:49.521292] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-11-03T19:11:49.534816] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-11-03T19:11:50.334907] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-11. [2025-11-03T19:11:50.614546] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-11-03T19:11:50.909279] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T19:11:51.134828] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-11-03T19:11:51.777956] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-11 (1.44 seconds). [2025-11-03T19:11:51.779515] [INFO ] [REMOTE ] GLW: Full fetch complete (77802 records). [2025-11-03T19:11:51.779628] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-11-03T19:11:51.938155] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-11-03T19:11:52.172256] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-11-03T19:11:52.172340] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-11-03T19:11:52.173274] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-11-03T19:11:52.173338] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-11-03T19:11:52.174730] [DEBUG] [LOCAL ] GLW: Trimmed 77802 records to 53636 (keeping 200 days of data) [2025-11-03T19:11:52.487868] [DEBUG] [LOCAL ] GLW: Primary data saved (53636 records). [2025-11-03T19:11:52.487991] [INFO ] [MAIN ] GLW: Full history saved. [2025-11-03T19:11:52.488908] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GLW took 31.9s. Estimated remaining: 3h 19m 37s. Rate: 7.1 symbols/min [2025-11-03T19:11:52.652232] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:11:52.684856] [DEBUG] [LOCAL ] GMRE: Loaded 35602 existing records from primary storage. [2025-11-03T19:11:52.685134] [INFO ] [MAIN ] GMRE: Loaded 35602 existing records. [2025-11-03T19:11:52.746667] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-11-03T19:11:52.863338] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:11:52.863534] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-11-03T19:11:52.863593] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-11-03T19:11:52.864192] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-11-03T19:11:52.864251] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-11-03T19:11:53.218752] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:11:53.252100] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-11-03T19:11:53.287110] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T19:11:53.534883] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-11-03T19:11:54.334827] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-11-03T19:11:54.421785] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-11-03T19:11:55.134857] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-11-03T19:11:55.334418] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-11-03T19:11:55.368328] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T19:11:55.934849] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-11-03T19:11:56.298375] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:11:56.734816] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-11-03T19:11:56.844200] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T19:11:57.534850] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-11-03T19:11:58.032459] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T19:11:58.334838] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-11-03T19:11:58.373010] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T19:11:59.134870] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-11-03T19:11:59.934912] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-11-03T19:12:00.252370] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-11-03T19:12:00.542341] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T19:12:00.734849] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-11-03T19:12:01.205610] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T19:12:01.534844] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-11-03T19:12:01.792297] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T19:12:02.334857] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-11-03T19:12:02.662570] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T19:12:03.134865] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-11-03T19:12:03.934929] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-11-03T19:12:04.270739] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-11-03T19:12:04.334109] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T19:12:04.734942] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-11-03T19:12:05.086247] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T19:12:05.534852] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-11-03T19:12:06.334822] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-11-03T19:12:06.536398] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-11-03T19:12:06.596278] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T19:12:07.134833] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-11-03T19:12:07.870610] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T19:12:07.934868] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-11-03T19:12:08.438536] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T19:12:08.734858] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-11-03T19:12:09.499763] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T19:12:09.534819] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-11. [2025-11-03T19:12:10.334863] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-11-03T19:12:10.570410] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-11-03T19:12:10.941351] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-11 (1.41 seconds). [2025-11-03T19:12:10.943332] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-11-03T19:12:10.943456] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-11-03T19:12:11.148701] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-11-03T19:12:11.356114] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-11-03T19:12:11.356296] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-11-03T19:12:11.357287] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-11-03T19:12:11.357434] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-11-03T19:12:11.366602] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-11-03T19:12:11.382428] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T19:12:11.703636] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-11-03T19:12:11.703789] [INFO ] [MAIN ] GM: Full history saved. [2025-11-03T19:12:11.703866] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GM took 38.9s. Estimated remaining: 3h 19m 44s. Rate: 7.1 symbols/min [2025-11-03T19:12:11.879133] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:12:11.879312] [DEBUG] [LOCAL ] GNE: No existing data file found in primary storage. [2025-11-03T19:12:11.879348] [WARN ] [MAIN ] GNE: No existing data found, performing full refresh instead. [2025-11-03T19:12:11.879463] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-11-03T19:12:11.879503] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-11-03T19:12:11.879543] [DEBUG] [LOCAL ] GNE: No primary data file found to delete. [2025-11-03T19:12:11.879574] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-11-03T19:12:11.941535] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-11-03T19:12:12.248836] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:12:12.452179] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T19:12:12.734887] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-11-03T19:12:12.910425] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T19:12:13.129138] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-11-03T19:12:13.534854] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-11-03T19:12:14.334870] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-11-03T19:12:15.134857] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-11-03T19:12:15.432014] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:12:15.557594] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-11-03T19:12:15.934866] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-11-03T19:12:16.306861] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T19:12:16.486113] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-11-03T19:12:16.734865] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-11-03T19:12:17.353527] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-11-03T19:12:17.534851] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-11-03T19:12:18.099567] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-11-03T19:12:18.334906] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-11-03T19:12:19.136283] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-11. [2025-11-03T19:12:19.138638] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-11-03T19:12:19.934893] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-11. [2025-11-03T19:12:20.600070] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-11 (0.67 seconds). [2025-11-03T19:12:20.601620] [INFO ] [REMOTE ] GMRE: Full fetch complete (50598 records). [2025-11-03T19:12:20.601746] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-11-03T19:12:20.740133] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-11-03T19:12:20.944785] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-11 (1.81 seconds). [2025-11-03T19:12:20.967713] [INFO ] [REMOTE ] GME: Full fetch complete (77917 records). [2025-11-03T19:12:20.983363] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-11-03T19:12:21.159184] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-11-03T19:12:21.176155] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-11-03T19:12:21.177712] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-11-03T19:12:21.177811] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-11-03T19:12:21.205964] [DEBUG] [LOCAL ] GMRE: Trimmed 50598 records to 34870 (keeping 200 days of data) [2025-11-03T19:12:21.536751] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-11-03T19:12:21.667178] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T19:12:21.667810] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-11-03T19:12:21.668147] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-11-03T19:12:21.677544] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-11-03T19:12:21.685711] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-11-03T19:12:21.762742] [DEBUG] [LOCAL ] GME: Trimmed 77917 records to 53774 (keeping 200 days of data) [2025-11-03T19:12:21.878080] [DEBUG] [LOCAL ] GMRE: Primary data saved (34870 records). [2025-11-03T19:12:21.889538] [INFO ] [MAIN ] GMRE: Full history saved. [2025-11-03T19:12:21.893526] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GMRE took 29.4s. Estimated remaining: 3h 19m 39s. Rate: 7.1 symbols/min [2025-11-03T19:12:22.164285] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:12:22.301359] [DEBUG] [LOCAL ] GME: Primary data saved (53774 records). [2025-11-03T19:12:22.301472] [INFO ] [MAIN ] GME: Full history saved. [2025-11-03T19:12:22.301582] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GME took 43.7s. Estimated remaining: 3h 19m 18s. Rate: 7.1 symbols/min [2025-11-03T19:12:22.301280] [DEBUG] [LOCAL ] GNK: Loaded 39232 existing records from primary storage. [2025-11-03T19:12:22.322792] [INFO ] [MAIN ] GNK: Loaded 39232 existing records. [2025-11-03T19:12:22.350064] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-11-03T19:12:22.653547] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:12:22.656780] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:12:22.657043] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-11-03T19:12:22.657429] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-11-03T19:12:22.658458] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-11-03T19:12:22.658546] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-11-03T19:12:22.975287] [DEBUG] [LOCAL ] GNL: Loaded 46754 existing records from primary storage. [2025-11-03T19:12:22.986181] [INFO ] [MAIN ] GNL: Loaded 46754 existing records. [2025-11-03T19:12:23.121495] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:12:23.144729] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-11-03T19:12:23.244944] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:12:23.263144] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-11-03T19:12:23.263436] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-11-03T19:12:23.265519] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-11-03T19:12:23.265590] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-11-03T19:12:23.265899] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-11-03T19:12:23.455286] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T19:12:23.654505] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:12:23.934820] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-11. [2025-11-03T19:12:24.014404] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T19:12:24.734862] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-11-03T19:12:24.963220] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T19:12:24.965543] [INFO ] [REMOTE ] GMED: Full fetch complete (70038 records). [2025-11-03T19:12:24.965736] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-11-03T19:12:25.368075] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-11-03T19:12:25.368145] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-11-03T19:12:25.369006] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-11-03T19:12:25.369068] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-11-03T19:12:25.370452] [DEBUG] [LOCAL ] GMED: Trimmed 70038 records to 48051 (keeping 200 days of data) [2025-11-03T19:12:25.538956] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-11-03T19:12:25.643724] [DEBUG] [LOCAL ] GMED: Primary data saved (48051 records). [2025-11-03T19:12:25.643841] [INFO ] [MAIN ] GMED: Full history saved. [2025-11-03T19:12:25.644636] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GMED took 38.3s. Estimated remaining: 3h 19m 2s. Rate: 7.1 symbols/min [2025-11-03T19:12:25.781257] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T19:12:25.839190] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:12:25.881297] [DEBUG] [LOCAL ] GNRC: Loaded 45935 existing records from primary storage. [2025-11-03T19:12:25.881575] [INFO ] [MAIN ] GNRC: Loaded 45935 existing records. [2025-11-03T19:12:26.067120] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:12:26.067390] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-11-03T19:12:26.067452] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-11-03T19:12:26.068228] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-11-03T19:12:26.068288] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-11-03T19:12:26.344446] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-11-03T19:12:26.428817] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:12:26.443800] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T19:12:27.134939] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-11-03T19:12:27.579690] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T19:12:27.934924] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-11-03T19:12:28.295949] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T19:12:28.701559] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T19:12:28.734920] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-11-03T19:12:29.389183] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-11-03T19:12:29.534849] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-11-03T19:12:30.334857] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-11-03T19:12:30.511195] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T19:12:31.134839] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-11-03T19:12:31.599291] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T19:12:31.934864] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-11-03T19:12:32.319159] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T19:12:32.734868] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-11-03T19:12:32.959675] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T19:12:33.534874] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-11-03T19:12:33.911479] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T19:12:34.334880] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-11-03T19:12:34.719894] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T19:12:35.134903] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-11-03T19:12:35.559701] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T19:12:35.584120] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-11-03T19:12:35.934865] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-11. [2025-11-03T19:12:36.500730] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T19:12:36.501678] [INFO ] [REMOTE ] GNE: Full fetch complete (22741 records). [2025-11-03T19:12:36.501749] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-11-03T19:12:36.743269] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-11-03T19:12:36.865341] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-11-03T19:12:36.865409] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-11-03T19:12:36.865912] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-11-03T19:12:36.865972] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-11-03T19:12:36.866539] [DEBUG] [LOCAL ] GNE: Trimmed 22741 records to 18286 (keeping 200 days of data) [2025-11-03T19:12:36.972224] [DEBUG] [LOCAL ] GNE: Primary data saved (18286 records). [2025-11-03T19:12:36.972345] [INFO ] [MAIN ] GNE: Full history saved. [2025-11-03T19:12:36.972411] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GNE took 25.3s. Estimated remaining: 3h 18m 58s. Rate: 7.1 symbols/min [2025-11-03T19:12:37.140819] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:12:37.149721] [DEBUG] [LOCAL ] GNT: Loaded 8714 existing records from primary storage. [2025-11-03T19:12:37.149907] [INFO ] [MAIN ] GNT: Loaded 8714 existing records. [2025-11-03T19:12:37.342396] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:12:37.342603] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-11-03T19:12:37.342677] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-11-03T19:12:37.342968] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-11-03T19:12:37.343025] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-11-03T19:12:37.542393] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-11-03T19:12:37.706516] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:12:37.855608] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:12:38.334914] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-11-03T19:12:38.873099] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:12:39.134830] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-11-03T19:12:39.332438] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T19:12:39.508116] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-11-03T19:12:39.934847] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-11-03T19:12:40.734850] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-11-03T19:12:41.023895] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T19:12:41.170819] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-11-03T19:12:41.534866] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-11-03T19:12:41.896543] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-11-03T19:12:42.334857] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-11-03T19:12:42.841289] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T19:12:43.134871] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-11-03T19:12:43.934859] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-11-03T19:12:44.255498] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-11-03T19:12:44.734925] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-11-03T19:12:45.100779] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T19:12:45.534901] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-11-03T19:12:45.988089] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:12:46.334850] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-11-03T19:12:46.668228] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:12:47.134845] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-11-03T19:12:47.360136] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:12:47.934854] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-11-03T19:12:48.402080] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T19:12:48.734856] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-11-03T19:12:49.148202] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:12:49.194592] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-11-03T19:12:49.534840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-11-03T19:12:50.334858] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-11-03T19:12:50.761314] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T19:12:51.134901] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-11-03T19:12:51.391614] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T19:12:51.560745] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-11-03T19:12:51.934850] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-11-03T19:12:52.465739] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-11-03T19:12:52.734863] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-11-03T19:12:53.534913] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-11-03T19:12:53.799860] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T19:12:53.884360] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-11-03T19:12:54.334859] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-11-03T19:12:55.134898] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-11-03T19:12:55.546901] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T19:12:55.934907] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-11-03T19:12:56.230669] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:12:56.475084] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T19:12:56.734889] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-11-03T19:12:57.268016] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-11-03T19:12:57.534879] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-11-03T19:12:58.334839] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-11. [2025-11-03T19:12:58.577604] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-11-03T19:12:58.816098] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-11 (0.48 seconds). [2025-11-03T19:12:58.817218] [INFO ] [REMOTE ] GNT: Full fetch complete (11557 records). [2025-11-03T19:12:58.817293] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-11-03T19:12:59.140030] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-11. [2025-11-03T19:12:59.203755] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-11-03T19:12:59.203881] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-11-03T19:12:59.204633] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-11-03T19:12:59.204726] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-11-03T19:12:59.205430] [DEBUG] [LOCAL ] GNT: Trimmed 11557 records to 8509 (keeping 200 days of data) [2025-11-03T19:12:59.262699] [DEBUG] [LOCAL ] GNT: Primary data saved (8509 records). [2025-11-03T19:12:59.262916] [INFO ] [MAIN ] GNT: Full history saved. [2025-11-03T19:12:59.263027] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNT took 22.3s. Estimated remaining: 3h 19m 11s. Rate: 7.1 symbols/min [2025-11-03T19:12:59.445257] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:12:59.502382] [DEBUG] [LOCAL ] GNW: Loaded 51966 existing records from primary storage. [2025-11-03T19:12:59.502780] [INFO ] [MAIN ] GNW: Loaded 51966 existing records. [2025-11-03T19:12:59.687246] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:12:59.687520] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-11-03T19:12:59.687581] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-11-03T19:12:59.688487] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-11-03T19:12:59.688551] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-11-03T19:12:59.940621] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-11. [2025-11-03T19:12:59.987996] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-11 (0.85 seconds). [2025-11-03T19:13:00.029501] [INFO ] [REMOTE ] GNK: Full fetch complete (56996 records). [2025-11-03T19:13:00.041159] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-11-03T19:13:00.080337] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:00.465274] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-11-03T19:13:00.465365] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-11-03T19:13:00.466212] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-11-03T19:13:00.466277] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-11-03T19:13:00.467506] [DEBUG] [LOCAL ] GNK: Trimmed 56996 records to 38519 (keeping 200 days of data) [2025-11-03T19:13:00.692705] [DEBUG] [LOCAL ] GNK: Primary data saved (38519 records). [2025-11-03T19:13:00.692862] [INFO ] [MAIN ] GNK: Full history saved. [2025-11-03T19:13:00.693772] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GNK took 38.8s. Estimated remaining: 3h 18m 52s. Rate: 7.1 symbols/min [2025-11-03T19:13:00.742511] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-11-03T19:13:00.871054] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:00.913106] [DEBUG] [LOCAL ] GOF: Loaded 43447 existing records from primary storage. [2025-11-03T19:13:00.913415] [INFO ] [MAIN ] GOF: Loaded 43447 existing records. [2025-11-03T19:13:01.018449] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-11 (1.08 seconds). [2025-11-03T19:13:01.046088] [INFO ] [REMOTE ] GNL: Full fetch complete (67840 records). [2025-11-03T19:13:01.068693] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-11-03T19:13:01.130491] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:01.169670] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-11-03T19:13:01.194733] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-11-03T19:13:01.211327] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-11-03T19:13:01.221637] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-11-03T19:13:01.537387] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-11-03T19:13:01.825588] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-11-03T19:13:01.825734] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-11-03T19:13:01.826749] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-11-03T19:13:01.832465] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-11-03T19:13:01.908237] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:01.909862] [DEBUG] [LOCAL ] GNL: Trimmed 67840 records to 45955 (keeping 200 days of data) [2025-11-03T19:13:02.209428] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T19:13:02.279597] [DEBUG] [LOCAL ] GNL: Primary data saved (45955 records). [2025-11-03T19:13:02.279764] [INFO ] [MAIN ] GNL: Full history saved. [2025-11-03T19:13:02.279853] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNL took 40.0s. Estimated remaining: 3h 18m 33s. Rate: 7.1 symbols/min [2025-11-03T19:13:02.343575] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-11-03T19:13:02.476400] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:02.508570] [DEBUG] [LOCAL ] GOLF: Loaded 29941 existing records from primary storage. [2025-11-03T19:13:02.508918] [INFO ] [MAIN ] GOLF: Loaded 29941 existing records. [2025-11-03T19:13:02.738581] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:02.738895] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-11-03T19:13:02.738969] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-11-03T19:13:02.739723] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-11-03T19:13:02.739805] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-11-03T19:13:03.139551] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-11-03T19:13:03.219132] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:03.253283] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-11-03T19:13:03.570284] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T19:13:03.934865] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-11-03T19:13:04.412207] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T19:13:04.563426] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-11-03T19:13:04.734896] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-11-03T19:13:05.534847] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-11-03T19:13:06.063374] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T19:13:06.334874] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-11-03T19:13:06.782508] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-11-03T19:13:07.134871] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-11. [2025-11-03T19:13:07.260745] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-11-03T19:13:07.934874] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-11-03T19:13:08.190820] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:13:08.192848] [INFO ] [REMOTE ] GNRC: Full fetch complete (65927 records). [2025-11-03T19:13:08.193011] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-11-03T19:13:08.631093] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-11-03T19:13:08.631186] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-11-03T19:13:08.632190] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-11-03T19:13:08.632259] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-11-03T19:13:08.633709] [DEBUG] [LOCAL ] GNRC: Trimmed 65927 records to 45302 (keeping 200 days of data) [2025-11-03T19:13:08.745015] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-11-03T19:13:08.933267] [DEBUG] [LOCAL ] GNRC: Primary data saved (45302 records). [2025-11-03T19:13:08.933421] [INFO ] [MAIN ] GNRC: Full history saved. [2025-11-03T19:13:08.933505] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GNRC took 43.3s. Estimated remaining: 3h 18m 22s. Rate: 7.1 symbols/min [2025-11-03T19:13:09.103076] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:09.141745] [DEBUG] [LOCAL ] GOOS: Loaded 44119 existing records from primary storage. [2025-11-03T19:13:09.142038] [INFO ] [MAIN ] GOOS: Loaded 44119 existing records. [2025-11-03T19:13:09.318446] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:09.318742] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-11-03T19:13:09.318817] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-11-03T19:13:09.319573] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-11-03T19:13:09.319635] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-11-03T19:13:09.451153] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T19:13:09.540437] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-11-03T19:13:09.716848] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:09.941823] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T19:13:10.334961] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-11-03T19:13:10.572488] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T19:13:11.134985] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-11-03T19:13:11.370277] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T19:13:11.934939] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-11-03T19:13:12.138873] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-11-03T19:13:12.734924] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-11-03T19:13:13.303741] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T19:13:13.534834] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-11-03T19:13:13.584035] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-11-03T19:13:14.334876] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-11-03T19:13:14.535326] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T19:13:15.134917] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-11-03T19:13:15.223766] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T19:13:15.934852] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-11-03T19:13:16.249061] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-11-03T19:13:16.734825] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-11-03T19:13:16.925589] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T19:13:17.534862] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-11-03T19:13:17.875967] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T19:13:18.334878] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-11-03T19:13:18.792495] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:13:19.134910] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-11-03T19:13:19.636293] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T19:13:19.934903] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-11-03T19:13:20.028484] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T19:13:20.734921] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-11-03T19:13:21.160777] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T19:13:21.534913] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-11-03T19:13:21.917789] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T19:13:22.334877] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-11-03T19:13:22.667927] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:13:23.134865] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-11-03T19:13:23.205384] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T19:13:23.934867] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-11-03T19:13:24.382614] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:13:24.734937] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-11-03T19:13:25.405542] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T19:13:25.534945] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-11-03T19:13:26.114672] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T19:13:26.334888] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-11-03T19:13:26.786235] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:13:27.134869] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-11-03T19:13:27.236002] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-11-03T19:13:27.934832] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-11. [2025-11-03T19:13:28.152974] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T19:13:28.588903] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T19:13:28.590220] [INFO ] [REMOTE ] GOLF: Full fetch complete (45273 records). [2025-11-03T19:13:28.590316] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-11-03T19:13:28.740010] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-11-03T19:13:29.005998] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-11-03T19:13:29.006120] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-11-03T19:13:29.007210] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-11-03T19:13:29.007281] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-11-03T19:13:29.009272] [DEBUG] [LOCAL ] GOLF: Trimmed 45273 records to 29269 (keeping 200 days of data) [2025-11-03T19:13:29.203737] [DEBUG] [LOCAL ] GOLF: Primary data saved (29269 records). [2025-11-03T19:13:29.203942] [INFO ] [MAIN ] GOLF: Full history saved. [2025-11-03T19:13:29.204075] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GOLF took 26.9s. Estimated remaining: 3h 18m 31s. Rate: 7.1 symbols/min [2025-11-03T19:13:29.378422] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:29.410042] [DEBUG] [LOCAL ] GOTU: Loaded 36971 existing records from primary storage. [2025-11-03T19:13:29.410320] [INFO ] [MAIN ] GOTU: Loaded 36971 existing records. [2025-11-03T19:13:29.548322] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-11-03T19:13:29.589071] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:29.589318] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-11-03T19:13:29.589368] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-11-03T19:13:29.589969] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-11-03T19:13:29.590028] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-11-03T19:13:29.956804] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:30.046766] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T19:13:30.334910] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-11-03T19:13:30.640392] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T19:13:31.134867] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-11. [2025-11-03T19:13:31.597044] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T19:13:31.934851] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-11-03T19:13:32.075591] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T19:13:32.076966] [INFO ] [REMOTE ] GOOS: Full fetch complete (64534 records). [2025-11-03T19:13:32.077072] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-11-03T19:13:32.482825] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-11-03T19:13:32.482922] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-11-03T19:13:32.483861] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-11-03T19:13:32.483925] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-11-03T19:13:32.485217] [DEBUG] [LOCAL ] GOOS: Trimmed 64534 records to 43452 (keeping 200 days of data) [2025-11-03T19:13:32.735638] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-11-03T19:13:32.735553] [DEBUG] [LOCAL ] GOOS: Primary data saved (43452 records). [2025-11-03T19:13:32.736612] [INFO ] [MAIN ] GOOS: Full history saved. [2025-11-03T19:13:32.737447] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GOOS took 23.8s. Estimated remaining: 3h 18m 16s. Rate: 7.1 symbols/min [2025-11-03T19:13:32.919174] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:32.963147] [DEBUG] [LOCAL ] GPC: Loaded 46337 existing records from primary storage. [2025-11-03T19:13:32.963432] [INFO ] [MAIN ] GPC: Loaded 46337 existing records. [2025-11-03T19:13:33.150414] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:33.150750] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-11-03T19:13:33.150917] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-11-03T19:13:33.151888] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-11-03T19:13:33.151950] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-11-03T19:13:33.298920] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T19:13:33.544120] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-11-03T19:13:33.549058] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:34.023751] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T19:13:34.334919] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-11-03T19:13:34.923762] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T19:13:35.134909] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-11-03T19:13:35.505540] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:13:35.934842] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-11-03T19:13:36.336502] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T19:13:36.734858] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-11-03T19:13:37.305206] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T19:13:37.534848] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-11. [2025-11-03T19:13:37.848032] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:13:38.334891] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-11-03T19:13:38.714221] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-11 (1.18 seconds). [2025-11-03T19:13:38.717036] [INFO ] [REMOTE ] GOF: Full fetch complete (63070 records). [2025-11-03T19:13:38.717285] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-11-03T19:13:39.133530] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-11-03T19:13:39.133611] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-11-03T19:13:39.134469] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-11-03T19:13:39.134545] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-11-03T19:13:39.134939] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-11-03T19:13:39.137906] [DEBUG] [LOCAL ] GOF: Trimmed 63070 records to 42832 (keeping 200 days of data) [2025-11-03T19:13:39.396259] [DEBUG] [LOCAL ] GOF: Primary data saved (42832 records). [2025-11-03T19:13:39.396381] [INFO ] [MAIN ] GOF: Full history saved. [2025-11-03T19:13:39.397143] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GOF took 38.7s. Estimated remaining: 3h 18m 5s. Rate: 7.1 symbols/min [2025-11-03T19:13:39.570919] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:39.586699] [DEBUG] [LOCAL ] GPI: Loaded 14978 existing records from primary storage. [2025-11-03T19:13:39.586929] [INFO ] [MAIN ] GPI: Loaded 14978 existing records. [2025-11-03T19:13:39.770476] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:39.771151] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-11-03T19:13:39.771403] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-11-03T19:13:39.771933] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-11-03T19:13:39.772012] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-11-03T19:13:39.923675] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T19:13:39.934863] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-11-03T19:13:40.215024] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:40.604864] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-11-03T19:13:40.734824] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-11-03T19:13:41.011027] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T19:13:41.534864] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-11-03T19:13:42.025134] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T19:13:42.334929] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-11-03T19:13:42.776235] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-11-03T19:13:43.134907] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-11-03T19:13:43.574167] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T19:13:43.758272] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T19:13:43.934910] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-11-03T19:13:44.734910] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-11-03T19:13:44.967555] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-11-03T19:13:45.534925] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-11. [2025-11-03T19:13:45.919222] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T19:13:46.334963] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-11-03T19:13:46.604074] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-11 (1.07 seconds). [2025-11-03T19:13:46.605570] [INFO ] [REMOTE ] GNW: Full fetch complete (73949 records). [2025-11-03T19:13:46.605719] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-11-03T19:13:46.995624] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-11-03T19:13:46.995752] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-11-03T19:13:46.996702] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-11-03T19:13:46.996769] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-11-03T19:13:46.998227] [DEBUG] [LOCAL ] GNW: Trimmed 73949 records to 51240 (keeping 200 days of data) [2025-11-03T19:13:47.155478] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-11-03T19:13:47.288114] [DEBUG] [LOCAL ] GNW: Primary data saved (51240 records). [2025-11-03T19:13:47.288252] [INFO ] [MAIN ] GNW: Full history saved. [2025-11-03T19:13:47.288347] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GNW took 48.0s. Estimated remaining: 3h 17m 55s. Rate: 7.1 symbols/min [2025-11-03T19:13:47.461221] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:13:47.466727] [DEBUG] [LOCAL ] GPJA: Loaded 4090 existing records from primary storage. [2025-11-03T19:13:47.466980] [INFO ] [MAIN ] GPJA: Loaded 4090 existing records. [2025-11-03T19:13:47.647205] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:13:47.647529] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-11-03T19:13:47.647603] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-11-03T19:13:47.647826] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-11-03T19:13:47.647881] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-11-03T19:13:47.921724] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-11-03T19:13:47.943176] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-11-03T19:13:48.038639] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:13:48.601129] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T19:13:48.617069] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T19:13:48.734847] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-11-03T19:13:49.534883] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-11-03T19:13:49.768829] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T19:13:50.073622] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-11-03T19:13:50.334938] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-11-03T19:13:51.134857] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-11-03T19:13:51.508315] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:13:51.934838] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-11-03T19:13:52.043987] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T19:13:52.734833] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-11-03T19:13:52.985117] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T19:13:53.474921] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-11-03T19:13:53.534872] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-11-03T19:13:54.184584] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T19:13:54.334855] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-11-03T19:13:55.141271] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-11-03T19:13:55.144511] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-11-03T19:13:55.485894] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T19:13:55.934831] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-11-03T19:13:56.734843] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-11-03T19:13:57.076977] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:13:57.090718] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-11-03T19:13:57.534848] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-11-03T19:13:58.334867] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-11-03T19:13:58.866606] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T19:13:59.134875] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-11-03T19:13:59.481978] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:13:59.497112] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-11-03T19:13:59.934887] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-11-03T19:14:00.734880] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-11. [2025-11-03T19:14:01.133187] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T19:14:01.534930] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-11-03T19:14:01.905013] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T19:14:01.906476] [INFO ] [REMOTE ] GPC: Full fetch complete (68465 records). [2025-11-03T19:14:01.906626] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-11-03T19:14:02.306093] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-11-03T19:14:02.306186] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-11-03T19:14:02.307191] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-11-03T19:14:02.307266] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-11-03T19:14:02.308628] [DEBUG] [LOCAL ] GPC: Trimmed 68465 records to 45698 (keeping 200 days of data) [2025-11-03T19:14:02.365964] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-11-03T19:14:02.644161] [DEBUG] [LOCAL ] GPC: Primary data saved (45698 records). [2025-11-03T19:14:02.644835] [INFO ] [MAIN ] GPC: Full history saved. [2025-11-03T19:14:02.645491] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T19:14:02.646606] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GPC took 29.9s. Estimated remaining: 3h 17m 57s. Rate: 7.1 symbols/min [2025-11-03T19:14:02.781679] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T19:14:02.854161] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:02.905096] [DEBUG] [LOCAL ] GPK: Loaded 53538 existing records from primary storage. [2025-11-03T19:14:02.905437] [INFO ] [MAIN ] GPK: Loaded 53538 existing records. [2025-11-03T19:14:03.088560] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:03.088791] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-11-03T19:14:03.088840] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-11-03T19:14:03.089721] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-11-03T19:14:03.089779] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-11-03T19:14:03.143239] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-11-03T19:14:03.451535] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:14:03.622318] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T19:14:03.934907] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-11-03T19:14:04.292579] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-11-03T19:14:04.734871] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-11-03T19:14:05.534867] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-11-03T19:14:05.730146] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T19:14:05.922015] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T19:14:06.334951] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-11-03T19:14:07.134930] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-11-03T19:14:07.575526] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-11-03T19:14:07.672938] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:14:07.934824] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-11-03T19:14:08.641268] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T19:14:08.734912] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-11. [2025-11-03T19:14:09.534903] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-11-03T19:14:09.557050] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T19:14:09.558977] [INFO ] [REMOTE ] GOTU: Full fetch complete (57615 records). [2025-11-03T19:14:09.559129] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-11-03T19:14:09.960702] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-11-03T19:14:09.960805] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-11-03T19:14:09.961699] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-11-03T19:14:09.961760] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-11-03T19:14:09.962793] [DEBUG] [LOCAL ] GOTU: Trimmed 57615 records to 36484 (keeping 200 days of data) [2025-11-03T19:14:10.155023] [DEBUG] [LOCAL ] GOTU: Primary data saved (36484 records). [2025-11-03T19:14:10.155148] [INFO ] [MAIN ] GOTU: Full history saved. [2025-11-03T19:14:10.155224] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GOTU took 41.0s. Estimated remaining: 3h 17m 48s. Rate: 7.1 symbols/min [2025-11-03T19:14:10.319435] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:10.334913] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-11-03T19:14:10.346390] [DEBUG] [LOCAL ] GPMT: Loaded 25509 existing records from primary storage. [2025-11-03T19:14:10.346697] [INFO ] [MAIN ] GPMT: Loaded 25509 existing records. [2025-11-03T19:14:10.564263] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:10.564535] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-11-03T19:14:10.564598] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-11-03T19:14:10.565198] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-11-03T19:14:10.565262] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-11-03T19:14:10.933831] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:14:10.964908] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T19:14:11.023026] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T19:14:11.134844] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-11-03T19:14:11.877206] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T19:14:11.934813] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-11-03T19:14:12.575138] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T19:14:12.734863] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-11-03T19:14:13.066237] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-11-03T19:14:13.534868] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-11-03T19:14:14.334912] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-11-03T19:14:14.765928] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T19:14:14.972945] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-11-03T19:14:15.134868] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-11-03T19:14:15.934851] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-11-03T19:14:15.975622] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-11-03T19:14:16.734900] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-11. [2025-11-03T19:14:17.187590] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:14:17.534953] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-11. [2025-11-03T19:14:17.645582] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T19:14:17.647168] [INFO ] [REMOTE ] GPI: Full fetch complete (22558 records). [2025-11-03T19:14:17.647330] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-11-03T19:14:18.029267] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-11 (0.49 seconds). [2025-11-03T19:14:18.041148] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-11-03T19:14:18.041300] [INFO ] [REMOTE ] GPJA: Full fetch complete (6535 records). [2025-11-03T19:14:18.041228] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-11-03T19:14:18.041917] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-11-03T19:14:18.042048] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-11-03T19:14:18.041999] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-11-03T19:14:18.128155] [DEBUG] [LOCAL ] GPI: Trimmed 22558 records to 14963 (keeping 200 days of data) [2025-11-03T19:14:18.338284] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-11-03T19:14:18.415474] [DEBUG] [LOCAL ] GPI: Primary data saved (14963 records). [2025-11-03T19:14:18.426228] [INFO ] [MAIN ] GPI: Full history saved. [2025-11-03T19:14:18.426351] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GPI took 39.0s. Estimated remaining: 3h 17m 39s. Rate: 7.1 symbols/min [2025-11-03T19:14:18.504279] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-11-03T19:14:18.504355] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-11-03T19:14:18.504537] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-11-03T19:14:18.504577] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-11-03T19:14:18.504981] [DEBUG] [LOCAL ] GPJA: Trimmed 6535 records to 3995 (keeping 200 days of data) [2025-11-03T19:14:18.529108] [DEBUG] [LOCAL ] GPJA: Primary data saved (3995 records). [2025-11-03T19:14:18.529216] [INFO ] [MAIN ] GPJA: Full history saved. [2025-11-03T19:14:18.529291] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GPJA took 31.2s. Estimated remaining: 3h 17m 18s. Rate: 7.1 symbols/min [2025-11-03T19:14:19.134926] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-11-03T19:14:19.711244] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-11-03T19:14:19.916154] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-11-03T19:14:19.934817] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-11-03T19:14:20.734849] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-11-03T19:14:21.007383] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T19:14:21.534915] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-11-03T19:14:22.017584] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T19:14:22.320790] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T19:14:22.334810] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-11-03T19:14:23.134893] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-11-03T19:14:23.404542] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T19:14:23.934935] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-11-03T19:14:24.487853] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T19:14:24.697959] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T19:14:24.734860] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-11-03T19:14:25.529898] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T19:14:25.535086] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-11-03T19:14:26.273017] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-11-03T19:14:26.334819] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-11-03T19:14:26.397955] [DEBUG] [REMOTE ] GPMT: Error fetching primary data for 2025-10: 'API call returned an empty response.' [2025-11-03T19:14:26.398269] [WARN ] [REMOTE ] GPMT: No data returned for month 2025-10 [2025-11-03T19:14:26.398356] [FATAL] [REMOTE ] GPMT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:14:26.398434] [FATAL] [MAIN ] GPMT: Failed to fetch primary data. [2025-11-03T19:14:26.398472] [WARN ] [MAIN ] GPMT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:14:26.398536] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-11-03T19:14:26.398599] [DEBUG] [LOCAL ] GPMT: No primary data file found to delete. [2025-11-03T19:14:26.398634] [INFO ] [LOCAL ] GPMT: Starting deletion of derivative data. [2025-11-03T19:14:26.398872] [DEBUG] [LOCAL ] GPMT: Deleted derivative data file. [2025-11-03T19:14:26.398955] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPMT took 16.2s. Estimated remaining: 3h 17m 9s. Rate: 7.1 symbols/min [2025-11-03T19:14:27.134867] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-11-03T19:14:28.366365] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T19:14:28.377532] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-11-03T19:14:29.639428] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:14:29.650570] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-11-03T19:14:31.036912] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T19:14:31.048958] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-11. [2025-11-03T19:14:32.133285] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-11 (1.08 seconds). [2025-11-03T19:14:32.134838] [INFO ] [REMOTE ] GPK: Full fetch complete (76190 records). [2025-11-03T19:14:32.134960] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-11-03T19:14:32.537685] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-11-03T19:14:32.537775] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-11-03T19:14:32.538748] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-11-03T19:14:32.538808] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-11-03T19:14:32.540150] [DEBUG] [LOCAL ] GPK: Trimmed 76190 records to 52825 (keeping 200 days of data) [2025-11-03T19:14:32.855516] [DEBUG] [LOCAL ] GPK: Primary data saved (52825 records). [2025-11-03T19:14:32.855637] [INFO ] [MAIN ] GPK: Full history saved. [2025-11-03T19:14:32.855751] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GPK took 30.2s. Estimated remaining: 3h 16m 58s. Rate: 7.1 symbols/min [2025-11-03T19:14:33.467065] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:33.537470] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:33.595458] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:33.596992] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:33.645776] [DEBUG] [LOCAL ] GRBK: Loaded 26587 existing records from primary storage. [2025-11-03T19:14:33.646514] [DEBUG] [LOCAL ] GPOR: Loaded 23683 existing records from primary storage. [2025-11-03T19:14:33.646902] [INFO ] [MAIN ] GRBK: Loaded 26587 existing records. [2025-11-03T19:14:33.646990] [INFO ] [MAIN ] GPOR: Loaded 23683 existing records. [2025-11-03T19:14:33.891949] [DEBUG] [LOCAL ] GPRK: Loaded 40767 existing records from primary storage. [2025-11-03T19:14:33.924830] [INFO ] [MAIN ] GPRK: Loaded 40767 existing records. [2025-11-03T19:14:34.077113] [DEBUG] [LOCAL ] GPN: Loaded 52470 existing records from primary storage. [2025-11-03T19:14:34.127158] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:34.151945] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-11-03T19:14:34.171243] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-11-03T19:14:34.146675] [INFO ] [MAIN ] GPN: Loaded 52470 existing records. [2025-11-03T19:14:34.190876] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:34.224102] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-11-03T19:14:34.224025] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-11-03T19:14:34.277933] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-11-03T19:14:34.283177] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-11-03T19:14:34.349685] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-11-03T19:14:34.383384] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-11-03T19:14:34.475333] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:34.520629] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-11-03T19:14:34.592680] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:34.545913] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-11-03T19:14:34.608757] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-11-03T19:14:34.651397] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-11-03T19:14:34.702198] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-11-03T19:14:34.686999] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-11-03T19:14:34.846625] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-11-03T19:14:34.887296] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-11-03T19:14:35.237219] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:14:35.297334] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-11-03T19:14:35.707313] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:14:35.725922] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-11-03T19:14:35.853985] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:14:35.864942] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-11-03T19:14:35.931892] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:14:35.932198] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-11-03T19:14:36.327246] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T19:14:36.333453] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-11-03T19:14:36.680819] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T19:14:36.691107] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-11-03T19:14:36.808929] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T19:14:36.817260] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-11-03T19:14:37.136141] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T19:14:37.146114] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-11-03T19:14:37.228313] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-11-03T19:14:37.234141] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-11-03T19:14:37.543501] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T19:14:37.550515] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-11-03T19:14:37.844899] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T19:14:37.906692] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T19:14:38.160992] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T19:14:38.334929] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-11-03T19:14:38.529692] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-11-03T19:14:39.134938] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-11-03T19:14:39.841931] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T19:14:39.934851] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-11-03T19:14:40.058293] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-11-03T19:14:40.734857] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-11-03T19:14:41.011697] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:14:41.488887] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T19:14:41.534812] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-11-03T19:14:42.334927] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-11-03T19:14:42.906981] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T19:14:43.134872] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-11-03T19:14:43.427499] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T19:14:43.934819] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-11-03T19:14:44.026800] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T19:14:44.734852] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-11-03T19:14:45.241827] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T19:14:45.367327] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:14:45.534870] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-11-03T19:14:46.334911] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-11-03T19:14:46.626735] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T19:14:47.134828] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-11-03T19:14:47.447166] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:14:47.934920] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-11-03T19:14:48.504266] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T19:14:48.734923] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-11-03T19:14:48.792250] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T19:14:49.534884] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-11-03T19:14:49.711107] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:14:50.334821] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-11-03T19:14:50.399240] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-11-03T19:14:51.134905] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-11-03T19:14:51.401935] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T19:14:51.891390] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T19:14:51.934822] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-11-03T19:14:52.734921] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-11-03T19:14:52.891514] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T19:14:53.534914] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-11-03T19:14:54.334855] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-11-03T19:14:54.540041] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T19:14:54.832507] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-11-03T19:14:55.134885] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-11-03T19:14:55.611979] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T19:14:55.884439] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T19:14:55.934868] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-11-03T19:14:56.734840] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-11-03T19:14:56.786255] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T19:14:57.534919] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-11-03T19:14:58.334863] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-11. [2025-11-03T19:14:58.519316] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-11-03T19:14:58.874401] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T19:14:59.041063] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-11 (0.71 seconds). [2025-11-03T19:14:59.042149] [INFO ] [REMOTE ] GRBK: Full fetch complete (39891 records). [2025-11-03T19:14:59.042222] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-11-03T19:14:59.141317] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-11-03T19:14:59.431682] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-11-03T19:14:59.431775] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-11-03T19:14:59.432428] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-11-03T19:14:59.432469] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-11-03T19:14:59.433399] [DEBUG] [LOCAL ] GRBK: Trimmed 39891 records to 26198 (keeping 200 days of data) [2025-11-03T19:14:59.590154] [DEBUG] [LOCAL ] GRBK: Primary data saved (26198 records). [2025-11-03T19:14:59.590322] [INFO ] [MAIN ] GRBK: Full history saved. [2025-11-03T19:14:59.590421] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GRBK took 26.7s. Estimated remaining: 3h 17m 16s. Rate: 7.1 symbols/min [2025-11-03T19:14:59.766178] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:14:59.775925] [DEBUG] [LOCAL ] GRC: Loaded 9457 existing records from primary storage. [2025-11-03T19:14:59.776166] [INFO ] [MAIN ] GRC: Loaded 9457 existing records. [2025-11-03T19:14:59.948535] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-11-03T19:14:59.954911] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:14:59.955962] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-11-03T19:14:59.956041] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-11-03T19:14:59.956325] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-11-03T19:14:59.956384] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-11-03T19:15:00.325756] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:00.414942] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T19:15:00.734858] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-11-03T19:15:01.448311] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T19:15:01.534927] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-11. [2025-11-03T19:15:01.636095] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-11-03T19:15:02.334844] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-11. [2025-11-03T19:15:02.722023] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T19:15:02.723919] [INFO ] [REMOTE ] GPRK: Full fetch complete (58781 records). [2025-11-03T19:15:02.724128] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-11-03T19:15:03.130633] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-11-03T19:15:03.130762] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-11-03T19:15:03.131573] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-11-03T19:15:03.131624] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-11-03T19:15:03.132922] [DEBUG] [LOCAL ] GPRK: Trimmed 58781 records to 40207 (keeping 200 days of data) [2025-11-03T19:15:03.180458] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-11-03T19:15:03.381234] [DEBUG] [LOCAL ] GPRK: Primary data saved (40207 records). [2025-11-03T19:15:03.382147] [INFO ] [MAIN ] GPRK: Full history saved. [2025-11-03T19:15:03.382040] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T19:15:03.382344] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPRK took 30.5s. Estimated remaining: 3h 17m 1s. Rate: 7.1 symbols/min [2025-11-03T19:15:03.395875] [INFO ] [REMOTE ] GPN: Full fetch complete (75003 records). [2025-11-03T19:15:03.424691] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-11-03T19:15:03.779605] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:03.946877] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-11-03T19:15:04.005180] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-11-03T19:15:04.005370] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-11-03T19:15:04.006359] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-11-03T19:15:04.013628] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-11-03T19:15:04.014223] [DEBUG] [LOCAL ] GRDN: Loaded 22039 existing records from primary storage. [2025-11-03T19:15:04.014758] [INFO ] [MAIN ] GRDN: Loaded 22039 existing records. [2025-11-03T19:15:04.047441] [DEBUG] [LOCAL ] GPN: Trimmed 75003 records to 51748 (keeping 200 days of data) [2025-11-03T19:15:04.308728] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:04.312801] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-11-03T19:15:04.323233] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-11-03T19:15:04.331604] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-11-03T19:15:04.429758] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-11-03T19:15:04.429512] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T19:15:04.713040] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:15:04.739931] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-11-03T19:15:04.780521] [DEBUG] [LOCAL ] GPN: Primary data saved (51748 records). [2025-11-03T19:15:04.793549] [INFO ] [MAIN ] GPN: Full history saved. [2025-11-03T19:15:04.816167] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPN took 31.9s. Estimated remaining: 3h 16m 42s. Rate: 7.1 symbols/min [2025-11-03T19:15:05.065718] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:05.094327] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:05.130621] [DEBUG] [LOCAL ] GRMN: Loaded 40108 existing records from primary storage. [2025-11-03T19:15:05.130930] [INFO ] [MAIN ] GRMN: Loaded 40108 existing records. [2025-11-03T19:15:05.312332] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:05.312559] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-11-03T19:15:05.312617] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-11-03T19:15:05.313320] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-11-03T19:15:05.313377] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-11-03T19:15:05.540088] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-11-03T19:15:05.667719] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:05.736711] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T19:15:06.268845] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T19:15:06.334893] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-11. [2025-11-03T19:15:07.121729] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T19:15:07.123074] [INFO ] [REMOTE ] GPOR: Full fetch complete (34678 records). [2025-11-03T19:15:07.123185] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-11-03T19:15:07.145242] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-11-03T19:15:07.492416] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-11-03T19:15:07.492491] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-11-03T19:15:07.493099] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-11-03T19:15:07.493160] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-11-03T19:15:07.493959] [DEBUG] [LOCAL ] GPOR: Trimmed 34678 records to 23393 (keeping 200 days of data) [2025-11-03T19:15:07.628995] [DEBUG] [LOCAL ] GPOR: Primary data saved (23393 records). [2025-11-03T19:15:07.629115] [INFO ] [MAIN ] GPOR: Full history saved. [2025-11-03T19:15:07.629188] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPOR took 34.8s. Estimated remaining: 3h 16m 26s. Rate: 7.1 symbols/min [2025-11-03T19:15:07.802239] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:07.815327] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T19:15:07.854130] [DEBUG] [LOCAL ] GRND: Loaded 50912 existing records from primary storage. [2025-11-03T19:15:07.854471] [INFO ] [MAIN ] GRND: Loaded 50912 existing records. [2025-11-03T19:15:07.940110] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-11-03T19:15:08.032601] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:08.032891] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-11-03T19:15:08.032949] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-11-03T19:15:08.033728] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-11-03T19:15:08.033787] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-11-03T19:15:08.393901] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:08.734937] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-11-03T19:15:09.239463] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:15:09.534897] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-11-03T19:15:10.052572] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T19:15:10.334850] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-11-03T19:15:10.447238] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-11-03T19:15:11.134899] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-11-03T19:15:11.515480] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T19:15:11.637514] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-11-03T19:15:11.934848] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-11-03T19:15:12.530006] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-11-03T19:15:12.734856] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-11-03T19:15:13.242987] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-11-03T19:15:13.534857] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-11-03T19:15:14.334834] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-11-03T19:15:14.719505] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T19:15:15.134866] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-11-03T19:15:15.632375] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-11-03T19:15:15.744842] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:15:15.934889] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-11-03T19:15:16.734903] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-11-03T19:15:17.206804] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-11-03T19:15:17.534865] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-11-03T19:15:17.926809] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T19:15:18.030603] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-11-03T19:15:18.334859] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-11-03T19:15:19.134908] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-11-03T19:15:19.645867] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T19:15:19.934862] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-11-03T19:15:20.360347] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T19:15:20.515219] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T19:15:20.734851] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-11-03T19:15:21.431571] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-11-03T19:15:21.534840] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-11-03T19:15:22.309565] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T19:15:22.334877] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-11-03T19:15:22.855132] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-11-03T19:15:23.134886] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-11-03T19:15:23.904580] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T19:15:23.934820] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-11-03T19:15:24.713349] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T19:15:24.734860] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-11-03T19:15:25.270216] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T19:15:25.534863] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-11-03T19:15:26.167423] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T19:15:26.334917] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-11-03T19:15:27.047110] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T19:15:27.134877] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-11. [2025-11-03T19:15:27.190947] [DEBUG] [REMOTE ] GRC: Error fetching primary data for 2025-11: 'API call returned an empty response.' [2025-11-03T19:15:27.191250] [WARN ] [REMOTE ] GRC: No data returned for month 2025-11 [2025-11-03T19:15:27.191340] [FATAL] [REMOTE ] GRC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:15:27.191441] [FATAL] [MAIN ] GRC: Failed to fetch primary data. [2025-11-03T19:15:27.191524] [WARN ] [MAIN ] GRC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:15:27.191610] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-11-03T19:15:27.191730] [DEBUG] [LOCAL ] GRC: No primary data file found to delete. [2025-11-03T19:15:27.191791] [INFO ] [LOCAL ] GRC: Starting deletion of derivative data. [2025-11-03T19:15:27.191993] [DEBUG] [LOCAL ] GRC: Deleted derivative data file. [2025-11-03T19:15:27.192094] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GRC took 27.6s. Estimated remaining: 3h 16m 34s. Rate: 7.1 symbols/min [2025-11-03T19:15:27.360022] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:27.389175] [DEBUG] [LOCAL ] GRNT: Loaded 33903 existing records from primary storage. [2025-11-03T19:15:27.389485] [INFO ] [MAIN ] GRNT: Loaded 33903 existing records. [2025-11-03T19:15:27.567842] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:27.568073] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-11-03T19:15:27.568140] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-11-03T19:15:27.568690] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-11-03T19:15:27.568749] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-11-03T19:15:27.938450] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:27.934876] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-11-03T19:15:28.734857] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-11-03T19:15:29.033266] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-11-03T19:15:29.534838] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-11-03T19:15:29.578927] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T19:15:30.334850] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-11-03T19:15:31.072973] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-11-03T19:15:31.134816] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-11-03T19:15:31.168494] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T19:15:31.934912] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-11-03T19:15:32.144951] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T19:15:32.734873] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-11-03T19:15:32.806117] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:15:33.534906] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-11. [2025-11-03T19:15:33.768539] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:15:34.184295] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T19:15:34.185215] [INFO ] [REMOTE ] GRDN: Full fetch complete (27263 records). [2025-11-03T19:15:34.185284] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-11-03T19:15:34.337394] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-11-03T19:15:34.553363] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-11-03T19:15:34.553455] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-11-03T19:15:34.554037] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-11-03T19:15:34.554097] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-11-03T19:15:34.554754] [DEBUG] [LOCAL ] GRDN: Trimmed 27263 records to 21862 (keeping 200 days of data) [2025-11-03T19:15:34.675016] [DEBUG] [LOCAL ] GRDN: Primary data saved (21862 records). [2025-11-03T19:15:34.675130] [INFO ] [MAIN ] GRDN: Full history saved. [2025-11-03T19:15:34.675201] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRDN took 31.3s. Estimated remaining: 3h 16m 24s. Rate: 7.1 symbols/min [2025-11-03T19:15:34.840347] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:34.849731] [DEBUG] [LOCAL ] GROV: Loaded 8948 existing records from primary storage. [2025-11-03T19:15:34.849935] [INFO ] [MAIN ] GROV: Loaded 8948 existing records. [2025-11-03T19:15:35.022855] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:35.023022] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-11-03T19:15:35.023067] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-11-03T19:15:35.023330] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-11-03T19:15:35.023386] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-11-03T19:15:35.140021] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-11-03T19:15:35.381213] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:35.404751] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T19:15:35.934844] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-11-03T19:15:36.170083] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-11-03T19:15:36.734882] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-11-03T19:15:37.172434] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T19:15:37.327063] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-11-03T19:15:37.534858] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-11-03T19:15:38.141303] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-11-03T19:15:38.334851] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-11-03T19:15:38.846738] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T19:15:39.134863] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-11-03T19:15:39.604007] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-11-03T19:15:39.934941] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-11-03T19:15:40.412609] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T19:15:40.734879] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-11. [2025-11-03T19:15:41.534868] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-11-03T19:15:41.734590] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-11 (1.00 seconds). [2025-11-03T19:15:41.736029] [INFO ] [REMOTE ] GRMN: Full fetch complete (59500 records). [2025-11-03T19:15:41.736164] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-11-03T19:15:42.066773] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-11-03T19:15:42.150531] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-11-03T19:15:42.150618] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-11-03T19:15:42.151500] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-11-03T19:15:42.151557] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-11-03T19:15:42.152857] [DEBUG] [LOCAL ] GRMN: Trimmed 59500 records to 39508 (keeping 200 days of data) [2025-11-03T19:15:42.346471] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-11-03T19:15:42.423236] [DEBUG] [LOCAL ] GRMN: Primary data saved (39508 records). [2025-11-03T19:15:42.423381] [INFO ] [MAIN ] GRMN: Full history saved. [2025-11-03T19:15:42.423460] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRMN took 37.6s. Estimated remaining: 3h 16m 15s. Rate: 7.1 symbols/min [2025-11-03T19:15:42.593454] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:42.599347] [DEBUG] [LOCAL ] GRX: Loaded 4850 existing records from primary storage. [2025-11-03T19:15:42.599531] [INFO ] [MAIN ] GRX: Loaded 4850 existing records. [2025-11-03T19:15:42.777544] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:42.777788] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-11-03T19:15:42.777837] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-11-03T19:15:42.778035] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-11-03T19:15:42.778091] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-11-03T19:15:43.147733] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-11-03T19:15:43.152859] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:43.750359] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T19:15:43.796632] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-11-03T19:15:43.934842] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-11-03T19:15:44.734867] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-11-03T19:15:45.068441] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:15:45.168802] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-11-03T19:15:45.534852] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-11-03T19:15:46.031266] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T19:15:46.334874] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-11-03T19:15:46.661805] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T19:15:47.134869] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-11-03T19:15:47.934880] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-11-03T19:15:48.336022] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T19:15:48.734870] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-11-03T19:15:48.969829] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-11-03T19:15:49.534857] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-11-03T19:15:49.867047] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T19:15:50.054906] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T19:15:50.334915] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-11-03T19:15:51.134825] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-11-03T19:15:51.331135] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T19:15:51.934880] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-11-03T19:15:52.285316] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T19:15:52.356524] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T19:15:52.735076] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-11-03T19:15:53.534825] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-11-03T19:15:54.124892] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T19:15:54.260310] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T19:15:54.334837] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-11. [2025-11-03T19:15:55.134840] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-11. [2025-11-03T19:15:55.646162] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T19:15:55.646876] [INFO ] [REMOTE ] GROV: Full fetch complete (13358 records). [2025-11-03T19:15:55.646943] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-11-03T19:15:55.735311] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T19:15:55.765684] [INFO ] [REMOTE ] GRND: Full fetch complete (72193 records). [2025-11-03T19:15:55.781209] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-11-03T19:15:55.940025] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-11-03T19:15:56.361007] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-11-03T19:15:56.366571] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-11-03T19:15:56.372233] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-11-03T19:15:56.372334] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-11-03T19:15:56.411228] [DEBUG] [LOCAL ] GROV: Trimmed 13358 records to 8835 (keeping 200 days of data) [2025-11-03T19:15:56.479374] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-11-03T19:15:56.484040] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-11-03T19:15:56.496776] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-11-03T19:15:56.499744] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-11-03T19:15:56.513252] [DEBUG] [LOCAL ] GROV: Primary data saved (8835 records). [2025-11-03T19:15:56.513479] [INFO ] [MAIN ] GROV: Full history saved. [2025-11-03T19:15:56.513734] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GROV took 21.8s. Estimated remaining: 3h 16m 14s. Rate: 7.1 symbols/min [2025-11-03T19:15:56.519792] [DEBUG] [LOCAL ] GRND: Trimmed 72193 records to 50160 (keeping 200 days of data) [2025-11-03T19:15:56.747098] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-11-03T19:15:56.811146] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:57.043518] [DEBUG] [LOCAL ] GRND: Primary data saved (50160 records). [2025-11-03T19:15:57.044369] [INFO ] [MAIN ] GRND: Full history saved. [2025-11-03T19:15:57.045517] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T19:15:57.045619] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRND took 49.4s. Estimated remaining: 3h 15m 55s. Rate: 7.1 symbols/min [2025-11-03T19:15:57.171394] [DEBUG] [LOCAL ] GS: Loaded 52476 existing records from primary storage. [2025-11-03T19:15:57.182093] [INFO ] [MAIN ] GS: Loaded 52476 existing records. [2025-11-03T19:15:57.351499] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:15:57.371721] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-11-03T19:15:57.446532] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:57.446874] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-11-03T19:15:57.446928] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-11-03T19:15:57.447907] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-11-03T19:15:57.447963] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-11-03T19:15:57.538259] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-11-03T19:15:57.715893] [DEBUG] [LOCAL ] GSBD: Loaded 39977 existing records from primary storage. [2025-11-03T19:15:57.727620] [INFO ] [MAIN ] GSBD: Loaded 39977 existing records. [2025-11-03T19:15:57.984969] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:58.016263] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:15:58.019871] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-11-03T19:15:58.020541] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T19:15:58.022316] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-11-03T19:15:58.023318] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-11-03T19:15:58.023389] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-11-03T19:15:58.339967] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-11-03T19:15:58.411982] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:15:59.134875] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-11-03T19:15:59.417727] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T19:15:59.571036] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-11-03T19:15:59.934869] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-11-03T19:16:00.734859] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-11-03T19:16:01.107859] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:16:01.190248] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-11-03T19:16:01.534901] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-11-03T19:16:02.334962] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-11-03T19:16:02.641057] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T19:16:02.734963] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T19:16:03.134903] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-11-03T19:16:03.934886] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-11-03T19:16:04.734877] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-11-03T19:16:04.810453] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-11-03T19:16:04.983119] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T19:16:05.223710] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T19:16:05.534893] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-11-03T19:16:06.334909] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-11-03T19:16:06.676474] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T19:16:07.134890] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-11-03T19:16:07.374942] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T19:16:07.934888] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-11-03T19:16:08.656900] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T19:16:08.734825] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-11-03T19:16:09.130751] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T19:16:09.534957] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-11-03T19:16:10.340470] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-11-03T19:16:10.361822] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-11-03T19:16:10.670894] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T19:16:11.134928] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-11. [2025-11-03T19:16:11.458428] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T19:16:11.934876] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-11-03T19:16:12.003271] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:16:12.004497] [INFO ] [REMOTE ] GRNT: Full fetch complete (48137 records). [2025-11-03T19:16:12.004590] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-11-03T19:16:12.329744] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-11-03T19:16:12.401502] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-11-03T19:16:12.401600] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-11-03T19:16:12.402376] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-11-03T19:16:12.402443] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-11-03T19:16:12.403600] [DEBUG] [LOCAL ] GRNT: Trimmed 48137 records to 33321 (keeping 200 days of data) [2025-11-03T19:16:12.592733] [DEBUG] [LOCAL ] GRNT: Primary data saved (33321 records). [2025-11-03T19:16:12.592886] [INFO ] [MAIN ] GRNT: Full history saved. [2025-11-03T19:16:12.592967] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GRNT took 45.4s. Estimated remaining: 3h 15m 56s. Rate: 7.1 symbols/min [2025-11-03T19:16:12.742021] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-11-03T19:16:12.777062] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:16:12.824798] [DEBUG] [LOCAL ] GSK: Loaded 54290 existing records from primary storage. [2025-11-03T19:16:12.825185] [INFO ] [MAIN ] GSK: Loaded 54290 existing records. [2025-11-03T19:16:13.018878] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:16:13.019164] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-11-03T19:16:13.019238] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-11-03T19:16:13.020313] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-11-03T19:16:13.020375] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-11-03T19:16:13.395547] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:16:13.534834] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-11-03T19:16:13.718863] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:16:14.334875] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-11-03T19:16:14.925342] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T19:16:15.134850] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-11. [2025-11-03T19:16:15.429271] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T19:16:15.747318] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-11 (0.61 seconds). [2025-11-03T19:16:15.748052] [INFO ] [REMOTE ] GRX: Full fetch complete (6540 records). [2025-11-03T19:16:15.748119] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-11-03T19:16:15.944692] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-11-03T19:16:16.121187] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-11-03T19:16:16.121290] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-11-03T19:16:16.121507] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-11-03T19:16:16.121547] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-11-03T19:16:16.122108] [DEBUG] [LOCAL ] GRX: Trimmed 6540 records to 4809 (keeping 200 days of data) [2025-11-03T19:16:16.152048] [DEBUG] [LOCAL ] GRX: Primary data saved (4809 records). [2025-11-03T19:16:16.152187] [INFO ] [MAIN ] GRX: Full history saved. [2025-11-03T19:16:16.152266] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GRX took 33.7s. Estimated remaining: 3h 15m 41s. Rate: 7.1 symbols/min [2025-11-03T19:16:16.327692] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:16:16.358406] [DEBUG] [LOCAL ] GSL: Loaded 32907 existing records from primary storage. [2025-11-03T19:16:16.358723] [INFO ] [MAIN ] GSL: Loaded 32907 existing records. [2025-11-03T19:16:16.544959] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:16:16.545164] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-11-03T19:16:16.545212] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-11-03T19:16:16.545828] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-11-03T19:16:16.545885] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-11-03T19:16:16.742992] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-11-03T19:16:16.956939] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:16:17.311371] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T19:16:17.534848] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-11-03T19:16:18.334841] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-11-03T19:16:18.386008] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-11-03T19:16:18.416475] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T19:16:19.134852] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-11-03T19:16:19.934834] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-11-03T19:16:20.033710] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-11-03T19:16:20.213766] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:16:20.734833] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-11-03T19:16:20.888978] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T19:16:21.534878] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-11-03T19:16:22.120499] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T19:16:22.334901] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-11-03T19:16:22.678931] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T19:16:23.134926] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-11-03T19:16:23.644336] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T19:16:23.934857] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-11-03T19:16:24.187030] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T19:16:24.734859] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-11-03T19:16:25.394239] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T19:16:25.534851] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-11-03T19:16:26.107335] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T19:16:26.334893] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-11. [2025-11-03T19:16:27.134838] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-11-03T19:16:27.174876] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-11-03T19:16:27.502698] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T19:16:27.503960] [INFO ] [REMOTE ] GSBD: Full fetch complete (58550 records). [2025-11-03T19:16:27.504036] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-11-03T19:16:27.896336] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-11-03T19:16:27.896462] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-11-03T19:16:27.897553] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-11-03T19:16:27.897662] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-11-03T19:16:27.899088] [DEBUG] [LOCAL ] GSBD: Trimmed 58550 records to 39371 (keeping 200 days of data) [2025-11-03T19:16:27.950391] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-11-03T19:16:28.133699] [DEBUG] [LOCAL ] GSBD: Primary data saved (39371 records). [2025-11-03T19:16:28.133840] [INFO ] [MAIN ] GSBD: Full history saved. [2025-11-03T19:16:28.133917] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GSBD took 31.1s. Estimated remaining: 3h 15m 38s. Rate: 7.1 symbols/min [2025-11-03T19:16:28.303111] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:16:28.348548] [DEBUG] [LOCAL ] GTES: Loaded 51012 existing records from primary storage. [2025-11-03T19:16:28.348863] [INFO ] [MAIN ] GTES: Loaded 51012 existing records. [2025-11-03T19:16:28.528938] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:16:28.529320] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-11-03T19:16:28.529435] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-11-03T19:16:28.530465] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-11-03T19:16:28.530538] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-11-03T19:16:28.750547] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-11-03T19:16:28.827301] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-11-03T19:16:28.937191] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:16:29.094987] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T19:16:29.534875] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-11-03T19:16:30.334827] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-11-03T19:16:30.560124] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-11-03T19:16:31.019219] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T19:16:31.134873] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-11-03T19:16:31.420755] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T19:16:31.934874] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-11-03T19:16:31.985715] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T19:16:32.734848] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-11-03T19:16:33.513579] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-11-03T19:16:33.534812] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-11-03T19:16:33.835024] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T19:16:34.334860] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-11-03T19:16:35.012606] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T19:16:35.134852] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-11-03T19:16:35.265568] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T19:16:35.934856] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-11-03T19:16:36.588069] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T19:16:36.734826] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-11-03T19:16:37.428093] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T19:16:37.534848] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-11-03T19:16:38.192809] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T19:16:38.334820] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-11-03T19:16:39.134858] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-11-03T19:16:39.506238] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-11-03T19:16:39.553930] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T19:16:39.934849] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-11. [2025-11-03T19:16:40.145702] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T19:16:40.734904] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-11-03T19:16:41.391413] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T19:16:41.392931] [INFO ] [REMOTE ] GS: Full fetch complete (75803 records). [2025-11-03T19:16:41.393038] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-11-03T19:16:41.540886] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-11-03T19:16:41.794344] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-11-03T19:16:41.794443] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-11-03T19:16:41.795381] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-11-03T19:16:41.795459] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-11-03T19:16:41.814812] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T19:16:41.814036] [DEBUG] [LOCAL ] GS: Trimmed 75803 records to 51698 (keeping 200 days of data) [2025-11-03T19:16:42.141667] [DEBUG] [LOCAL ] GS: Primary data saved (51698 records). [2025-11-03T19:16:42.141820] [INFO ] [MAIN ] GS: Full history saved. [2025-11-03T19:16:42.141903] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GS took 45.6s. Estimated remaining: 3h 15m 37s. Rate: 7.1 symbols/min [2025-11-03T19:16:42.306185] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:16:42.342708] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-11-03T19:16:42.345372] [DEBUG] [LOCAL ] GTLS: Loaded 43254 existing records from primary storage. [2025-11-03T19:16:42.345742] [INFO ] [MAIN ] GTLS: Loaded 43254 existing records. [2025-11-03T19:16:42.522931] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:16:42.523203] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-11-03T19:16:42.523252] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-11-03T19:16:42.524039] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-11-03T19:16:42.524097] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-11-03T19:16:42.881778] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:16:42.920480] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-11-03T19:16:43.134857] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-11-03T19:16:43.940039] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-11-03T19:16:43.957284] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-11-03T19:16:44.098293] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:16:44.734923] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-11-03T19:16:45.123426] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T19:16:45.534853] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-11-03T19:16:45.749879] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T19:16:46.334874] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-11-03T19:16:47.060099] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-11-03T19:16:47.134877] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-11-03T19:16:47.415949] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:16:47.934908] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-11. [2025-11-03T19:16:48.238880] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T19:16:48.734962] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-11-03T19:16:48.776004] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T19:16:48.778077] [INFO ] [REMOTE ] GSL: Full fetch complete (48317 records). [2025-11-03T19:16:48.778335] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-11-03T19:16:49.291290] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-11-03T19:16:49.291389] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-11-03T19:16:49.292189] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-11-03T19:16:49.292252] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-11-03T19:16:49.293293] [DEBUG] [LOCAL ] GSL: Trimmed 48317 records to 32406 (keeping 200 days of data) [2025-11-03T19:16:49.487472] [DEBUG] [LOCAL ] GSL: Primary data saved (32406 records). [2025-11-03T19:16:49.487602] [INFO ] [MAIN ] GSL: Full history saved. [2025-11-03T19:16:49.487698] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GSL took 33.3s. Estimated remaining: 3h 15m 27s. Rate: 7.1 symbols/min [2025-11-03T19:16:49.541564] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-11-03T19:16:49.657676] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:16:49.694833] [DEBUG] [LOCAL ] GTN: Loaded 44884 existing records from primary storage. [2025-11-03T19:16:49.695120] [INFO ] [MAIN ] GTN: Loaded 44884 existing records. [2025-11-03T19:16:49.868799] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:16:49.868999] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-11-03T19:16:49.869045] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-11-03T19:16:49.869723] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-11-03T19:16:49.869780] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-11-03T19:16:50.236535] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:16:50.334850] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-11-03T19:16:50.437406] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-11-03T19:16:50.940982] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T19:16:51.134847] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-11. [2025-11-03T19:16:51.432736] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T19:16:51.934897] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-11-03T19:16:52.304418] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T19:16:52.305998] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-11-03T19:16:52.306101] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-11-03T19:16:52.727495] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-11-03T19:16:52.727775] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-11-03T19:16:52.728802] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-11-03T19:16:52.728868] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-11-03T19:16:52.730355] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53511 (keeping 200 days of data) [2025-11-03T19:16:52.785370] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-11-03T19:16:53.048469] [DEBUG] [LOCAL ] GSK: Primary data saved (53511 records). [2025-11-03T19:16:53.048603] [INFO ] [MAIN ] GSK: Full history saved. [2025-11-03T19:16:53.048703] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSK took 40.5s. Estimated remaining: 3h 15m 12s. Rate: 7.1 symbols/min [2025-11-03T19:16:53.221976] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:16:53.249250] [DEBUG] [LOCAL ] GTY: Loaded 30005 existing records from primary storage. [2025-11-03T19:16:53.249590] [INFO ] [MAIN ] GTY: Loaded 30005 existing records. [2025-11-03T19:16:53.429802] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:16:53.430072] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-11-03T19:16:53.430127] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-11-03T19:16:53.430708] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-11-03T19:16:53.430764] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-11-03T19:16:53.545636] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-11-03T19:16:53.660445] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-11-03T19:16:53.836735] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:16:54.258174] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T19:16:54.334846] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-11-03T19:16:54.710128] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T19:16:55.141706] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-11-03T19:16:55.147215] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T19:16:55.934895] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-11-03T19:16:56.410370] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T19:16:56.734879] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-11-03T19:16:56.773797] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T19:16:57.534908] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-11-03T19:16:57.958392] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T19:16:58.334859] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-11-03T19:16:58.613831] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:16:59.134949] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-11-03T19:16:59.752442] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T19:16:59.934830] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-11-03T19:17:00.142166] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T19:17:00.734830] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-11-03T19:17:01.120472] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:17:01.534920] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-11-03T19:17:01.964427] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:17:02.334877] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-11. [2025-11-03T19:17:02.620953] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T19:17:03.134894] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-11-03T19:17:03.443474] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T19:17:03.445533] [INFO ] [REMOTE ] GTES: Full fetch complete (73872 records). [2025-11-03T19:17:03.445754] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-11-03T19:17:03.883582] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-11-03T19:17:03.883696] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-11-03T19:17:03.884705] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-11-03T19:17:03.884807] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-11-03T19:17:03.886223] [DEBUG] [LOCAL ] GTES: Trimmed 73872 records to 50296 (keeping 200 days of data) [2025-11-03T19:17:03.942881] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-11-03T19:17:04.193165] [DEBUG] [LOCAL ] GTES: Primary data saved (50296 records). [2025-11-03T19:17:04.193297] [INFO ] [MAIN ] GTES: Full history saved. [2025-11-03T19:17:04.193378] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GTES took 36.1s. Estimated remaining: 3h 15m 7s. Rate: 7.1 symbols/min [2025-11-03T19:17:04.372607] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:04.408922] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T19:17:04.413742] [DEBUG] [LOCAL ] GUG: Loaded 12157 existing records from primary storage. [2025-11-03T19:17:04.424547] [INFO ] [MAIN ] GUG: Loaded 12157 existing records. [2025-11-03T19:17:04.599082] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:04.599312] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-11-03T19:17:04.599360] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-11-03T19:17:04.599713] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-11-03T19:17:04.599788] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-11-03T19:17:04.740073] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-11-03T19:17:04.967993] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:05.283701] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:17:05.534909] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-11-03T19:17:05.835108] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-11-03T19:17:06.334894] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-11-03T19:17:06.773502] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T19:17:07.042230] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-11-03T19:17:07.134860] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-11-03T19:17:07.652791] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T19:17:07.934889] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-11-03T19:17:08.734865] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-11-03T19:17:09.091879] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T19:17:09.534903] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-11-03T19:17:09.684885] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T19:17:10.334881] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-11-03T19:17:10.977354] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T19:17:11.134885] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-11. [2025-11-03T19:17:11.939959] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-11-03T19:17:11.965557] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-11-03T19:17:12.278709] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:17:12.280104] [INFO ] [REMOTE ] GTN: Full fetch complete (65386 records). [2025-11-03T19:17:12.280207] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-11-03T19:17:12.675584] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-11-03T19:17:12.675698] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-11-03T19:17:12.676635] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-11-03T19:17:12.676721] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-11-03T19:17:12.678095] [DEBUG] [LOCAL ] GTN: Trimmed 65386 records to 44239 (keeping 200 days of data) [2025-11-03T19:17:12.736391] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-11-03T19:17:12.814816] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T19:17:12.958436] [DEBUG] [LOCAL ] GTN: Primary data saved (44239 records). [2025-11-03T19:17:12.958575] [INFO ] [MAIN ] GTN: Full history saved. [2025-11-03T19:17:12.959483] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GTN took 23.5s. Estimated remaining: 3h 14m 59s. Rate: 7.1 symbols/min [2025-11-03T19:17:13.126673] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:13.141746] [DEBUG] [LOCAL ] GUT: Loaded 15540 existing records from primary storage. [2025-11-03T19:17:13.141980] [INFO ] [MAIN ] GUT: Loaded 15540 existing records. [2025-11-03T19:17:13.321562] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:13.321797] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-11-03T19:17:13.321845] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-11-03T19:17:13.322264] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-11-03T19:17:13.322320] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-11-03T19:17:13.449165] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T19:17:13.541788] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-11-03T19:17:13.697994] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:14.334852] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-11-03T19:17:14.746193] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-11-03T19:17:14.853824] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-11-03T19:17:15.134844] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-11-03T19:17:15.742760] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-11-03T19:17:15.934887] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-11-03T19:17:16.734846] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-11-03T19:17:16.779342] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T19:17:17.534865] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-11-03T19:17:17.881901] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:17:18.230578] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-11-03T19:17:18.334867] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-11-03T19:17:19.131788] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T19:17:19.138357] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-11-03T19:17:19.669979] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T19:17:19.934858] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-11-03T19:17:20.734838] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-11-03T19:17:20.889859] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T19:17:21.407358] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T19:17:21.534890] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-11-03T19:17:22.334828] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-11-03T19:17:22.462929] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T19:17:22.930910] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T19:17:23.134845] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-11-03T19:17:23.756063] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T19:17:23.934854] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-11-03T19:17:24.625304] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-11-03T19:17:24.734820] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-11-03T19:17:25.350074] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T19:17:25.534919] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-11-03T19:17:26.092629] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T19:17:26.334871] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-11-03T19:17:27.134838] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-11-03T19:17:27.417863] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-11-03T19:17:27.739802] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T19:17:27.934858] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-11. [2025-11-03T19:17:28.713690] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T19:17:28.714789] [INFO ] [REMOTE ] GTY: Full fetch complete (43745 records). [2025-11-03T19:17:28.714887] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-11-03T19:17:28.744464] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-11-03T19:17:29.089236] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-11-03T19:17:29.089310] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-11-03T19:17:29.089916] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-11-03T19:17:29.089977] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-11-03T19:17:29.090833] [DEBUG] [LOCAL ] GTY: Trimmed 43745 records to 29596 (keeping 200 days of data) [2025-11-03T19:17:29.263011] [DEBUG] [LOCAL ] GTY: Primary data saved (29596 records). [2025-11-03T19:17:29.263132] [INFO ] [MAIN ] GTY: Full history saved. [2025-11-03T19:17:29.263206] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTY took 36.2s. Estimated remaining: 3h 15m 2s. Rate: 7.1 symbols/min [2025-11-03T19:17:29.442710] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:29.453602] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T19:17:29.486153] [DEBUG] [LOCAL ] GVA: Loaded 32378 existing records from primary storage. [2025-11-03T19:17:29.486489] [INFO ] [MAIN ] GVA: Loaded 32378 existing records. [2025-11-03T19:17:29.540039] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-11-03T19:17:29.665214] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:29.665454] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-11-03T19:17:29.665512] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-11-03T19:17:29.666528] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-11-03T19:17:29.666588] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-11-03T19:17:30.013426] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:30.334859] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-11-03T19:17:30.368518] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T19:17:31.134913] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-11. [2025-11-03T19:17:31.288463] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T19:17:31.756678] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T19:17:31.757864] [INFO ] [REMOTE ] GUT: Full fetch complete (22336 records). [2025-11-03T19:17:31.757949] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-11-03T19:17:31.942607] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-11-03T19:17:32.227721] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-11-03T19:17:32.227814] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-11-03T19:17:32.228369] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-11-03T19:17:32.228447] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-11-03T19:17:32.229282] [DEBUG] [LOCAL ] GUT: Trimmed 22336 records to 15288 (keeping 200 days of data) [2025-11-03T19:17:32.324917] [DEBUG] [LOCAL ] GUT: Primary data saved (15288 records). [2025-11-03T19:17:32.325065] [INFO ] [MAIN ] GUT: Full history saved. [2025-11-03T19:17:32.325156] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GUT took 19.4s. Estimated remaining: 3h 14m 46s. Rate: 7.1 symbols/min [2025-11-03T19:17:32.536275] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:32.558231] [DEBUG] [LOCAL ] GWH: Loaded 22019 existing records from primary storage. [2025-11-03T19:17:32.558505] [INFO ] [MAIN ] GWH: Loaded 22019 existing records. [2025-11-03T19:17:32.762219] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-11-03T19:17:32.770029] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:32.770339] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-11-03T19:17:32.770389] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-11-03T19:17:32.770847] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-11-03T19:17:32.770916] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-11-03T19:17:33.180372] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:33.174128] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T19:17:33.383225] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:17:33.534863] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-11-03T19:17:34.069676] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T19:17:34.334889] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-11. [2025-11-03T19:17:35.134903] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-11-03T19:17:35.371825] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-11 (1.04 seconds). [2025-11-03T19:17:35.373351] [INFO ] [REMOTE ] GTLS: Full fetch complete (61241 records). [2025-11-03T19:17:35.373481] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-11-03T19:17:35.840174] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T19:17:35.941098] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-11-03T19:17:35.968154] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-11-03T19:17:35.968267] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-11-03T19:17:35.969736] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-11-03T19:17:35.969837] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-11-03T19:17:35.971508] [DEBUG] [LOCAL ] GTLS: Trimmed 61241 records to 42676 (keeping 200 days of data) [2025-11-03T19:17:36.321448] [DEBUG] [LOCAL ] GTLS: Primary data saved (42676 records). [2025-11-03T19:17:36.321588] [INFO ] [MAIN ] GTLS: Full history saved. [2025-11-03T19:17:36.321698] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GTLS took 54.2s. Estimated remaining: 3h 14m 31s. Rate: 7.1 symbols/min [2025-11-03T19:17:36.527881] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-11-03T19:17:36.530601] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:36.571988] [DEBUG] [LOCAL ] GWRE: Loaded 39752 existing records from primary storage. [2025-11-03T19:17:36.572312] [INFO ] [MAIN ] GWRE: Loaded 39752 existing records. [2025-11-03T19:17:36.747506] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-11-03T19:17:36.752833] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:36.754513] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-11-03T19:17:36.754592] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-11-03T19:17:36.755302] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-11-03T19:17:36.755363] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-11-03T19:17:37.112076] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:37.534901] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-11-03T19:17:37.908350] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-11-03T19:17:37.933729] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T19:17:38.334850] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-11-03T19:17:39.064634] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-11-03T19:17:39.134877] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-11-03T19:17:39.876782] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T19:17:39.934874] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-11-03T19:17:40.734902] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-11-03T19:17:40.780913] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T19:17:41.534883] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-11-03T19:17:41.842843] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-11-03T19:17:42.268065] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T19:17:42.334841] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-11-03T19:17:43.044055] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T19:17:43.134861] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-11-03T19:17:43.934842] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-11-03T19:17:44.380847] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-11-03T19:17:44.434032] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:17:44.734886] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-11-03T19:17:45.534834] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-11-03T19:17:45.862429] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:17:46.123493] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T19:17:46.334844] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-11-03T19:17:47.134877] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-11-03T19:17:47.634965] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-11-03T19:17:47.934844] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-11. [2025-11-03T19:17:48.174153] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T19:17:48.425360] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-11 (0.49 seconds). [2025-11-03T19:17:48.426322] [INFO ] [REMOTE ] GUG: Full fetch complete (18495 records). [2025-11-03T19:17:48.426392] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-11-03T19:17:48.740033] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-11-03T19:17:48.871284] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-11-03T19:17:48.871363] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-11-03T19:17:48.871830] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-11-03T19:17:48.871893] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-11-03T19:17:48.872411] [DEBUG] [LOCAL ] GUG: Trimmed 18495 records to 11856 (keeping 200 days of data) [2025-11-03T19:17:48.953144] [DEBUG] [LOCAL ] GUG: Primary data saved (11856 records). [2025-11-03T19:17:48.953297] [INFO ] [MAIN ] GUG: Full history saved. [2025-11-03T19:17:48.953389] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GUG took 44.8s. Estimated remaining: 3h 14m 29s. Rate: 7.1 symbols/min [2025-11-03T19:17:49.161473] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:49.181973] [DEBUG] [LOCAL ] GWW: Loaded 19272 existing records from primary storage. [2025-11-03T19:17:49.182198] [INFO ] [MAIN ] GWW: Loaded 19272 existing records. [2025-11-03T19:17:49.376525] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:49.376755] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-11-03T19:17:49.376806] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-11-03T19:17:49.377229] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-11-03T19:17:49.377289] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-11-03T19:17:49.550332] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-11-03T19:17:49.752636] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:49.940972] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T19:17:50.334848] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-11-03T19:17:51.134847] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-11-03T19:17:51.327530] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-11-03T19:17:51.357939] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T19:17:51.932197] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T19:17:51.938283] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-11-03T19:17:52.672521] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T19:17:52.734813] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-11. [2025-11-03T19:17:53.534876] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-11-03T19:17:54.266356] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-11 (1.53 seconds). [2025-11-03T19:17:54.267440] [INFO ] [REMOTE ] GWH: Full fetch complete (26416 records). [2025-11-03T19:17:54.267524] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-11-03T19:17:54.339950] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-11-03T19:17:54.684243] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-11-03T19:17:54.684321] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-11-03T19:17:54.684909] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-11-03T19:17:54.684969] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-11-03T19:17:54.685618] [DEBUG] [LOCAL ] GWH: Trimmed 26416 records to 22068 (keeping 200 days of data) [2025-11-03T19:17:54.808877] [DEBUG] [LOCAL ] GWH: Primary data saved (22068 records). [2025-11-03T19:17:54.809108] [INFO ] [MAIN ] GWH: Full history saved. [2025-11-03T19:17:54.809218] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GWH took 22.5s. Estimated remaining: 3h 14m 17s. Rate: 7.1 symbols/min [2025-11-03T19:17:54.977809] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:17:55.000966] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:17:55.047283] [DEBUG] [LOCAL ] GXO: Loaded 46626 existing records from primary storage. [2025-11-03T19:17:55.047575] [INFO ] [MAIN ] GXO: Loaded 46626 existing records. [2025-11-03T19:17:55.142351] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-11-03T19:17:55.225436] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:17:55.225636] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-11-03T19:17:55.225726] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-11-03T19:17:55.226481] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-11-03T19:17:55.226542] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-11-03T19:17:55.604469] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:17:55.622937] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-11-03T19:17:55.934865] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-11-03T19:17:56.473024] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:17:56.734918] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-11-03T19:17:57.171515] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T19:17:57.534913] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-11-03T19:17:57.809398] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T19:17:58.334916] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-11-03T19:17:58.666754] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:17:59.134879] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-11-03T19:17:59.224938] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T19:17:59.934919] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-11-03T19:18:00.227845] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T19:18:00.734822] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-11-03T19:18:00.780269] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T19:18:01.534853] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-11-03T19:18:01.857844] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T19:18:02.334959] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-11. [2025-11-03T19:18:02.637903] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T19:18:03.117671] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T19:18:03.118800] [INFO ] [REMOTE ] GVA: Full fetch complete (48502 records). [2025-11-03T19:18:03.118873] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-11-03T19:18:03.140065] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-11-03T19:18:03.511731] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-11-03T19:18:03.511829] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-11-03T19:18:03.512550] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-11-03T19:18:03.512610] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-11-03T19:18:03.513583] [DEBUG] [LOCAL ] GVA: Trimmed 48502 records to 31800 (keeping 200 days of data) [2025-11-03T19:18:03.711119] [DEBUG] [LOCAL ] GVA: Primary data saved (31800 records). [2025-11-03T19:18:03.711253] [INFO ] [MAIN ] GVA: Full history saved. [2025-11-03T19:18:03.711336] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GVA took 34.4s. Estimated remaining: 3h 14m 9s. Rate: 7.1 symbols/min [2025-11-03T19:18:03.901330] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:18:03.904482] [DEBUG] [LOCAL ] GYLD: Loaded 1530 existing records from primary storage. [2025-11-03T19:18:03.904624] [INFO ] [MAIN ] GYLD: Loaded 1530 existing records. [2025-11-03T19:18:03.937987] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-11-03T19:18:04.096045] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:18:04.110720] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T19:18:04.110237] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-11-03T19:18:04.115604] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-11-03T19:18:04.116403] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-11-03T19:18:04.116460] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-11-03T19:18:04.471698] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:18:04.734861] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-11-03T19:18:04.966842] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-11-03T19:18:05.157728] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T19:18:05.534921] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-11-03T19:18:06.334948] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-11-03T19:18:06.671854] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T19:18:07.039734] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T19:18:07.134888] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-11. [2025-11-03T19:18:07.934898] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-11-03T19:18:08.030111] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T19:18:08.031416] [INFO ] [REMOTE ] GWRE: Full fetch complete (59685 records). [2025-11-03T19:18:08.031501] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-11-03T19:18:08.410946] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-11-03T19:18:08.411034] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-11-03T19:18:08.411886] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-11-03T19:18:08.411949] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-11-03T19:18:08.413245] [DEBUG] [LOCAL ] GWRE: Trimmed 59685 records to 39230 (keeping 200 days of data) [2025-11-03T19:18:08.637050] [DEBUG] [LOCAL ] GWRE: Primary data saved (39230 records). [2025-11-03T19:18:08.637182] [INFO ] [MAIN ] GWRE: Full history saved. [2025-11-03T19:18:08.637257] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GWRE took 32.3s. Estimated remaining: 3h 13m 56s. Rate: 7.1 symbols/min [2025-11-03T19:18:08.736816] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-11-03T19:18:08.806406] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:18:08.848013] [DEBUG] [LOCAL ] H: Loaded 44904 existing records from primary storage. [2025-11-03T19:18:08.848298] [INFO ] [MAIN ] H: Loaded 44904 existing records. [2025-11-03T19:18:09.024700] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:18:09.024903] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-11-03T19:18:09.024948] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-11-03T19:18:09.025771] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-11-03T19:18:09.025828] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-11-03T19:18:09.184731] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-11-03T19:18:09.395931] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:18:09.433149] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-11-03T19:18:09.534865] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-11-03T19:18:10.246435] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:18:10.334860] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-11-03T19:18:11.134830] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-11-03T19:18:11.168951] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T19:18:11.934905] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-11-03T19:18:12.247020] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-11-03T19:18:12.283947] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:18:12.734847] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-11-03T19:18:13.534903] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-11-03T19:18:14.016986] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T19:18:14.242271] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T19:18:14.334861] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-11-03T19:18:15.134855] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-11-03T19:18:15.428538] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T19:18:15.890431] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T19:18:15.934811] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-11-03T19:18:16.729907] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-11-03T19:18:16.734847] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-11. [2025-11-03T19:18:17.534923] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-11-03T19:18:17.748102] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T19:18:17.749278] [INFO ] [REMOTE ] GWW: Full fetch complete (29209 records). [2025-11-03T19:18:17.749352] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-11-03T19:18:18.132276] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-11-03T19:18:18.132369] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-11-03T19:18:18.133019] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-11-03T19:18:18.133086] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-11-03T19:18:18.133938] [DEBUG] [LOCAL ] GWW: Trimmed 29209 records to 19161 (keeping 200 days of data) [2025-11-03T19:18:18.251736] [DEBUG] [LOCAL ] GWW: Primary data saved (19161 records). [2025-11-03T19:18:18.251864] [INFO ] [MAIN ] GWW: Full history saved. [2025-11-03T19:18:18.251938] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GWW took 29.3s. Estimated remaining: 3h 13m 49s. Rate: 7.1 symbols/min [2025-11-03T19:18:18.344890] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-11-03T19:18:18.431523] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:18:18.465830] [DEBUG] [LOCAL ] HAE: Loaded 39312 existing records from primary storage. [2025-11-03T19:18:18.466123] [INFO ] [MAIN ] HAE: Loaded 39312 existing records. [2025-11-03T19:18:18.650991] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:18:18.651254] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-11-03T19:18:18.651395] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-11-03T19:18:18.652044] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-11-03T19:18:18.652102] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-11-03T19:18:18.741166] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-11-03T19:18:19.021949] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:18:19.049557] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T19:18:19.134871] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-11-03T19:18:19.934885] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-11-03T19:18:20.497932] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T19:18:20.734885] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-11-03T19:18:20.816781] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T19:18:21.028152] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:18:21.534865] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-11-03T19:18:22.334882] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-11-03T19:18:22.639555] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-11-03T19:18:22.735381] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T19:18:23.134873] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-11-03T19:18:23.934870] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-11-03T19:18:24.414099] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T19:18:24.734869] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-11-03T19:18:25.121236] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:18:25.534905] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-11-03T19:18:25.829940] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T19:18:26.334909] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-11-03T19:18:26.754959] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T19:18:27.134889] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-11-03T19:18:27.482817] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T19:18:27.934906] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-11-03T19:18:28.173558] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-11-03T19:18:28.279265] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T19:18:28.734922] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-11-03T19:18:29.534871] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-11-03T19:18:29.824903] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-11-03T19:18:29.893538] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T19:18:30.334917] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-11-03T19:18:31.134891] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-11-03T19:18:31.467931] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T19:18:31.473348] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:18:31.934859] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-11-03T19:18:32.734850] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-11-03T19:18:33.065770] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T19:18:33.534917] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-11-03T19:18:33.890292] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T19:18:34.334897] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-11-03T19:18:34.635495] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.30 seconds). [2025-11-03T19:18:34.681462] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:18:35.134885] [INFO ] [REMOTE ] H: Fetching primary data for 2025-11. [2025-11-03T19:18:35.934864] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-11-03T19:18:36.260768] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T19:18:36.262141] [INFO ] [REMOTE ] H: Full fetch complete (63963 records). [2025-11-03T19:18:36.262229] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-11-03T19:18:36.642320] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-11-03T19:18:36.642416] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-11-03T19:18:36.643296] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-11-03T19:18:36.643361] [DEBUG] [LOCAL ] H: Saving primary data. [2025-11-03T19:18:36.644682] [DEBUG] [LOCAL ] H: Trimmed 63963 records to 44268 (keeping 200 days of data) [2025-11-03T19:18:36.734956] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-11-03T19:18:36.927481] [DEBUG] [LOCAL ] H: Primary data saved (44268 records). [2025-11-03T19:18:36.927784] [INFO ] [MAIN ] H: Full history saved. [2025-11-03T19:18:36.927898] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. H took 28.3s. Estimated remaining: 3h 13m 55s. Rate: 7.1 symbols/min [2025-11-03T19:18:37.102102] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:18:37.133455] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T19:18:37.177551] [DEBUG] [LOCAL ] HAFN: Loaded 42941 existing records from primary storage. [2025-11-03T19:18:37.177915] [INFO ] [MAIN ] HAFN: Loaded 42941 existing records. [2025-11-03T19:18:37.353205] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:18:37.353448] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-11-03T19:18:37.353505] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-11-03T19:18:37.354254] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-11-03T19:18:37.354311] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-11-03T19:18:37.540947] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-11. [2025-11-03T19:18:37.709289] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:18:37.845254] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:18:37.952559] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-11 (0.41 seconds). [2025-11-03T19:18:37.953581] [INFO ] [REMOTE ] GYLD: Full fetch complete (2145 records). [2025-11-03T19:18:37.953692] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-11-03T19:18:38.339145] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-11-03T19:18:38.346082] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-11-03T19:18:38.346214] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-11-03T19:18:38.346406] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-11-03T19:18:38.346473] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-11-03T19:18:38.347094] [DEBUG] [LOCAL ] GYLD: Trimmed 2145 records to 1525 (keeping 200 days of data) [2025-11-03T19:18:38.358915] [DEBUG] [LOCAL ] GYLD: Primary data saved (1525 records). [2025-11-03T19:18:38.359185] [INFO ] [MAIN ] GYLD: Full history saved. [2025-11-03T19:18:38.359300] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GYLD took 34.6s. Estimated remaining: 3h 13m 37s. Rate: 7.1 symbols/min [2025-11-03T19:18:38.535014] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:18:38.587870] [DEBUG] [LOCAL ] HAL: Loaded 54498 existing records from primary storage. [2025-11-03T19:18:38.588271] [INFO ] [MAIN ] HAL: Loaded 54498 existing records. [2025-11-03T19:18:38.771435] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:18:38.771768] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-11-03T19:18:38.771825] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-11-03T19:18:38.773105] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-11-03T19:18:38.773163] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-11-03T19:18:39.142294] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-11-03T19:18:39.186346] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:18:39.459519] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T19:18:39.934847] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-11-03T19:18:40.472560] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T19:18:40.734855] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-11-03T19:18:41.468036] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-11-03T19:18:41.534902] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-11-03T19:18:41.920460] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T19:18:42.334874] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-11. [2025-11-03T19:18:42.476256] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T19:18:43.134845] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-11-03T19:18:43.320306] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:18:43.321814] [INFO ] [REMOTE ] GXO: Full fetch complete (69030 records). [2025-11-03T19:18:43.321903] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-11-03T19:18:43.706143] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-11-03T19:18:43.706239] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-11-03T19:18:43.707148] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-11-03T19:18:43.707209] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-11-03T19:18:43.708463] [DEBUG] [LOCAL ] GXO: Trimmed 69030 records to 45853 (keeping 200 days of data) [2025-11-03T19:18:43.935392] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-11-03T19:18:43.969912] [DEBUG] [LOCAL ] GXO: Primary data saved (45853 records). [2025-11-03T19:18:43.970038] [INFO ] [MAIN ] GXO: Full history saved. [2025-11-03T19:18:43.971056] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. GXO took 49.2s. Estimated remaining: 3h 13m 24s. Rate: 7.1 symbols/min [2025-11-03T19:18:44.145173] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:18:44.186691] [DEBUG] [LOCAL ] HASI: Loaded 47986 existing records from primary storage. [2025-11-03T19:18:44.186973] [INFO ] [MAIN ] HASI: Loaded 47986 existing records. [2025-11-03T19:18:44.369116] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:18:44.369463] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-11-03T19:18:44.369528] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-11-03T19:18:44.370429] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-11-03T19:18:44.370488] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-11-03T19:18:44.735115] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-11-03T19:18:44.764784] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:18:44.768226] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-11-03T19:18:44.940453] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T19:18:45.534845] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-11-03T19:18:46.223728] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-11-03T19:18:46.334846] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-11-03T19:18:46.780932] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T19:18:47.134848] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-11-03T19:18:47.520033] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T19:18:47.934844] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-11-03T19:18:48.539879] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:18:48.734841] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-11-03T19:18:49.141418] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T19:18:49.534840] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-11-03T19:18:50.257630] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T19:18:50.334817] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-11-03T19:18:50.717328] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T19:18:51.134843] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-11-03T19:18:51.564194] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T19:18:51.934826] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-11-03T19:18:52.174335] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T19:18:52.734914] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-11-03T19:18:53.120733] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:18:53.534908] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-11-03T19:18:53.968254] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T19:18:54.334915] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-11-03T19:18:54.775311] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T19:18:55.134870] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-11-03T19:18:55.508292] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T19:18:55.934905] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-11-03T19:18:56.473792] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T19:18:56.734859] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-11-03T19:18:56.906774] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T19:18:57.534921] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-11-03T19:18:58.252281] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-11-03T19:18:58.334856] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-11-03T19:18:58.505460] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T19:18:59.134892] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-11. [2025-11-03T19:18:59.833491] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T19:18:59.934886] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-11-03T19:19:00.049247] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T19:19:00.050692] [INFO ] [REMOTE ] HAE: Full fetch complete (59305 records). [2025-11-03T19:19:00.050823] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-11-03T19:19:00.438243] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-11-03T19:19:00.438327] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-11-03T19:19:00.439150] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-11-03T19:19:00.439224] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-11-03T19:19:00.440394] [DEBUG] [LOCAL ] HAE: Trimmed 59305 records to 38785 (keeping 200 days of data) [2025-11-03T19:19:00.662416] [DEBUG] [LOCAL ] HAE: Primary data saved (38785 records). [2025-11-03T19:19:00.662581] [INFO ] [MAIN ] HAE: Full history saved. [2025-11-03T19:19:00.662683] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. HAE took 42.4s. Estimated remaining: 3h 13m 28s. Rate: 7.1 symbols/min [2025-11-03T19:19:00.739953] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-11-03T19:19:00.833872] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:00.877009] [DEBUG] [LOCAL ] HAYW: Loaded 49491 existing records from primary storage. [2025-11-03T19:19:00.877309] [INFO ] [MAIN ] HAYW: Loaded 49491 existing records. [2025-11-03T19:19:01.052967] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:01.053174] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-11-03T19:19:01.053221] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-11-03T19:19:01.053998] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-11-03T19:19:01.054054] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-11-03T19:19:01.417440] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:01.445762] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-11-03T19:19:01.534846] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-11-03T19:19:02.334839] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-11-03T19:19:02.367131] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-11-03T19:19:02.730443] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T19:19:03.134885] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-11-03T19:19:03.502075] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:19:03.934899] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-11-03T19:19:04.250519] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T19:19:04.734921] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-11-03T19:19:05.434715] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-11-03T19:19:05.534885] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-11-03T19:19:05.888893] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T19:19:06.334861] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-11-03T19:19:07.134868] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-11-03T19:19:07.254887] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-11-03T19:19:07.495437] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:19:07.934857] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-11. [2025-11-03T19:19:08.239811] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:19:08.734855] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-11-03T19:19:09.323387] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-11 (1.39 seconds). [2025-11-03T19:19:09.325237] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-11-03T19:19:09.325345] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-11-03T19:19:09.543697] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-11-03T19:19:09.762591] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-11-03T19:19:09.762888] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-11-03T19:19:09.763956] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-11-03T19:19:09.764020] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-11-03T19:19:09.765471] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-11-03T19:19:10.009250] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:19:10.137030] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-11-03T19:19:10.137164] [INFO ] [MAIN ] HAL: Full history saved. [2025-11-03T19:19:10.137244] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. HAL took 31.8s. Estimated remaining: 3h 13m 21s. Rate: 7.1 symbols/min [2025-11-03T19:19:10.305159] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:10.311932] [DEBUG] [LOCAL ] HBB: Loaded 5971 existing records from primary storage. [2025-11-03T19:19:10.312101] [INFO ] [MAIN ] HBB: Loaded 5971 existing records. [2025-11-03T19:19:10.342273] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-11-03T19:19:10.522824] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:10.523091] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-11-03T19:19:10.523151] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-11-03T19:19:10.523409] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-11-03T19:19:10.523468] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-11-03T19:19:10.971995] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:11.011498] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T19:19:11.134859] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-11-03T19:19:11.688550] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T19:19:11.934855] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-11. [2025-11-03T19:19:12.390472] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:19:12.734879] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-11-03T19:19:13.045023] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T19:19:13.046541] [INFO ] [REMOTE ] HASI: Full fetch complete (68260 records). [2025-11-03T19:19:13.046712] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-11-03T19:19:13.165027] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-11-03T19:19:13.445021] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-11-03T19:19:13.445097] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-11-03T19:19:13.445947] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-11-03T19:19:13.446007] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-11-03T19:19:13.447221] [DEBUG] [LOCAL ] HASI: Trimmed 68260 records to 47238 (keeping 200 days of data) [2025-11-03T19:19:13.537696] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-11-03T19:19:13.724021] [DEBUG] [LOCAL ] HASI: Primary data saved (47238 records). [2025-11-03T19:19:13.724137] [INFO ] [MAIN ] HASI: Full history saved. [2025-11-03T19:19:13.724916] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HASI took 29.8s. Estimated remaining: 3h 13m 5s. Rate: 7.1 symbols/min [2025-11-03T19:19:13.890862] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:13.943041] [DEBUG] [LOCAL ] HBI: Loaded 53646 existing records from primary storage. [2025-11-03T19:19:13.943506] [INFO ] [MAIN ] HBI: Loaded 53646 existing records. [2025-11-03T19:19:14.049762] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-11-03T19:19:14.127421] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:14.127710] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-11-03T19:19:14.127767] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-11-03T19:19:14.128535] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-11-03T19:19:14.128591] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-11-03T19:19:14.339990] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-11-03T19:19:14.479605] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:14.895345] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T19:19:15.134849] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-11-03T19:19:15.934928] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-11-03T19:19:16.320909] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:19:16.734954] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-11-03T19:19:17.143562] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T19:19:17.534863] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-11-03T19:19:17.851821] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-11-03T19:19:18.334924] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-11-03T19:19:18.726230] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:19:18.951923] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-11-03T19:19:19.134820] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-11-03T19:19:19.615860] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T19:19:19.934843] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-11-03T19:19:20.734869] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-11-03T19:19:21.224689] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:19:21.534863] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-11-03T19:19:21.983057] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:19:22.334886] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-11-03T19:19:22.781987] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:19:23.134898] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-11-03T19:19:23.583587] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:19:23.934856] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-11-03T19:19:24.231971] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:19:24.290598] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T19:19:24.734917] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-11-03T19:19:25.534883] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-11-03T19:19:25.940077] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T19:19:25.960720] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-11-03T19:19:26.334851] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-11-03T19:19:26.831572] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T19:19:27.134850] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-11-03T19:19:27.934836] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-11-03T19:19:28.486479] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-11-03T19:19:28.734923] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-11. [2025-11-03T19:19:29.003627] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-11-03T19:19:29.534858] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-11-03T19:19:29.708108] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T19:19:29.709861] [INFO ] [REMOTE ] HAFN: Full fetch complete (64246 records). [2025-11-03T19:19:29.709974] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-11-03T19:19:30.111435] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-11-03T19:19:30.111522] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-11-03T19:19:30.112464] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-11-03T19:19:30.112532] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-11-03T19:19:30.113900] [DEBUG] [LOCAL ] HAFN: Trimmed 64246 records to 42173 (keeping 200 days of data) [2025-11-03T19:19:30.338092] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-11-03T19:19:30.358670] [DEBUG] [LOCAL ] HAFN: Primary data saved (42173 records). [2025-11-03T19:19:30.358766] [INFO ] [MAIN ] HAFN: Full history saved. [2025-11-03T19:19:30.358838] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HAFN took 53.4s. Estimated remaining: 3h 13m 8s. Rate: 7.1 symbols/min [2025-11-03T19:19:30.526034] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:30.573169] [DEBUG] [LOCAL ] HBM: Loaded 53758 existing records from primary storage. [2025-11-03T19:19:30.573483] [INFO ] [MAIN ] HBM: Loaded 53758 existing records. [2025-11-03T19:19:30.751549] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:30.752288] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-11-03T19:19:30.755717] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-11-03T19:19:30.755893] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-11-03T19:19:30.759124] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-11-03T19:19:30.759195] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-11-03T19:19:31.081538] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-11-03T19:19:31.139936] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-11. [2025-11-03T19:19:31.193028] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:31.934843] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-11-03T19:19:32.300185] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T19:19:32.305457] [INFO ] [REMOTE ] HAYW: Full fetch complete (70977 records). [2025-11-03T19:19:32.306200] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.37 seconds). [2025-11-03T19:19:32.306257] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-11-03T19:19:32.695056] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-11-03T19:19:32.695169] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-11-03T19:19:32.696080] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-11-03T19:19:32.696179] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-11-03T19:19:32.697575] [DEBUG] [LOCAL ] HAYW: Trimmed 70977 records to 48824 (keeping 200 days of data) [2025-11-03T19:19:32.744911] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-11. [2025-11-03T19:19:32.979335] [DEBUG] [LOCAL ] HAYW: Primary data saved (48824 records). [2025-11-03T19:19:32.979461] [INFO ] [MAIN ] HAYW: Full history saved. [2025-11-03T19:19:32.979538] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HAYW took 32.3s. Estimated remaining: 3h 12m 52s. Rate: 7.1 symbols/min [2025-11-03T19:19:33.149603] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:33.189256] [DEBUG] [LOCAL ] HCA: Loaded 47483 existing records from primary storage. [2025-11-03T19:19:33.189546] [INFO ] [MAIN ] HCA: Loaded 47483 existing records. [2025-11-03T19:19:33.263306] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-11 (0.52 seconds). [2025-11-03T19:19:33.295861] [INFO ] [REMOTE ] HBB: Full fetch complete (9034 records). [2025-11-03T19:19:33.298370] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-11-03T19:19:33.493098] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:33.503599] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-11-03T19:19:33.517123] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-11-03T19:19:33.537671] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-11-03T19:19:33.581432] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-11-03T19:19:33.581518] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-11-03T19:19:34.012963] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-11-03T19:19:34.030574] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-11-03T19:19:34.042128] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-11-03T19:19:34.042476] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-11-03T19:19:34.063718] [DEBUG] [LOCAL ] HBB: Trimmed 9034 records to 5745 (keeping 200 days of data) [2025-11-03T19:19:34.137601] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:34.154313] [DEBUG] [LOCAL ] HBB: Primary data saved (5745 records). [2025-11-03T19:19:34.154379] [INFO ] [MAIN ] HBB: Full history saved. [2025-11-03T19:19:34.154446] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HBB took 24.0s. Estimated remaining: 3h 12m 33s. Rate: 7.1 symbols/min [2025-11-03T19:19:34.326176] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:34.334888] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-11-03T19:19:34.364383] [DEBUG] [LOCAL ] HCC: Loaded 45174 existing records from primary storage. [2025-11-03T19:19:34.364702] [INFO ] [MAIN ] HCC: Loaded 45174 existing records. [2025-11-03T19:19:34.551064] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:34.551236] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-11-03T19:19:34.551282] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-11-03T19:19:34.552067] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-11-03T19:19:34.552122] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-11-03T19:19:34.907838] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:34.948210] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T19:19:35.134867] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-11-03T19:19:35.628560] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T19:19:35.934907] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-11-03T19:19:36.344459] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T19:19:36.734877] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-11-03T19:19:37.261150] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T19:19:37.534894] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-11-03T19:19:38.050899] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T19:19:38.334859] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-11-03T19:19:38.514243] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T19:19:39.134922] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-11-03T19:19:39.545216] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T19:19:39.934888] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-11-03T19:19:40.449559] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T19:19:40.734899] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-11-03T19:19:41.335214] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T19:19:41.534854] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-11-03T19:19:41.921587] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:19:42.334853] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-11-03T19:19:42.671477] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T19:19:43.134883] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-11-03T19:19:43.754155] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-11-03T19:19:43.934844] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-11-03T19:19:44.379563] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T19:19:44.734858] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-11-03T19:19:45.190286] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:19:45.534845] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-11-03T19:19:45.992483] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:19:46.334818] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-11-03T19:19:46.872827] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-11-03T19:19:47.134854] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-11. [2025-11-03T19:19:47.507599] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:19:47.934859] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-11-03T19:19:48.064324] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T19:19:48.066190] [INFO ] [REMOTE ] HBI: Full fetch complete (76930 records). [2025-11-03T19:19:48.066291] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-11-03T19:19:48.541202] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-11-03T19:19:48.541309] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-11-03T19:19:48.542452] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-11-03T19:19:48.542518] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-11-03T19:19:48.544152] [DEBUG] [LOCAL ] HBI: Trimmed 76930 records to 52858 (keeping 200 days of data) [2025-11-03T19:19:48.734855] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-11-03T19:19:48.835858] [DEBUG] [LOCAL ] HBI: Primary data saved (52858 records). [2025-11-03T19:19:48.835982] [INFO ] [MAIN ] HBI: Full history saved. [2025-11-03T19:19:48.836979] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HBI took 35.1s. Estimated remaining: 3h 12m 34s. Rate: 7.1 symbols/min [2025-11-03T19:19:49.008793] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:19:49.025393] [DEBUG] [LOCAL ] HCI: Loaded 14038 existing records from primary storage. [2025-11-03T19:19:49.025592] [INFO ] [MAIN ] HCI: Loaded 14038 existing records. [2025-11-03T19:19:49.211066] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:19:49.211380] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-11-03T19:19:49.211452] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-11-03T19:19:49.211868] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-11-03T19:19:49.211968] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-11-03T19:19:49.544457] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-11-03T19:19:49.598351] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-11-03T19:19:49.619812] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:19:50.030870] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T19:19:50.334884] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-11-03T19:19:50.773348] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T19:19:50.811077] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-11-03T19:19:51.134853] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-11-03T19:19:51.934862] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-11-03T19:19:52.343191] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T19:19:52.734858] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-11-03T19:19:53.130817] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:19:53.534877] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-11-03T19:19:53.985795] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T19:19:54.334889] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-11-03T19:19:54.897965] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T19:19:55.102392] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T19:19:55.134817] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-11-03T19:19:55.934841] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-11-03T19:19:56.507804] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T19:19:56.668563] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T19:19:56.734833] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-11-03T19:19:57.370422] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-11-03T19:19:57.534853] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-11-03T19:19:58.049464] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-11-03T19:19:58.334864] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-11-03T19:19:59.134852] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-11-03T19:19:59.535021] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T19:19:59.830520] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T19:19:59.934860] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-11-03T19:20:00.734852] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-11-03T19:20:01.444200] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T19:20:01.534868] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-11-03T19:20:02.251329] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T19:20:02.334883] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-11-03T19:20:02.627208] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T19:20:03.134909] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-11-03T19:20:03.740958] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T19:20:03.934880] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-11-03T19:20:04.409412] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T19:20:04.734924] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-11-03T19:20:05.236491] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T19:20:05.534870] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-11-03T19:20:06.088614] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-11-03T19:20:06.334855] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-11-03T19:20:06.846126] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T19:20:07.007785] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T19:20:07.134853] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-11. [2025-11-03T19:20:07.934886] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-11-03T19:20:08.225523] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-11 (1.09 seconds). [2025-11-03T19:20:08.226968] [INFO ] [REMOTE ] HCC: Full fetch complete (64643 records). [2025-11-03T19:20:08.227075] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-11-03T19:20:08.639295] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-11-03T19:20:08.639411] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-11-03T19:20:08.648234] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-11-03T19:20:08.649154] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T19:20:08.648822] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-11-03T19:20:08.653679] [DEBUG] [LOCAL ] HCC: Trimmed 64643 records to 44523 (keeping 200 days of data) [2025-11-03T19:20:08.739912] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-11-03T19:20:08.917800] [DEBUG] [LOCAL ] HCC: Primary data saved (44523 records). [2025-11-03T19:20:08.917930] [INFO ] [MAIN ] HCC: Full history saved. [2025-11-03T19:20:08.918012] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HCC took 34.8s. Estimated remaining: 3h 12m 41s. Rate: 7.1 symbols/min [2025-11-03T19:20:09.092724] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:09.092969] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-11-03T19:20:09.093026] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-11-03T19:20:09.093103] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-11-03T19:20:09.093142] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-11-03T19:20:09.093182] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-11-03T19:20:09.093231] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-11-03T19:20:09.459827] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:09.534822] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-11-03T19:20:09.736608] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-11-03T19:20:10.244034] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T19:20:10.334840] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-11-03T19:20:10.948849] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-11-03T19:20:11.134931] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-11-03T19:20:11.386573] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-11-03T19:20:11.934863] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-11. [2025-11-03T19:20:12.734876] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-11-03T19:20:13.431366] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T19:20:13.534851] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-11. [2025-11-03T19:20:14.334874] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-11-03T19:20:14.567262] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-11-03T19:20:14.850836] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T19:20:14.852850] [INFO ] [REMOTE ] HBM: Full fetch complete (76852 records). [2025-11-03T19:20:14.852979] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-11-03T19:20:14.978825] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-11 (3.04 seconds). [2025-11-03T19:20:15.003421] [INFO ] [REMOTE ] HCA: Full fetch complete (68949 records). [2025-11-03T19:20:15.027153] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-11-03T19:20:15.139052] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-11. [2025-11-03T19:20:15.737741] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-11-03T19:20:15.737944] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-11-03T19:20:15.739346] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-11-03T19:20:15.739439] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-11-03T19:20:15.801924] [DEBUG] [LOCAL ] HBM: Trimmed 76852 records to 52987 (keeping 200 days of data) [2025-11-03T19:20:15.839425] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-11-03T19:20:15.839945] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-11-03T19:20:15.840687] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-11-03T19:20:15.840753] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-11-03T19:20:15.936205] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-11-03T19:20:15.936457] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-11 (0.80 seconds). [2025-11-03T19:20:15.948997] [DEBUG] [LOCAL ] HCA: Trimmed 68949 records to 46872 (keeping 200 days of data) [2025-11-03T19:20:15.949182] [INFO ] [REMOTE ] HCI: Full fetch complete (19628 records). [2025-11-03T19:20:15.951291] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-11-03T19:20:16.294303] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-11-03T19:20:16.747791] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-11-03T19:20:16.795357] [DEBUG] [LOCAL ] HBM: Primary data saved (52987 records). [2025-11-03T19:20:16.851688] [INFO ] [MAIN ] HBM: Full history saved. [2025-11-03T19:20:16.862933] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HBM took 46.5s. Estimated remaining: 3h 12m 32s. Rate: 7.1 symbols/min [2025-11-03T19:20:16.895398] [DEBUG] [LOCAL ] HCA: Primary data saved (46872 records). [2025-11-03T19:20:16.909143] [INFO ] [MAIN ] HCA: Full history saved. [2025-11-03T19:20:16.909539] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HCA took 43.9s. Estimated remaining: 3h 12m 12s. Rate: 7.1 symbols/min [2025-11-03T19:20:16.933402] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-11-03T19:20:16.933453] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-11-03T19:20:16.933894] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-11-03T19:20:16.933953] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-11-03T19:20:16.934496] [DEBUG] [LOCAL ] HCI: Trimmed 19628 records to 13872 (keeping 200 days of data) [2025-11-03T19:20:17.036256] [DEBUG] [LOCAL ] HCI: Primary data saved (13872 records). [2025-11-03T19:20:17.037018] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:20:17.037221] [INFO ] [MAIN ] HCI: Full history saved. [2025-11-03T19:20:17.038329] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HCI took 28.2s. Estimated remaining: 3h 11m 52s. Rate: 7.1 symbols/min [2025-11-03T19:20:17.534917] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-11-03T19:20:17.883408] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-11-03T19:20:18.334883] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-11-03T19:20:18.544818] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-11-03T19:20:19.134910] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-11-03T19:20:19.346164] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.21 seconds). [2025-11-03T19:20:19.934918] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-11-03T19:20:20.153486] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-11-03T19:20:20.734920] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-11-03T19:20:21.025664] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T19:20:21.534925] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-11. [2025-11-03T19:20:21.891055] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-11 (0.36 seconds). [2025-11-03T19:20:21.891709] [INFO ] [REMOTE ] HCXY: Full fetch complete (525 records). [2025-11-03T19:20:21.891779] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-11-03T19:20:22.097831] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-11-03T19:20:22.098025] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:20:22.098112] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:20:22.098203] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-11-03T19:20:22.098296] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-11-03T19:20:22.098369] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-11-03T19:20:22.098429] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-11-03T19:20:22.098487] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCXY took 13.2s. Estimated remaining: 3h 11m 39s. Rate: 7.1 symbols/min [2025-11-03T19:20:22.758796] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:22.802265] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:22.813341] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:22.815067] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:22.884382] [DEBUG] [LOCAL ] HEI: Loaded 30121 existing records from primary storage. [2025-11-03T19:20:22.884941] [INFO ] [MAIN ] HEI: Loaded 30121 existing records. [2025-11-03T19:20:23.044930] [DEBUG] [LOCAL ] HDB: Loaded 52660 existing records from primary storage. [2025-11-03T19:20:23.044240] [DEBUG] [LOCAL ] HD: Loaded 54207 existing records from primary storage. [2025-11-03T19:20:23.051208] [DEBUG] [LOCAL ] HE: Loaded 49237 existing records from primary storage. [2025-11-03T19:20:23.067204] [INFO ] [MAIN ] HD: Loaded 54207 existing records. [2025-11-03T19:20:23.072583] [INFO ] [MAIN ] HDB: Loaded 52660 existing records. [2025-11-03T19:20:23.103700] [INFO ] [MAIN ] HE: Loaded 49237 existing records. [2025-11-03T19:20:23.220092] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:20:23.339429] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-11-03T19:20:23.448666] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-11-03T19:20:23.592762] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-11-03T19:20:23.693285] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:20:23.707924] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-11-03T19:20:23.707830] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:20:23.729128] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-11-03T19:20:23.732445] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-11-03T19:20:23.737729] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-11-03T19:20:23.765746] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-11-03T19:20:23.751188] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:20:23.786511] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-11-03T19:20:23.795756] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-11-03T19:20:23.801114] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-11-03T19:20:23.801231] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-11-03T19:20:23.795703] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-11-03T19:20:23.801394] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-11-03T19:20:23.830344] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-11-03T19:20:23.865255] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-11-03T19:20:25.467611] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:25.482370] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-11-03T19:20:25.476845] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:25.528455] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-11-03T19:20:25.612164] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:25.617706] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-11-03T19:20:25.647930] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:25.648383] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-11-03T19:20:26.788898] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:20:26.796758] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-11-03T19:20:26.968230] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T19:20:26.978922] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-11-03T19:20:27.020131] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T19:20:27.134885] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-11-03T19:20:27.215963] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T19:20:27.670459] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:20:27.934844] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-11-03T19:20:28.342542] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T19:20:28.446257] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T19:20:28.734899] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-11-03T19:20:29.494813] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T19:20:29.534819] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-11-03T19:20:30.025014] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:20:30.334894] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-11-03T19:20:30.841162] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:20:31.134904] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-11-03T19:20:31.927631] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T19:20:31.938224] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-11-03T19:20:32.447674] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T19:20:32.734906] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-11-03T19:20:32.836234] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-11-03T19:20:33.534933] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-11-03T19:20:34.214902] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T19:20:34.334847] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-11-03T19:20:34.620337] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T19:20:35.134907] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-11-03T19:20:35.929044] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-11-03T19:20:35.945253] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-11-03T19:20:36.203252] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T19:20:36.734857] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-11-03T19:20:37.194302] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:20:37.534876] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-11-03T19:20:37.674565] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T19:20:38.334872] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-11-03T19:20:38.722195] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T19:20:39.134900] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-11-03T19:20:39.331793] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-11-03T19:20:39.934851] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-11-03T19:20:40.393165] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:20:40.734842] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-11-03T19:20:41.537353] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-11-03T19:20:41.541398] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T19:20:41.706246] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-11-03T19:20:42.334858] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-11-03T19:20:42.837705] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T19:20:43.134902] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-11-03T19:20:43.939924] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-11-03T19:20:43.953339] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-11-03T19:20:44.258889] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-11-03T19:20:44.734850] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-11-03T19:20:45.357838] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T19:20:45.534837] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-11-03T19:20:46.334893] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-11-03T19:20:46.463509] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-11-03T19:20:46.712380] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T19:20:47.131345] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-11-03T19:20:47.136177] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-11-03T19:20:47.934840] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-11-03T19:20:48.355132] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T19:20:48.734869] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-11. [2025-11-03T19:20:49.221753] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T19:20:49.434884] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T19:20:49.436093] [INFO ] [REMOTE ] HEI: Full fetch complete (46181 records). [2025-11-03T19:20:49.436166] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-11-03T19:20:49.542679] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-11-03T19:20:49.818158] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-11-03T19:20:49.818234] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-11-03T19:20:49.818940] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-11-03T19:20:49.819001] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-11-03T19:20:49.819901] [DEBUG] [LOCAL ] HEI: Trimmed 46181 records to 29602 (keeping 200 days of data) [2025-11-03T19:20:50.005198] [DEBUG] [LOCAL ] HEI: Primary data saved (29602 records). [2025-11-03T19:20:50.005332] [INFO ] [MAIN ] HEI: Full history saved. [2025-11-03T19:20:50.005409] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HEI took 27.9s. Estimated remaining: 3h 11m 58s. Rate: 7.1 symbols/min [2025-11-03T19:20:50.172954] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:50.180442] [DEBUG] [LOCAL ] HEQ: Loaded 6670 existing records from primary storage. [2025-11-03T19:20:50.180615] [INFO ] [MAIN ] HEQ: Loaded 6670 existing records. [2025-11-03T19:20:50.336466] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-11. [2025-11-03T19:20:50.362423] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:20:50.362706] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-11-03T19:20:50.362775] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-11-03T19:20:50.363025] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-11-03T19:20:50.363083] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-11-03T19:20:50.716167] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:51.134885] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-11-03T19:20:51.275089] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-11-03T19:20:51.399454] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:20:51.400917] [INFO ] [REMOTE ] HE: Full fetch complete (71738 records). [2025-11-03T19:20:51.401023] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-11-03T19:20:51.796231] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-11-03T19:20:51.796311] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-11-03T19:20:51.797227] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-11-03T19:20:51.797291] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-11-03T19:20:51.798763] [DEBUG] [LOCAL ] HE: Trimmed 71738 records to 48484 (keeping 200 days of data) [2025-11-03T19:20:51.963835] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-11-03T19:20:52.089221] [DEBUG] [LOCAL ] HE: Primary data saved (48484 records). [2025-11-03T19:20:52.089379] [INFO ] [MAIN ] HE: Full history saved. [2025-11-03T19:20:52.089463] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HE took 30.0s. Estimated remaining: 3h 11m 41s. Rate: 7.1 symbols/min [2025-11-03T19:20:52.268152] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:52.299776] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-11-03T19:20:52.345723] [DEBUG] [LOCAL ] HESM: Loaded 49282 existing records from primary storage. [2025-11-03T19:20:52.346043] [INFO ] [MAIN ] HESM: Loaded 49282 existing records. [2025-11-03T19:20:52.536168] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:20:52.536896] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-11-03T19:20:52.539405] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-11-03T19:20:52.539469] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-11-03T19:20:52.540219] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-11-03T19:20:52.540276] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-11-03T19:20:52.740072] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-11-03T19:20:52.935719] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:53.534942] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-11-03T19:20:53.868436] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T19:20:54.164196] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T19:20:54.334856] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-11-03T19:20:54.823016] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-11-03T19:20:55.134863] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-11-03T19:20:55.934837] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-11-03T19:20:56.709703] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-11-03T19:20:56.734831] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-11. [2025-11-03T19:20:56.964741] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:20:57.534892] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-11-03T19:20:58.016478] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-11-03T19:20:58.227142] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-11 (1.49 seconds). [2025-11-03T19:20:58.228762] [INFO ] [REMOTE ] HD: Full fetch complete (77513 records). [2025-11-03T19:20:58.228861] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-11-03T19:20:58.339995] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-11-03T19:20:58.619061] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-11-03T19:20:58.619149] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-11-03T19:20:58.620104] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-11-03T19:20:58.620169] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-11-03T19:20:58.621593] [DEBUG] [LOCAL ] HD: Trimmed 77513 records to 53429 (keeping 200 days of data) [2025-11-03T19:20:58.953748] [DEBUG] [LOCAL ] HD: Primary data saved (53429 records). [2025-11-03T19:20:58.953901] [INFO ] [MAIN ] HD: Full history saved. [2025-11-03T19:20:58.953995] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HD took 36.9s. Estimated remaining: 3h 11m 30s. Rate: 7.1 symbols/min [2025-11-03T19:20:59.121795] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:20:59.121958] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-11-03T19:20:59.121995] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-11-03T19:20:59.122101] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-11-03T19:20:59.122141] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-11-03T19:20:59.122181] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-11-03T19:20:59.122211] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-11-03T19:20:59.142751] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-11-03T19:20:59.481403] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:20:59.773351] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-11-03T19:20:59.934858] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-11-03T19:21:00.132150] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.20 seconds). [2025-11-03T19:21:00.328190] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T19:21:00.734864] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-11-03T19:21:01.534823] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-11-03T19:21:01.912098] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T19:21:01.940988] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-11-03T19:21:02.334885] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-11-03T19:21:02.676092] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-11-03T19:21:03.134877] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-11-03T19:21:03.584019] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-11-03T19:21:03.934885] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-11-03T19:21:04.338819] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T19:21:04.734850] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-11-03T19:21:05.264392] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-11-03T19:21:05.534864] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-11-03T19:21:06.334869] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-11-03T19:21:06.963257] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T19:21:07.134883] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-11. [2025-11-03T19:21:07.645294] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:21:07.934859] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-11-03T19:21:08.123408] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:21:08.124926] [INFO ] [REMOTE ] HDB: Full fetch complete (75669 records). [2025-11-03T19:21:08.125048] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-11-03T19:21:08.520997] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-11-03T19:21:08.521092] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-11-03T19:21:08.525512] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-11-03T19:21:08.525635] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-11-03T19:21:08.529420] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T19:21:08.533046] [DEBUG] [LOCAL ] HDB: Trimmed 75669 records to 51874 (keeping 200 days of data) [2025-11-03T19:21:08.735179] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-11. [2025-11-03T19:21:08.841223] [DEBUG] [LOCAL ] HDB: Primary data saved (51874 records). [2025-11-03T19:21:08.841347] [INFO ] [MAIN ] HDB: Full history saved. [2025-11-03T19:21:08.841422] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HDB took 46.7s. Estimated remaining: 3h 11m 23s. Rate: 7.1 symbols/min [2025-11-03T19:21:09.014769] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:09.014927] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-11-03T19:21:09.014967] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-11-03T19:21:09.015078] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-11-03T19:21:09.015119] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-11-03T19:21:09.015162] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-11-03T19:21:09.015196] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-11-03T19:21:09.287169] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T19:21:09.311789] [INFO ] [REMOTE ] HEQ: Full fetch complete (9892 records). [2025-11-03T19:21:09.323434] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-11-03T19:21:09.517919] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:09.545063] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-11-03T19:21:09.760417] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-11-03T19:21:09.760493] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-11-03T19:21:09.760793] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-11-03T19:21:09.760885] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-11-03T19:21:09.761315] [DEBUG] [LOCAL ] HEQ: Trimmed 9892 records to 6659 (keeping 200 days of data) [2025-11-03T19:21:09.800219] [DEBUG] [LOCAL ] HEQ: Primary data saved (6659 records). [2025-11-03T19:21:09.800345] [INFO ] [MAIN ] HEQ: Full history saved. [2025-11-03T19:21:09.800421] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HEQ took 19.8s. Estimated remaining: 3h 11m 5s. Rate: 7.1 symbols/min [2025-11-03T19:21:09.892416] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-11-03T19:21:09.971575] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:09.986241] [DEBUG] [LOCAL ] HFRO: Loaded 15857 existing records from primary storage. [2025-11-03T19:21:09.986474] [INFO ] [MAIN ] HFRO: Loaded 15857 existing records. [2025-11-03T19:21:10.157961] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:21:10.158160] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-11-03T19:21:10.158227] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-11-03T19:21:10.158572] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-11-03T19:21:10.158629] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-11-03T19:21:10.340990] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-11-03T19:21:10.529734] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:10.661909] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T19:21:11.134929] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-11-03T19:21:11.934955] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-11-03T19:21:12.220223] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-11-03T19:21:12.367058] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T19:21:12.734942] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-11-03T19:21:12.937805] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-11-03T19:21:13.534921] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-11-03T19:21:13.754132] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-11-03T19:21:14.334878] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-11-03T19:21:15.134851] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-11-03T19:21:15.444537] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-11-03T19:21:15.497469] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T19:21:15.934885] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-11-03T19:21:16.213904] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-11-03T19:21:16.734857] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-11-03T19:21:17.025550] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:21:17.534922] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-11-03T19:21:18.334867] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-11-03T19:21:18.552245] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-11-03T19:21:18.669406] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:21:19.134863] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-11-03T19:21:19.348393] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-11-03T19:21:19.934911] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-11-03T19:21:20.734904] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-11-03T19:21:21.264791] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T19:21:21.534904] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-11-03T19:21:21.638302] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T19:21:22.334875] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-11-03T19:21:23.090059] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T19:21:23.118810] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T19:21:23.134822] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-11-03T19:21:23.441318] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-11-03T19:21:23.934850] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-11-03T19:21:24.222789] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-11-03T19:21:24.734905] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-11-03T19:21:25.038540] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-11-03T19:21:25.534915] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-11-03T19:21:26.332048] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-11-03T19:21:26.336784] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-11-03T19:21:27.134908] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-11-03T19:21:27.389050] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-11-03T19:21:27.565176] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T19:21:27.934850] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-11-03T19:21:28.157134] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.22 seconds). [2025-11-03T19:21:28.734833] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-11-03T19:21:29.422521] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-11-03T19:21:29.534922] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-11. [2025-11-03T19:21:29.888983] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-11 (0.35 seconds). [2025-11-03T19:21:29.889661] [INFO ] [REMOTE ] HFND: Full fetch complete (1817 records). [2025-11-03T19:21:29.889735] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-11-03T19:21:30.068049] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-11-03T19:21:30.068260] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:21:30.068328] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:21:30.068402] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-11-03T19:21:30.068466] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-11-03T19:21:30.068502] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-11-03T19:21:30.068542] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-11-03T19:21:30.068596] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HFND took 21.2s. Estimated remaining: 3h 11m 13s. Rate: 7.1 symbols/min [2025-11-03T19:21:30.245779] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:30.260590] [DEBUG] [LOCAL ] HGER: Loaded 16379 existing records from primary storage. [2025-11-03T19:21:30.260811] [INFO ] [MAIN ] HGER: Loaded 16379 existing records. [2025-11-03T19:21:30.339923] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-11-03T19:21:30.438288] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:21:30.438499] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-11-03T19:21:30.438562] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-11-03T19:21:30.438954] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-11-03T19:21:30.439013] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-11-03T19:21:30.596350] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-11-03T19:21:30.805572] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:31.134864] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-11-03T19:21:31.612039] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T19:21:31.934894] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-11-03T19:21:32.734863] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-11-03T19:21:33.167527] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-11-03T19:21:33.305981] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T19:21:33.534867] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-11-03T19:21:33.706426] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.17 seconds). [2025-11-03T19:21:34.334861] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-11-03T19:21:34.517016] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.18 seconds). [2025-11-03T19:21:35.135010] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-11-03T19:21:35.506924] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T19:21:35.934860] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-11. [2025-11-03T19:21:36.734870] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-11-03T19:21:37.262978] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-11 (1.33 seconds). [2025-11-03T19:21:37.264620] [INFO ] [REMOTE ] HESM: Full fetch complete (70122 records). [2025-11-03T19:21:37.264787] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-11-03T19:21:37.386574] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-11-03T19:21:37.543156] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-11-03T19:21:37.676060] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-11-03T19:21:37.676143] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-11-03T19:21:37.677187] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-11-03T19:21:37.677255] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-11-03T19:21:37.678673] [DEBUG] [LOCAL ] HESM: Trimmed 70122 records to 48677 (keeping 200 days of data) [2025-11-03T19:21:37.960124] [DEBUG] [LOCAL ] HESM: Primary data saved (48677 records). [2025-11-03T19:21:37.960264] [INFO ] [MAIN ] HESM: Full history saved. [2025-11-03T19:21:37.961164] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HESM took 45.9s. Estimated remaining: 3h 11m 3s. Rate: 7.1 symbols/min [2025-11-03T19:21:38.141414] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:38.152866] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T19:21:38.166496] [DEBUG] [LOCAL ] HGLB: Loaded 9351 existing records from primary storage. [2025-11-03T19:21:38.166785] [INFO ] [MAIN ] HGLB: Loaded 9351 existing records. [2025-11-03T19:21:38.347690] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-11-03T19:21:38.353058] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:21:38.354467] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-11-03T19:21:38.354531] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-11-03T19:21:38.355196] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-11-03T19:21:38.355257] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-11-03T19:21:38.718568] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:38.955233] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-11-03T19:21:39.134856] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-11-03T19:21:39.647885] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-11-03T19:21:39.934912] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-11-03T19:21:40.428294] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-11-03T19:21:40.734845] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-11-03T19:21:41.288315] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-11-03T19:21:41.534860] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-11-03T19:21:42.071672] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T19:21:42.334841] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-11-03T19:21:42.893434] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T19:21:43.134885] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-11-03T19:21:43.939942] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-11-03T19:21:43.947073] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T19:21:44.576621] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T19:21:44.734860] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-11-03T19:21:44.924508] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.19 seconds). [2025-11-03T19:21:45.534847] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-11-03T19:21:46.152388] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:21:46.334852] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-11-03T19:21:46.874368] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T19:21:47.134846] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-11-03T19:21:47.676049] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T19:21:47.934861] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-11. [2025-11-03T19:21:48.219588] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-11 (0.28 seconds). [2025-11-03T19:21:48.220243] [INFO ] [REMOTE ] HF: Full fetch complete (414 records). [2025-11-03T19:21:48.220309] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-11-03T19:21:48.418331] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 143 unique days, need 200 days [2025-11-03T19:21:48.418514] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:21:48.418561] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:21:48.418628] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-11-03T19:21:48.418729] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-11-03T19:21:48.418771] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-11-03T19:21:48.418818] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-11-03T19:21:48.418915] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HF took 49.5s. Estimated remaining: 3h 10m 58s. Rate: 7.1 symbols/min [2025-11-03T19:21:48.604399] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:48.619062] [DEBUG] [LOCAL ] HGTY: Loaded 13612 existing records from primary storage. [2025-11-03T19:21:48.619306] [INFO ] [MAIN ] HGTY: Loaded 13612 existing records. [2025-11-03T19:21:48.739962] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-11-03T19:21:48.818676] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:21:48.818959] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-11-03T19:21:48.819010] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-11-03T19:21:48.819581] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-11-03T19:21:48.819639] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-11-03T19:21:49.180898] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:49.530444] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T19:21:49.535061] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-11-03T19:21:50.264040] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T19:21:50.334883] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-11-03T19:21:51.014686] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-11-03T19:21:51.134831] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-11-03T19:21:51.671290] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-11-03T19:21:51.934862] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-11-03T19:21:52.450980] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-11-03T19:21:52.734908] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-11-03T19:21:53.534852] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-11-03T19:21:53.619885] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T19:21:53.975252] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-11-03T19:21:54.334858] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-11. [2025-11-03T19:21:55.024038] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-11 (0.69 seconds). [2025-11-03T19:21:55.024970] [INFO ] [REMOTE ] HGER: Full fetch complete (20003 records). [2025-11-03T19:21:55.025042] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-11-03T19:21:55.140014] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-11-03T19:21:55.393899] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-11-03T19:21:55.393980] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-11-03T19:21:55.394399] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-11-03T19:21:55.394437] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-11-03T19:21:55.395030] [DEBUG] [LOCAL ] HGER: Trimmed 20003 records to 16238 (keeping 200 days of data) [2025-11-03T19:21:55.489737] [DEBUG] [LOCAL ] HGER: Primary data saved (16238 records). [2025-11-03T19:21:55.489868] [INFO ] [MAIN ] HGER: Full history saved. [2025-11-03T19:21:55.489942] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HGER took 25.4s. Estimated remaining: 3h 10m 47s. Rate: 7.1 symbols/min [2025-11-03T19:21:55.657254] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:55.700513] [DEBUG] [LOCAL ] HGV: Loaded 46596 existing records from primary storage. [2025-11-03T19:21:55.701251] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T19:21:55.703185] [INFO ] [MAIN ] HGV: Loaded 46596 existing records. [2025-11-03T19:21:55.888578] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:21:55.888833] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-11-03T19:21:55.888883] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-11-03T19:21:55.889902] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-11-03T19:21:55.889961] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-11-03T19:21:55.944719] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-11. [2025-11-03T19:21:56.290676] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:56.519046] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T19:21:56.520185] [INFO ] [REMOTE ] HFRO: Full fetch complete (25718 records). [2025-11-03T19:21:56.520496] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-11-03T19:21:56.744415] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-11-03T19:21:56.958839] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-11-03T19:21:56.958951] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-11-03T19:21:56.959616] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-11-03T19:21:56.959703] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-11-03T19:21:56.960513] [DEBUG] [LOCAL ] HFRO: Trimmed 25718 records to 15642 (keeping 200 days of data) [2025-11-03T19:21:57.049712] [DEBUG] [LOCAL ] HFRO: Primary data saved (15642 records). [2025-11-03T19:21:57.049846] [INFO ] [MAIN ] HFRO: Full history saved. [2025-11-03T19:21:57.049921] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HFRO took 47.2s. Estimated remaining: 3h 10m 30s. Rate: 7.1 symbols/min [2025-11-03T19:21:57.233831] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:21:57.264591] [DEBUG] [LOCAL ] HHH: Loaded 33021 existing records from primary storage. [2025-11-03T19:21:57.264922] [INFO ] [MAIN ] HHH: Loaded 33021 existing records. [2025-11-03T19:21:57.426162] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T19:21:57.475017] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:21:57.475261] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-11-03T19:21:57.475311] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-11-03T19:21:57.475909] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-11-03T19:21:57.475968] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-11-03T19:21:57.545136] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-11-03T19:21:57.871019] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:21:58.062303] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-11-03T19:21:58.334858] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-11-03T19:21:58.887175] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-11-03T19:21:59.134850] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-11-03T19:21:59.908955] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:21:59.934807] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-11-03T19:22:00.734914] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-11-03T19:22:01.064366] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:22:01.253153] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-11-03T19:22:01.534900] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-11-03T19:22:02.334825] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-11-03T19:22:02.458921] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T19:22:02.970932] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-11-03T19:22:03.134938] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-11-03T19:22:03.704913] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T19:22:03.934926] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-11. [2025-11-03T19:22:04.620414] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-11 (0.69 seconds). [2025-11-03T19:22:04.622010] [INFO ] [REMOTE ] HGLB: Full fetch complete (14565 records). [2025-11-03T19:22:04.622282] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-11-03T19:22:04.740160] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-11-03T19:22:05.041381] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-11-03T19:22:05.041484] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-11-03T19:22:05.041858] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-11-03T19:22:05.041918] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-11-03T19:22:05.042575] [DEBUG] [LOCAL ] HGLB: Trimmed 14565 records to 9249 (keeping 200 days of data) [2025-11-03T19:22:05.097743] [DEBUG] [LOCAL ] HGLB: Primary data saved (9249 records). [2025-11-03T19:22:05.097871] [INFO ] [MAIN ] HGLB: Full history saved. [2025-11-03T19:22:05.097947] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HGLB took 27.1s. Estimated remaining: 3h 10m 21s. Rate: 7.1 symbols/min [2025-11-03T19:22:05.264219] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:22:05.299741] [DEBUG] [LOCAL ] HI: Loaded 36811 existing records from primary storage. [2025-11-03T19:22:05.300018] [INFO ] [MAIN ] HI: Loaded 36811 existing records. [2025-11-03T19:22:05.476462] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:22:05.476699] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-11-03T19:22:05.476757] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-11-03T19:22:05.477500] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-11-03T19:22:05.477559] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-11-03T19:22:05.539969] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-11-03T19:22:05.907399] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:22:05.923370] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T19:22:06.334910] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-11-03T19:22:06.713704] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:22:07.134975] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-11-03T19:22:07.574341] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T19:22:07.730276] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T19:22:07.934927] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-11-03T19:22:08.734869] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-11-03T19:22:08.900280] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T19:22:09.534824] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-11-03T19:22:09.608082] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T19:22:10.334945] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-11-03T19:22:10.640533] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:22:11.134936] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-11-03T19:22:11.363123] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T19:22:11.934901] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-11-03T19:22:12.117575] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-11-03T19:22:12.427913] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T19:22:12.734882] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-11-03T19:22:13.534922] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-11-03T19:22:13.942300] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:22:14.083576] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-11-03T19:22:14.334860] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-11-03T19:22:15.134830] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-11-03T19:22:15.308738] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T19:22:15.935003] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-11-03T19:22:16.336098] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-11-03T19:22:16.734867] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-11-03T19:22:17.001042] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-11-03T19:22:17.534916] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-11-03T19:22:17.774600] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T19:22:18.335096] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-11-03T19:22:18.546270] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-11-03T19:22:19.134885] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-11-03T19:22:19.414466] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T19:22:19.934845] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-11-03T19:22:20.043036] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T19:22:20.735135] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-11-03T19:22:21.020575] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T19:22:21.437980] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T19:22:21.534894] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-11-03T19:22:22.192618] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T19:22:22.334901] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-11-03T19:22:23.134891] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-11-03T19:22:23.542110] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T19:22:23.934925] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-11-03T19:22:24.401494] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:22:24.608931] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-11-03T19:22:24.734872] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-11-03T19:22:25.534924] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-11. [2025-11-03T19:22:25.818159] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:22:26.254181] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T19:22:26.255013] [INFO ] [REMOTE ] HGTY: Full fetch complete (17691 records). [2025-11-03T19:22:26.255100] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-11-03T19:22:26.340029] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-11-03T19:22:26.622503] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-11-03T19:22:26.622575] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-11-03T19:22:26.622983] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-11-03T19:22:26.623043] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-11-03T19:22:26.623579] [DEBUG] [LOCAL ] HGTY: Trimmed 17691 records to 13533 (keeping 200 days of data) [2025-11-03T19:22:26.702196] [DEBUG] [LOCAL ] HGTY: Primary data saved (13533 records). [2025-11-03T19:22:26.702338] [INFO ] [MAIN ] HGTY: Full history saved. [2025-11-03T19:22:26.702424] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HGTY took 38.3s. Estimated remaining: 3h 10m 30s. Rate: 7.1 symbols/min [2025-11-03T19:22:26.877876] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:22:26.926669] [DEBUG] [LOCAL ] HIG: Loaded 51735 existing records from primary storage. [2025-11-03T19:22:26.926994] [INFO ] [MAIN ] HIG: Loaded 51735 existing records. [2025-11-03T19:22:27.108262] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:22:27.108458] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-11-03T19:22:27.108505] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-11-03T19:22:27.109395] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-11-03T19:22:27.109451] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-11-03T19:22:27.140300] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-11-03T19:22:27.484547] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:22:27.510638] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T19:22:27.934871] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-11-03T19:22:28.157350] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T19:22:28.734928] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-11-03T19:22:29.038428] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-11-03T19:22:29.534858] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-11-03T19:22:29.655482] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T19:22:30.334849] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-11-03T19:22:30.871258] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:22:31.134869] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-11. [2025-11-03T19:22:31.221348] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-11-03T19:22:31.934828] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-11-03T19:22:31.996996] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T19:22:31.998406] [INFO ] [REMOTE ] HGV: Full fetch complete (66005 records). [2025-11-03T19:22:31.998490] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-11-03T19:22:32.444108] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-11-03T19:22:32.444211] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-11-03T19:22:32.445262] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-11-03T19:22:32.445348] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-11-03T19:22:32.446818] [DEBUG] [LOCAL ] HGV: Trimmed 66005 records to 45816 (keeping 200 days of data) [2025-11-03T19:22:32.736829] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-11. [2025-11-03T19:22:32.745413] [DEBUG] [LOCAL ] HGV: Primary data saved (45816 records). [2025-11-03T19:22:32.746351] [INFO ] [MAIN ] HGV: Full history saved. [2025-11-03T19:22:32.746450] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HGV took 37.3s. Estimated remaining: 3h 10m 18s. Rate: 7.1 symbols/min [2025-11-03T19:22:32.964957] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:22:32.984889] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-11-03T19:22:33.021166] [DEBUG] [LOCAL ] HII: Loaded 33304 existing records from primary storage. [2025-11-03T19:22:33.021461] [INFO ] [MAIN ] HII: Loaded 33304 existing records. [2025-11-03T19:22:33.239198] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:22:33.239473] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-11-03T19:22:33.239528] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-11-03T19:22:33.240115] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-11-03T19:22:33.240174] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-11-03T19:22:33.540615] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-11-03T19:22:33.540547] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-11 (0.80 seconds). [2025-11-03T19:22:33.587272] [INFO ] [REMOTE ] HHH: Full fetch complete (45854 records). [2025-11-03T19:22:33.643790] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-11-03T19:22:33.649384] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:22:34.040183] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-11-03T19:22:34.040260] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-11-03T19:22:34.040980] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-11-03T19:22:34.041041] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-11-03T19:22:34.041981] [DEBUG] [LOCAL ] HHH: Trimmed 45854 records to 32780 (keeping 200 days of data) [2025-11-03T19:22:34.241473] [DEBUG] [LOCAL ] HHH: Primary data saved (32780 records). [2025-11-03T19:22:34.241599] [INFO ] [MAIN ] HHH: Full history saved. [2025-11-03T19:22:34.241699] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HHH took 37.2s. Estimated remaining: 3h 10m 1s. Rate: 7.1 symbols/min [2025-11-03T19:22:34.339996] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-11-03T19:22:34.439039] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:22:34.486524] [DEBUG] [LOCAL ] HIMS: Loaded 54597 existing records from primary storage. [2025-11-03T19:22:34.486876] [INFO ] [MAIN ] HIMS: Loaded 54597 existing records. [2025-11-03T19:22:34.665881] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:22:34.666131] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-11-03T19:22:34.666181] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-11-03T19:22:34.667076] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-11-03T19:22:34.667135] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-11-03T19:22:35.029802] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:22:35.070026] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T19:22:35.134860] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-11-03T19:22:35.529924] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:22:35.934927] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-11. [2025-11-03T19:22:36.734831] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-11-03T19:22:36.828494] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-11 (0.89 seconds). [2025-11-03T19:22:36.830113] [INFO ] [REMOTE ] HI: Full fetch complete (52128 records). [2025-11-03T19:22:36.830302] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-11-03T19:22:37.021796] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-11-03T19:22:37.246219] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-11-03T19:22:37.246300] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-11-03T19:22:37.247049] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-11-03T19:22:37.247134] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-11-03T19:22:37.248205] [DEBUG] [LOCAL ] HI: Trimmed 52128 records to 36381 (keeping 200 days of data) [2025-11-03T19:22:37.461249] [DEBUG] [LOCAL ] HI: Primary data saved (36381 records). [2025-11-03T19:22:37.461377] [INFO ] [MAIN ] HI: Full history saved. [2025-11-03T19:22:37.462196] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HI took 32.4s. Estimated remaining: 3h 9m 45s. Rate: 7.1 symbols/min [2025-11-03T19:22:37.540000] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-11-03T19:22:37.635628] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:22:37.657954] [DEBUG] [LOCAL ] HIO: Loaded 23775 existing records from primary storage. [2025-11-03T19:22:37.658207] [INFO ] [MAIN ] HIO: Loaded 23775 existing records. [2025-11-03T19:22:37.839720] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:22:37.847710] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-11-03T19:22:37.857963] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-11-03T19:22:37.860758] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-11-03T19:22:37.861736] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-11-03T19:22:37.861796] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-11-03T19:22:38.218511] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:22:38.334832] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-11-03T19:22:39.134819] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-11-03T19:22:39.201960] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T19:22:39.463248] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-11-03T19:22:39.934872] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-11-03T19:22:40.209359] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T19:22:40.734865] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-11-03T19:22:41.155846] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T19:22:41.534848] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-11-03T19:22:42.314393] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-11-03T19:22:42.334812] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-11-03T19:22:42.812561] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T19:22:43.134845] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-11-03T19:22:43.758941] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T19:22:43.898199] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T19:22:43.934894] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-11-03T19:22:44.734868] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-11-03T19:22:45.534866] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-11-03T19:22:46.038859] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T19:22:46.322855] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-11-03T19:22:46.334805] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-11-03T19:22:46.539712] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T19:22:47.134897] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-11-03T19:22:47.934831] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-11-03T19:22:48.074718] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T19:22:48.307053] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-11-03T19:22:48.734899] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-11-03T19:22:49.162294] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:22:49.534816] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-11-03T19:22:49.589708] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T19:22:50.334831] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-11-03T19:22:50.424446] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T19:22:51.134930] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-11-03T19:22:51.595832] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T19:22:51.704325] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T19:22:51.934910] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-11-03T19:22:52.734886] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-11-03T19:22:53.185970] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:22:53.361310] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:22:53.534909] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-11-03T19:22:54.334865] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-11-03T19:22:55.134892] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-11-03T19:22:55.602305] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T19:22:55.927175] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T19:22:55.947353] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-11-03T19:22:55.983838] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-11-03T19:22:56.734830] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-11-03T19:22:56.888139] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T19:22:57.534850] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-11-03T19:22:58.334865] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-11-03T19:22:58.579123] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:22:58.708383] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-11-03T19:22:59.134914] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-11-03T19:22:59.663979] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T19:22:59.934863] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-11-03T19:23:00.734912] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-11-03T19:23:01.534879] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-11. [2025-11-03T19:23:05.364938] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (4.63 seconds). [2025-11-03T19:23:05.371537] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-11-03T19:23:05.638899] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (5.70 seconds). [2025-11-03T19:23:05.652433] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-11-03T19:23:05.923958] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (6.79 seconds). [2025-11-03T19:23:05.932098] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-11-03T19:23:06.380250] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-11 (4.85 seconds). [2025-11-03T19:23:06.382566] [INFO ] [REMOTE ] HIG: Full fetch complete (73726 records). [2025-11-03T19:23:06.382808] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-11-03T19:23:06.814574] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T19:23:06.848430] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-11. [2025-11-03T19:23:06.925194] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-11-03T19:23:06.925320] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-11-03T19:23:06.926673] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-11-03T19:23:06.926761] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-11-03T19:23:06.928828] [DEBUG] [LOCAL ] HIG: Trimmed 73726 records to 50976 (keeping 200 days of data) [2025-11-03T19:23:07.155417] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T19:23:07.205324] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-11-03T19:23:07.308616] [DEBUG] [LOCAL ] HIG: Primary data saved (50976 records). [2025-11-03T19:23:07.308853] [INFO ] [MAIN ] HIG: Full history saved. [2025-11-03T19:23:07.308962] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HIG took 40.6s. Estimated remaining: 3h 10m 5s. Rate: 7.1 symbols/min [2025-11-03T19:23:07.497146] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:07.520339] [DEBUG] [LOCAL ] HIPO: Loaded 21174 existing records from primary storage. [2025-11-03T19:23:07.520745] [INFO ] [MAIN ] HIPO: Loaded 21174 existing records. [2025-11-03T19:23:07.607629] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-11 (0.76 seconds). [2025-11-03T19:23:07.647899] [INFO ] [REMOTE ] HIO: Full fetch complete (38018 records). [2025-11-03T19:23:07.658536] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-11-03T19:23:07.789035] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:07.818097] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-11-03T19:23:07.834416] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-11-03T19:23:07.851408] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-11-03T19:23:07.851732] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-11-03T19:23:08.469080] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.82 seconds). [2025-11-03T19:23:08.522473] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-11-03T19:23:08.523018] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-11-03T19:23:08.523088] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-11-03T19:23:08.541133] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-11-03T19:23:08.546602] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-11-03T19:23:08.628166] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:08.629237] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-11-03T19:23:08.630627] [DEBUG] [LOCAL ] HIO: Trimmed 38018 records to 23577 (keeping 200 days of data) [2025-11-03T19:23:08.754628] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-11-03T19:23:08.771063] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-11. [2025-11-03T19:23:08.817531] [DEBUG] [LOCAL ] HIO: Primary data saved (23577 records). [2025-11-03T19:23:08.817701] [INFO ] [MAIN ] HIO: Full history saved. [2025-11-03T19:23:08.817802] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HIO took 31.4s. Estimated remaining: 3h 9m 48s. Rate: 7.1 symbols/min [2025-11-03T19:23:08.994283] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:09.043679] [DEBUG] [LOCAL ] HIW: Loaded 45011 existing records from primary storage. [2025-11-03T19:23:09.044126] [INFO ] [MAIN ] HIW: Loaded 45011 existing records. [2025-11-03T19:23:09.224671] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:09.224912] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-11-03T19:23:09.224958] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-11-03T19:23:09.225696] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-11-03T19:23:09.225754] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-11-03T19:23:09.567557] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-11-03T19:23:09.587601] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-11-03T19:23:09.612756] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:09.613252] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-11-03T19:23:09.677638] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T19:23:09.679110] [INFO ] [REMOTE ] HII: Full fetch complete (52304 records). [2025-11-03T19:23:09.679183] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-11-03T19:23:10.050479] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-11-03T19:23:10.050564] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-11-03T19:23:10.051371] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-11-03T19:23:10.051472] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-11-03T19:23:10.052505] [DEBUG] [LOCAL ] HII: Trimmed 52304 records to 32647 (keeping 200 days of data) [2025-11-03T19:23:10.258752] [DEBUG] [LOCAL ] HII: Primary data saved (32647 records). [2025-11-03T19:23:10.259024] [INFO ] [MAIN ] HII: Full history saved. [2025-11-03T19:23:10.259146] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HII took 37.5s. Estimated remaining: 3h 9m 30s. Rate: 7.1 symbols/min [2025-11-03T19:23:10.365416] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-11-03T19:23:10.381097] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-11-03T19:23:10.452133] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:10.491367] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-11-03T19:23:10.509840] [DEBUG] [LOCAL ] HIX: Loaded 20229 existing records from primary storage. [2025-11-03T19:23:10.510114] [INFO ] [MAIN ] HIX: Loaded 20229 existing records. [2025-11-03T19:23:10.686326] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:10.686594] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-11-03T19:23:10.686753] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-11-03T19:23:10.687265] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-11-03T19:23:10.687334] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-11-03T19:23:10.835790] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T19:23:11.066758] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:11.134785] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-11-03T19:23:11.209155] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T19:23:11.934836] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-11-03T19:23:12.694011] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-11-03T19:23:12.734869] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-11-03T19:23:13.267039] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-11-03T19:23:13.534885] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-11. [2025-11-03T19:23:13.847282] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:23:14.334937] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-11-03T19:23:15.035496] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T19:23:15.134865] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-11-03T19:23:15.417183] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-11 (1.88 seconds). [2025-11-03T19:23:15.419223] [INFO ] [REMOTE ] HIMS: Full fetch complete (77997 records). [2025-11-03T19:23:15.419345] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-11-03T19:23:15.834687] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-11-03T19:23:15.834823] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-11-03T19:23:15.836315] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-11-03T19:23:15.836387] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-11-03T19:23:15.838510] [DEBUG] [LOCAL ] HIMS: Trimmed 77997 records to 53817 (keeping 200 days of data) [2025-11-03T19:23:15.943020] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-11-03T19:23:16.081815] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-11-03T19:23:16.195821] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-11-03T19:23:16.195945] [INFO ] [MAIN ] HIMS: Full history saved. [2025-11-03T19:23:16.196025] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HIMS took 42.0s. Estimated remaining: 3h 9m 18s. Rate: 7.1 symbols/min [2025-11-03T19:23:16.365681] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:16.383237] [DEBUG] [LOCAL ] HKD: Loaded 19201 existing records from primary storage. [2025-11-03T19:23:16.383449] [INFO ] [MAIN ] HKD: Loaded 19201 existing records. [2025-11-03T19:23:16.563378] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:16.563579] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-11-03T19:23:16.563629] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-11-03T19:23:16.564035] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-11-03T19:23:16.564091] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-11-03T19:23:16.741990] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-11-03T19:23:16.927464] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:17.095871] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-11-03T19:23:17.542534] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-11-03T19:23:17.543674] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-11-03T19:23:18.333010] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-11-03T19:23:18.337216] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-11-03T19:23:19.134904] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-11-03T19:23:19.549721] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T19:23:19.934905] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-11-03T19:23:19.983811] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T19:23:20.726079] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T19:23:20.734809] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-11-03T19:23:21.503389] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T19:23:21.534830] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-11-03T19:23:22.201788] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T19:23:22.334917] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-11-03T19:23:23.072475] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-11-03T19:23:23.134890] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-11-03T19:23:23.934840] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-11-03T19:23:24.237754] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:23:24.734896] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-11-03T19:23:24.768982] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T19:23:25.350427] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:23:25.534858] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-11-03T19:23:26.253246] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T19:23:26.334847] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-11-03T19:23:27.122133] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T19:23:27.134827] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-11-03T19:23:27.883247] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T19:23:27.934872] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-11-03T19:23:28.738486] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-11-03T19:23:28.740506] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T19:23:29.414033] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-11-03T19:23:29.534880] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-11-03T19:23:30.243056] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T19:23:30.334851] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-11-03T19:23:31.104070] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-11-03T19:23:31.134844] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-11-03T19:23:31.848786] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T19:23:31.934818] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-11. [2025-11-03T19:23:32.538594] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-11 (0.60 seconds). [2025-11-03T19:23:32.539526] [INFO ] [REMOTE ] HIX: Full fetch complete (29603 records). [2025-11-03T19:23:32.539595] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-11-03T19:23:32.740483] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-11-03T19:23:32.917219] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-11-03T19:23:32.917297] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-11-03T19:23:32.917978] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-11-03T19:23:32.918040] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-11-03T19:23:32.918764] [DEBUG] [LOCAL ] HIX: Trimmed 29603 records to 20029 (keeping 200 days of data) [2025-11-03T19:23:33.041433] [DEBUG] [LOCAL ] HIX: Primary data saved (20029 records). [2025-11-03T19:23:33.041586] [INFO ] [MAIN ] HIX: Full history saved. [2025-11-03T19:23:33.041727] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HIX took 22.8s. Estimated remaining: 3h 9m 21s. Rate: 7.1 symbols/min [2025-11-03T19:23:33.243889] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:33.289991] [DEBUG] [LOCAL ] HL: Loaded 54456 existing records from primary storage. [2025-11-03T19:23:33.290319] [INFO ] [MAIN ] HL: Loaded 54456 existing records. [2025-11-03T19:23:33.466217] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:33.466507] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-11-03T19:23:33.466570] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-11-03T19:23:33.467487] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-11-03T19:23:33.467545] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-11-03T19:23:33.539925] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-11. [2025-11-03T19:23:33.817962] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:33.850219] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T19:23:34.219671] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T19:23:34.220680] [INFO ] [REMOTE ] HIPO: Full fetch complete (30813 records). [2025-11-03T19:23:34.220750] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-11-03T19:23:34.340009] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-11-03T19:23:34.588168] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-11-03T19:23:34.588262] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-11-03T19:23:34.588877] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-11-03T19:23:34.588937] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-11-03T19:23:34.589623] [DEBUG] [LOCAL ] HIPO: Trimmed 30813 records to 20894 (keeping 200 days of data) [2025-11-03T19:23:34.709076] [DEBUG] [LOCAL ] HIPO: Primary data saved (20894 records). [2025-11-03T19:23:34.709192] [INFO ] [MAIN ] HIPO: Full history saved. [2025-11-03T19:23:34.709263] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIPO took 27.4s. Estimated remaining: 3h 9m 4s. Rate: 7.1 symbols/min [2025-11-03T19:23:34.876051] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:34.916014] [DEBUG] [LOCAL ] HLF: Loaded 48778 existing records from primary storage. [2025-11-03T19:23:34.916302] [INFO ] [MAIN ] HLF: Loaded 48778 existing records. [2025-11-03T19:23:35.089769] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:35.089966] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-11-03T19:23:35.090013] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-11-03T19:23:35.090789] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-11-03T19:23:35.090846] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-11-03T19:23:35.139936] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-11-03T19:23:35.464120] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:35.489867] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:23:35.805835] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T19:23:35.934904] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-11-03T19:23:36.734856] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-11-03T19:23:37.116308] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T19:23:37.318124] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T19:23:37.534892] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-11-03T19:23:38.334868] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-11-03T19:23:38.636724] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T19:23:39.134862] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-11-03T19:23:39.296708] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T19:23:39.934861] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-11-03T19:23:40.406223] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T19:23:40.734887] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-11-03T19:23:41.306031] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T19:23:41.534914] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-11-03T19:23:41.861910] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T19:23:42.334906] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-11-03T19:23:43.134880] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-11-03T19:23:43.191063] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-11-03T19:23:43.530350] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T19:23:43.934860] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-11-03T19:23:43.974589] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-11-03T19:23:44.734833] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-11-03T19:23:44.975853] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T19:23:45.244875] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T19:23:45.534868] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-11-03T19:23:46.334931] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-11-03T19:23:46.640868] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-11-03T19:23:47.134880] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-11-03T19:23:47.640818] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:23:47.934853] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-11-03T19:23:48.344339] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T19:23:48.734899] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-11-03T19:23:48.775625] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T19:23:49.534879] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-11-03T19:23:50.201395] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T19:23:50.334902] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-11-03T19:23:50.692788] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-11-03T19:23:51.134863] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-11-03T19:23:51.827525] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T19:23:51.907773] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T19:23:51.934851] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-11. [2025-11-03T19:23:52.735029] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-11-03T19:23:52.812331] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T19:23:52.814621] [INFO ] [REMOTE ] HKD: Full fetch complete (28136 records). [2025-11-03T19:23:52.814777] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-11-03T19:23:53.220970] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-11-03T19:23:53.221120] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-11-03T19:23:53.222562] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-11-03T19:23:53.222667] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-11-03T19:23:53.224060] [DEBUG] [LOCAL ] HKD: Trimmed 28136 records to 19173 (keeping 200 days of data) [2025-11-03T19:23:53.347717] [DEBUG] [LOCAL ] HKD: Primary data saved (19173 records). [2025-11-03T19:23:53.347923] [INFO ] [MAIN ] HKD: Full history saved. [2025-11-03T19:23:53.348023] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HKD took 37.2s. Estimated remaining: 3h 9m 8s. Rate: 7.1 symbols/min [2025-11-03T19:23:53.537511] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:53.537667] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-11-03T19:23:53.573999] [DEBUG] [LOCAL ] HLI: Loaded 31047 existing records from primary storage. [2025-11-03T19:23:53.574346] [INFO ] [MAIN ] HLI: Loaded 31047 existing records. [2025-11-03T19:23:53.782635] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:53.783413] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-11-03T19:23:53.783479] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-11-03T19:23:53.784236] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-11-03T19:23:53.784299] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-11-03T19:23:54.224739] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:54.233210] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T19:23:54.334920] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-11-03T19:23:54.832295] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T19:23:55.134896] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-11. [2025-11-03T19:23:55.334588] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T19:23:55.934888] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-11-03T19:23:56.142401] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T19:23:56.143867] [INFO ] [REMOTE ] HIW: Full fetch complete (65177 records). [2025-11-03T19:23:56.143970] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-11-03T19:23:56.546435] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-11-03T19:23:56.546512] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-11-03T19:23:56.547686] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-11-03T19:23:56.547751] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-11-03T19:23:56.549019] [DEBUG] [LOCAL ] HIW: Trimmed 65177 records to 44539 (keeping 200 days of data) [2025-11-03T19:23:56.752277] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-11-03T19:23:56.817683] [DEBUG] [LOCAL ] HIW: Primary data saved (44539 records). [2025-11-03T19:23:56.817798] [INFO ] [MAIN ] HIW: Full history saved. [2025-11-03T19:23:56.818799] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HIW took 48.0s. Estimated remaining: 3h 8m 54s. Rate: 7.1 symbols/min [2025-11-03T19:23:57.012173] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:23:57.064474] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T19:23:57.085796] [DEBUG] [LOCAL ] HLIO: Loaded 28143 existing records from primary storage. [2025-11-03T19:23:57.086119] [INFO ] [MAIN ] HLIO: Loaded 28143 existing records. [2025-11-03T19:23:57.263720] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:23:57.263972] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-11-03T19:23:57.264027] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-11-03T19:23:57.264544] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-11-03T19:23:57.264609] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-11-03T19:23:57.541054] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-11-03T19:23:57.625186] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:23:57.691760] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-11-03T19:23:58.334875] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-11-03T19:23:58.746234] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:23:59.134928] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-11-03T19:23:59.385271] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T19:23:59.812560] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T19:23:59.934856] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-11-03T19:24:00.588692] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-11-03T19:24:00.734911] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-11-03T19:24:01.534837] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-11-03T19:24:01.679327] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-11-03T19:24:02.334883] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-11-03T19:24:02.745362] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-11-03T19:24:03.134850] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-11-03T19:24:03.857878] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T19:24:03.934846] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-11-03T19:24:03.981733] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-11-03T19:24:04.734919] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-11. [2025-11-03T19:24:04.857977] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T19:24:05.534885] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-11-03T19:24:05.743708] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T19:24:05.745144] [INFO ] [REMOTE ] HLF: Full fetch complete (70620 records). [2025-11-03T19:24:05.745247] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-11-03T19:24:06.152017] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-11-03T19:24:06.152115] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-11-03T19:24:06.153020] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-11-03T19:24:06.153081] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-11-03T19:24:06.154377] [DEBUG] [LOCAL ] HLF: Trimmed 70620 records to 48033 (keeping 200 days of data) [2025-11-03T19:24:06.347987] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-11-03T19:24:06.445128] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T19:24:06.447791] [DEBUG] [LOCAL ] HLF: Primary data saved (48033 records). [2025-11-03T19:24:06.454163] [INFO ] [MAIN ] HLF: Full history saved. [2025-11-03T19:24:06.454433] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HLF took 31.7s. Estimated remaining: 3h 8m 47s. Rate: 7.1 symbols/min [2025-11-03T19:24:06.623475] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:06.652596] [DEBUG] [LOCAL ] HLLY: Loaded 33574 existing records from primary storage. [2025-11-03T19:24:06.652905] [INFO ] [MAIN ] HLLY: Loaded 33574 existing records. [2025-11-03T19:24:06.835075] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:06.835277] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-11-03T19:24:06.835325] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-11-03T19:24:06.835835] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-11-03T19:24:06.835893] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-11-03T19:24:07.140035] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-11-03T19:24:07.219624] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:07.236847] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T19:24:07.934867] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-11-03T19:24:08.734841] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-11-03T19:24:08.793701] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-11-03T19:24:08.852023] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T19:24:09.534828] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-11-03T19:24:09.686215] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-11-03T19:24:10.334870] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-11-03T19:24:10.524178] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T19:24:11.134855] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-11-03T19:24:11.917798] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-11-03T19:24:11.941148] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-11-03T19:24:11.953872] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T19:24:12.734841] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-11-03T19:24:12.814916] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T19:24:13.534823] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-11-03T19:24:13.720874] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-11-03T19:24:14.334822] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-11-03T19:24:14.540752] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T19:24:15.134859] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-11. [2025-11-03T19:24:15.934830] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-11-03T19:24:16.147446] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-11-03T19:24:16.213841] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-11 (1.08 seconds). [2025-11-03T19:24:16.215062] [INFO ] [REMOTE ] HLI: Full fetch complete (45607 records). [2025-11-03T19:24:16.215141] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-11-03T19:24:16.585055] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-11-03T19:24:16.585157] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-11-03T19:24:16.585992] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-11-03T19:24:16.586058] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-11-03T19:24:16.587192] [DEBUG] [LOCAL ] HLI: Trimmed 45607 records to 30617 (keeping 200 days of data) [2025-11-03T19:24:16.738519] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-11-03T19:24:16.778582] [DEBUG] [LOCAL ] HLI: Primary data saved (30617 records). [2025-11-03T19:24:16.778716] [INFO ] [MAIN ] HLI: Full history saved. [2025-11-03T19:24:16.778805] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HLI took 23.4s. Estimated remaining: 3h 8m 41s. Rate: 7.1 symbols/min [2025-11-03T19:24:16.948557] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:16.968464] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:24:17.018252] [DEBUG] [LOCAL ] HLN: Loaded 53866 existing records from primary storage. [2025-11-03T19:24:17.018576] [INFO ] [MAIN ] HLN: Loaded 53866 existing records. [2025-11-03T19:24:17.192150] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:17.192390] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-11-03T19:24:17.192438] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-11-03T19:24:17.193395] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-11-03T19:24:17.193456] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-11-03T19:24:17.537975] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-11. [2025-11-03T19:24:17.564695] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:17.582803] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T19:24:18.334849] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-11-03T19:24:19.101576] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-11 (1.56 seconds). [2025-11-03T19:24:19.103530] [INFO ] [REMOTE ] HL: Full fetch complete (77838 records). [2025-11-03T19:24:19.103712] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-11-03T19:24:19.141228] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-11-03T19:24:19.531827] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-11-03T19:24:19.531962] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-11-03T19:24:19.533135] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-11-03T19:24:19.533212] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-11-03T19:24:19.535280] [DEBUG] [LOCAL ] HL: Trimmed 77838 records to 53677 (keeping 200 days of data) [2025-11-03T19:24:19.621239] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T19:24:19.889802] [DEBUG] [LOCAL ] HL: Primary data saved (53677 records). [2025-11-03T19:24:19.890107] [INFO ] [MAIN ] HL: Full history saved. [2025-11-03T19:24:19.890238] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HL took 46.8s. Estimated remaining: 3h 8m 25s. Rate: 7.1 symbols/min [2025-11-03T19:24:19.958334] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-11-03T19:24:20.006115] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-11-03T19:24:20.096159] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:20.142408] [DEBUG] [LOCAL ] HLT: Loaded 51125 existing records from primary storage. [2025-11-03T19:24:20.142785] [INFO ] [MAIN ] HLT: Loaded 51125 existing records. [2025-11-03T19:24:20.322254] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:20.322469] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-11-03T19:24:20.322516] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-11-03T19:24:20.323387] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-11-03T19:24:20.323446] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-11-03T19:24:20.692193] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:20.704894] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T19:24:20.734808] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-11-03T19:24:21.534872] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-11-03T19:24:21.610368] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-11-03T19:24:22.334915] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-11-03T19:24:22.856199] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T19:24:23.134819] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-11-03T19:24:23.255253] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T19:24:23.934843] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-11-03T19:24:24.441240] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T19:24:24.734891] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-11-03T19:24:24.890847] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T19:24:25.534862] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-11-03T19:24:26.185822] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T19:24:26.334840] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-11-03T19:24:26.497111] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-11-03T19:24:27.134860] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-11-03T19:24:27.786443] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-11-03T19:24:27.934819] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-11-03T19:24:27.983153] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T19:24:28.734853] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-11-03T19:24:29.135184] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T19:24:29.534851] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-11-03T19:24:29.902738] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T19:24:30.334810] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-11-03T19:24:30.446035] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T19:24:31.134879] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-11-03T19:24:31.766426] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T19:24:31.934902] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-11-03T19:24:32.382831] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T19:24:32.734879] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-11-03T19:24:33.088606] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T19:24:33.534897] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-11-03T19:24:34.122819] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T19:24:34.334851] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-11-03T19:24:34.811206] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T19:24:35.134845] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-11. [2025-11-03T19:24:35.582070] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:24:35.934863] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-11-03T19:24:36.034751] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T19:24:36.035840] [INFO ] [REMOTE ] HLIO: Full fetch complete (37437 records). [2025-11-03T19:24:36.035954] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-11-03T19:24:36.429512] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-11-03T19:24:36.429587] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-11-03T19:24:36.430438] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-11-03T19:24:36.430501] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-11-03T19:24:36.431348] [DEBUG] [LOCAL ] HLIO: Trimmed 37437 records to 27731 (keeping 200 days of data) [2025-11-03T19:24:36.594334] [DEBUG] [LOCAL ] HLIO: Primary data saved (27731 records). [2025-11-03T19:24:36.594457] [INFO ] [MAIN ] HLIO: Full history saved. [2025-11-03T19:24:36.594533] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HLIO took 39.8s. Estimated remaining: 3h 8m 28s. Rate: 7.1 symbols/min [2025-11-03T19:24:36.743670] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-11-03T19:24:36.761749] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:36.801417] [DEBUG] [LOCAL ] HLX: Loaded 47904 existing records from primary storage. [2025-11-03T19:24:36.801733] [INFO ] [MAIN ] HLX: Loaded 47904 existing records. [2025-11-03T19:24:36.996218] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:36.996780] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-11-03T19:24:36.996828] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-11-03T19:24:36.997492] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-11-03T19:24:36.997548] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-11-03T19:24:37.356741] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:37.387194] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T19:24:37.534839] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-11-03T19:24:37.991433] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T19:24:38.334844] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-11-03T19:24:38.735023] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T19:24:39.134921] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-11-03T19:24:39.693118] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T19:24:39.934896] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-11. [2025-11-03T19:24:40.705881] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T19:24:40.734821] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-11-03T19:24:41.079870] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:24:41.081522] [INFO ] [REMOTE ] HLT: Full fetch complete (73665 records). [2025-11-03T19:24:41.081722] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-11-03T19:24:41.489330] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-11-03T19:24:41.489413] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-11-03T19:24:41.490425] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-11-03T19:24:41.490491] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-11-03T19:24:41.491858] [DEBUG] [LOCAL ] HLT: Trimmed 73665 records to 50355 (keeping 200 days of data) [2025-11-03T19:24:41.545769] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-11-03T19:24:41.801521] [DEBUG] [LOCAL ] HLT: Primary data saved (50355 records). [2025-11-03T19:24:41.801695] [INFO ] [MAIN ] HLT: Full history saved. [2025-11-03T19:24:41.801793] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLT took 21.9s. Estimated remaining: 3h 8m 15s. Rate: 7.1 symbols/min [2025-11-03T19:24:41.989200] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:42.029671] [DEBUG] [LOCAL ] HMC: Loaded 46746 existing records from primary storage. [2025-11-03T19:24:42.029976] [INFO ] [MAIN ] HMC: Loaded 46746 existing records. [2025-11-03T19:24:42.249073] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:42.261366] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-11-03T19:24:42.261430] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-11-03T19:24:42.264349] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-11-03T19:24:42.264261] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T19:24:42.275255] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-11-03T19:24:42.343733] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-11-03T19:24:42.669992] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:42.694076] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T19:24:43.134968] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-11-03T19:24:43.496241] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T19:24:43.934925] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-11-03T19:24:44.395598] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-11-03T19:24:44.734894] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-11-03T19:24:45.090636] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-11-03T19:24:45.534857] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-11-03T19:24:45.954127] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T19:24:46.334852] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-11-03T19:24:46.671316] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:24:47.134889] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-11-03T19:24:47.568630] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-11-03T19:24:47.934916] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-11-03T19:24:48.443354] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:24:48.734967] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-11-03T19:24:48.970668] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T19:24:49.534863] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-11-03T19:24:49.881476] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T19:24:50.334824] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-11-03T19:24:50.520794] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T19:24:51.134923] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-11-03T19:24:51.448556] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T19:24:51.934855] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-11-03T19:24:52.544379] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T19:24:52.734844] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-11. [2025-11-03T19:24:53.194746] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-11-03T19:24:53.534866] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-11. [2025-11-03T19:24:53.791140] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:24:53.792975] [INFO ] [REMOTE ] HLN: Full fetch complete (77018 records). [2025-11-03T19:24:53.793117] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-11-03T19:24:54.219015] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-11-03T19:24:54.219100] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-11-03T19:24:54.220048] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-11-03T19:24:54.220111] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-11-03T19:24:54.221508] [DEBUG] [LOCAL ] HLN: Trimmed 77018 records to 53091 (keeping 200 days of data) [2025-11-03T19:24:54.347246] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-11-03T19:24:54.410313] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T19:24:54.444461] [INFO ] [REMOTE ] HLLY: Full fetch complete (45992 records). [2025-11-03T19:24:54.446830] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-11-03T19:24:54.846106] [DEBUG] [LOCAL ] HLN: Primary data saved (53091 records). [2025-11-03T19:24:54.862109] [INFO ] [MAIN ] HLN: Full history saved. [2025-11-03T19:24:54.872541] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLN took 38.1s. Estimated remaining: 3h 8m 13s. Rate: 7.1 symbols/min [2025-11-03T19:24:55.161004] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-11-03T19:24:55.166396] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:55.167943] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-11-03T19:24:55.168080] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-11-03T19:24:55.169078] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-11-03T19:24:55.169631] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-11-03T19:24:55.171153] [DEBUG] [LOCAL ] HLLY: Trimmed 45992 records to 32961 (keeping 200 days of data) [2025-11-03T19:24:55.401181] [DEBUG] [LOCAL ] HLLY: Primary data saved (32961 records). [2025-11-03T19:24:55.402709] [INFO ] [MAIN ] HLLY: Full history saved. [2025-11-03T19:24:55.402864] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLLY took 48.9s. Estimated remaining: 3h 7m 54s. Rate: 7.1 symbols/min [2025-11-03T19:24:55.402556] [DEBUG] [LOCAL ] HMN: Loaded 23256 existing records from primary storage. [2025-11-03T19:24:55.455510] [INFO ] [MAIN ] HMN: Loaded 23256 existing records. [2025-11-03T19:24:55.719780] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:24:55.806193] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:55.807002] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-11-03T19:24:55.807151] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-11-03T19:24:55.807966] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-11-03T19:24:55.808074] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-11-03T19:24:55.903028] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T19:24:55.982319] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-11-03T19:24:56.094446] [DEBUG] [LOCAL ] HMY: Loaded 53937 existing records from primary storage. [2025-11-03T19:24:56.166097] [INFO ] [MAIN ] HMY: Loaded 53937 existing records. [2025-11-03T19:24:56.375704] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:56.454875] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:24:56.455122] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-11-03T19:24:56.455181] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-11-03T19:24:56.456148] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-11-03T19:24:56.456223] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-11-03T19:24:56.657625] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-11-03T19:24:56.738408] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-11-03T19:24:56.854086] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:24:57.071148] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T19:24:57.354722] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T19:24:57.534824] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-11-03T19:24:58.334912] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-11-03T19:24:58.947380] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-11-03T19:24:59.134899] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-11-03T19:24:59.557990] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T19:24:59.934927] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-11-03T19:25:00.259236] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T19:25:00.513926] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T19:25:00.734847] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-11-03T19:25:01.455162] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T19:25:01.534907] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-11. [2025-11-03T19:25:02.334858] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-11-03T19:25:02.641731] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-11 (1.11 seconds). [2025-11-03T19:25:02.643133] [INFO ] [REMOTE ] HLX: Full fetch complete (69006 records). [2025-11-03T19:25:02.643232] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-11-03T19:25:03.032018] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-11-03T19:25:03.032123] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-11-03T19:25:03.033161] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-11-03T19:25:03.033224] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-11-03T19:25:03.034525] [DEBUG] [LOCAL ] HLX: Trimmed 69006 records to 47136 (keeping 200 days of data) [2025-11-03T19:25:03.134880] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-11-03T19:25:03.297240] [DEBUG] [LOCAL ] HLX: Primary data saved (47136 records). [2025-11-03T19:25:03.297396] [INFO ] [MAIN ] HLX: Full history saved. [2025-11-03T19:25:03.298299] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLX took 26.7s. Estimated remaining: 3h 7m 45s. Rate: 7.1 symbols/min [2025-11-03T19:25:03.464003] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:25:03.464175] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-11-03T19:25:03.464211] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-11-03T19:25:03.464349] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-11-03T19:25:03.464446] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-11-03T19:25:03.464519] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-11-03T19:25:03.464600] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-11-03T19:25:03.837356] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:25:03.867104] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-11-03T19:25:03.934831] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-11-03T19:25:04.081470] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T19:25:04.734909] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-11-03T19:25:05.173278] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T19:25:05.534872] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-11-03T19:25:05.620514] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T19:25:06.334867] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-11-03T19:25:06.500743] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:25:06.501080] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-11-03T19:25:06.501187] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:25:06.501242] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-11-03T19:25:06.501285] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:25:06.501325] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-11-03T19:25:06.501389] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-11-03T19:25:06.501446] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-11-03T19:25:06.501489] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-11-03T19:25:06.501535] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HNGE took 3.2s. Estimated remaining: 3h 7m 29s. Rate: 7.1 symbols/min [2025-11-03T19:25:06.676860] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:25:06.707356] [DEBUG] [LOCAL ] HNI: Loaded 30434 existing records from primary storage. [2025-11-03T19:25:06.707638] [INFO ] [MAIN ] HNI: Loaded 30434 existing records. [2025-11-03T19:25:06.882519] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:25:06.882742] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-11-03T19:25:06.882792] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-11-03T19:25:06.883319] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-11-03T19:25:06.883376] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-11-03T19:25:07.139962] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-11-03T19:25:07.263705] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:25:07.293815] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-11-03T19:25:07.934824] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-11-03T19:25:08.009211] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T19:25:08.734918] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-11-03T19:25:09.490719] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-11-03T19:25:09.534829] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-11-03T19:25:10.040221] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T19:25:10.334890] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-11-03T19:25:10.584946] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T19:25:11.134851] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-11-03T19:25:11.934845] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-11-03T19:25:12.000226] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-11-03T19:25:12.539188] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T19:25:12.647463] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T19:25:12.734894] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-11-03T19:25:13.534873] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-11-03T19:25:13.559617] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T19:25:14.298622] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T19:25:14.334848] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-11-03T19:25:15.134857] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-11-03T19:25:15.158722] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T19:25:15.934921] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-11-03T19:25:16.370387] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:25:16.734888] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-11-03T19:25:17.403219] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T19:25:17.534863] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-11-03T19:25:17.612522] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-11-03T19:25:18.334935] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-11-03T19:25:19.038575] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T19:25:19.134844] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-11-03T19:25:19.574277] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T19:25:19.934912] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-11-03T19:25:20.649977] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-11-03T19:25:20.734860] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-11-03T19:25:20.843271] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-11-03T19:25:21.534922] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-11. [2025-11-03T19:25:22.337853] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-11-03T19:25:22.341111] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T19:25:22.782125] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-11 (1.25 seconds). [2025-11-03T19:25:22.783776] [INFO ] [REMOTE ] HMC: Full fetch complete (68347 records). [2025-11-03T19:25:22.783878] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-11-03T19:25:23.140094] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-11-03T19:25:23.269200] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-11-03T19:25:23.269356] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-11-03T19:25:23.270384] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-11-03T19:25:23.270449] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-11-03T19:25:23.271944] [DEBUG] [LOCAL ] HMC: Trimmed 68347 records to 46056 (keeping 200 days of data) [2025-11-03T19:25:23.392411] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T19:25:23.591659] [DEBUG] [LOCAL ] HMC: Primary data saved (46056 records). [2025-11-03T19:25:23.591806] [INFO ] [MAIN ] HMC: Full history saved. [2025-11-03T19:25:23.591884] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HMC took 41.8s. Estimated remaining: 3h 7m 32s. Rate: 7.1 symbols/min [2025-11-03T19:25:23.773945] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:25:23.821700] [DEBUG] [LOCAL ] HOG: Loaded 51201 existing records from primary storage. [2025-11-03T19:25:23.822036] [INFO ] [MAIN ] HOG: Loaded 51201 existing records. [2025-11-03T19:25:23.940091] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-11-03T19:25:24.038559] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:25:24.038835] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-11-03T19:25:24.038888] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-11-03T19:25:24.039780] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-11-03T19:25:24.039839] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-11-03T19:25:24.426175] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:25:24.723813] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T19:25:24.734812] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-11-03T19:25:24.883403] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-11-03T19:25:25.507793] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-11-03T19:25:25.534837] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-11-03T19:25:26.334864] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-11. [2025-11-03T19:25:26.615180] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:25:27.134864] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-11-03T19:25:27.640719] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-11 (1.31 seconds). [2025-11-03T19:25:27.643024] [INFO ] [REMOTE ] HMY: Full fetch complete (77170 records). [2025-11-03T19:25:27.643152] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-11-03T19:25:27.945049] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-11-03T19:25:28.043329] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-11-03T19:25:28.043402] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-11-03T19:25:28.044356] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-11-03T19:25:28.044418] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-11-03T19:25:28.045932] [DEBUG] [LOCAL ] HMY: Trimmed 77170 records to 53153 (keeping 200 days of data) [2025-11-03T19:25:28.371047] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:25:28.391738] [DEBUG] [LOCAL ] HMY: Primary data saved (53153 records). [2025-11-03T19:25:28.391848] [INFO ] [MAIN ] HMY: Full history saved. [2025-11-03T19:25:28.391919] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HMY took 33.0s. Estimated remaining: 3h 7m 19s. Rate: 7.1 symbols/min [2025-11-03T19:25:28.589027] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:25:28.626093] [DEBUG] [LOCAL ] HOMB: Loaded 44181 existing records from primary storage. [2025-11-03T19:25:28.626370] [INFO ] [MAIN ] HOMB: Loaded 44181 existing records. [2025-11-03T19:25:28.740009] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-11-03T19:25:28.807000] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:25:28.807187] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-11-03T19:25:28.807255] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-11-03T19:25:28.808025] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-11-03T19:25:28.808082] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-11-03T19:25:29.182834] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:25:29.211694] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T19:25:29.394727] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-11-03T19:25:29.534854] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-11-03T19:25:30.334850] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-11-03T19:25:30.658184] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T19:25:31.134855] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-11. [2025-11-03T19:25:31.572992] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T19:25:31.934882] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-11-03T19:25:31.971280] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T19:25:31.972284] [INFO ] [REMOTE ] HMN: Full fetch complete (31988 records). [2025-11-03T19:25:31.972353] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-11-03T19:25:32.347425] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-11-03T19:25:32.347509] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-11-03T19:25:32.348186] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-11-03T19:25:32.348248] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-11-03T19:25:32.349066] [DEBUG] [LOCAL ] HMN: Trimmed 31988 records to 22979 (keeping 200 days of data) [2025-11-03T19:25:32.484776] [DEBUG] [LOCAL ] HMN: Primary data saved (22979 records). [2025-11-03T19:25:32.484912] [INFO ] [MAIN ] HMN: Full history saved. [2025-11-03T19:25:32.484994] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HMN took 37.6s. Estimated remaining: 3h 7m 5s. Rate: 7.1 symbols/min [2025-11-03T19:25:32.660910] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:25:32.699545] [DEBUG] [LOCAL ] HOUS: Loaded 46582 existing records from primary storage. [2025-11-03T19:25:32.699873] [INFO ] [MAIN ] HOUS: Loaded 46582 existing records. [2025-11-03T19:25:32.742951] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-11. [2025-11-03T19:25:32.883687] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:25:32.883938] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-11-03T19:25:32.883988] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-11-03T19:25:32.884782] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-11-03T19:25:32.884841] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-11-03T19:25:33.252166] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:25:33.291858] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T19:25:33.534847] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-11-03T19:25:33.614537] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:25:33.616165] [INFO ] [REMOTE ] HNI: Full fetch complete (42678 records). [2025-11-03T19:25:33.616402] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-11-03T19:25:34.002955] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-11-03T19:25:34.003034] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-11-03T19:25:34.003983] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-11-03T19:25:34.004046] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-11-03T19:25:34.004979] [DEBUG] [LOCAL ] HNI: Trimmed 42678 records to 30250 (keeping 200 days of data) [2025-11-03T19:25:34.184568] [DEBUG] [LOCAL ] HNI: Primary data saved (30250 records). [2025-11-03T19:25:34.184731] [INFO ] [MAIN ] HNI: Full history saved. [2025-11-03T19:25:34.184820] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HNI took 27.7s. Estimated remaining: 3h 6m 48s. Rate: 7.1 symbols/min [2025-11-03T19:25:34.350865] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-11-03T19:25:34.353404] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:25:34.368343] [DEBUG] [LOCAL ] HOV: Loaded 13825 existing records from primary storage. [2025-11-03T19:25:34.368709] [INFO ] [MAIN ] HOV: Loaded 13825 existing records. [2025-11-03T19:25:34.547168] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:25:34.547496] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-11-03T19:25:34.547618] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-11-03T19:25:34.548130] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-11-03T19:25:34.548185] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-11-03T19:25:34.938078] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T19:25:34.942694] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:25:35.134856] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-11-03T19:25:35.520220] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:25:35.715940] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-11-03T19:25:35.934901] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-11-03T19:25:36.593227] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-11-03T19:25:36.734864] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-11-03T19:25:37.534927] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-11-03T19:25:38.028450] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T19:25:38.334831] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-11-03T19:25:38.367784] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T19:25:39.134862] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-11-03T19:25:39.391484] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T19:25:39.734319] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-11-03T19:25:39.934916] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-11-03T19:25:40.735162] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-11-03T19:25:40.987791] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T19:25:41.534896] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-11-03T19:25:41.902837] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:25:42.142308] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-11-03T19:25:42.334863] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-11-03T19:25:42.908967] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T19:25:43.134877] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-11-03T19:25:43.934855] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-11-03T19:25:44.382792] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:25:44.519972] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T19:25:44.734869] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-11-03T19:25:45.534875] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-11-03T19:25:46.017172] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T19:25:46.086458] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-11-03T19:25:46.334869] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-11-03T19:25:47.134890] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-11-03T19:25:47.581424] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:25:47.934859] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-11-03T19:25:48.044375] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-11-03T19:25:48.734864] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-11-03T19:25:49.244477] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T19:25:49.534856] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-11-03T19:25:49.867525] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T19:25:50.334886] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-11-03T19:25:50.616879] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T19:25:50.946756] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-11-03T19:25:51.134905] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-11-03T19:25:51.934885] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-11-03T19:25:52.248210] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-11-03T19:25:52.734850] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-11-03T19:25:52.951292] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T19:25:53.534897] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-11-03T19:25:53.912056] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T19:25:54.334900] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-11-03T19:25:54.746103] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:25:54.951903] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-11-03T19:25:55.134873] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-11-03T19:25:55.934833] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-11-03T19:25:56.120435] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-11-03T19:25:56.734869] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-11-03T19:25:57.131959] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T19:25:57.534865] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-11-03T19:25:57.754780] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T19:25:58.090779] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-11-03T19:25:58.334915] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-11-03T19:25:59.134901] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-11. [2025-11-03T19:25:59.412492] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:25:59.704228] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T19:25:59.705214] [INFO ] [REMOTE ] HOV: Full fetch complete (18891 records). [2025-11-03T19:25:59.705291] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-11-03T19:25:59.940025] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-11-03T19:26:00.154981] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-11-03T19:26:00.155063] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-11-03T19:26:00.155684] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-11-03T19:26:00.155750] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-11-03T19:26:00.156340] [DEBUG] [LOCAL ] HOV: Trimmed 18891 records to 13685 (keeping 200 days of data) [2025-11-03T19:26:00.247960] [DEBUG] [LOCAL ] HOV: Primary data saved (13685 records). [2025-11-03T19:26:00.248096] [INFO ] [MAIN ] HOV: Full history saved. [2025-11-03T19:26:00.248174] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HOV took 26.1s. Estimated remaining: 3h 7m 2s. Rate: 7.1 symbols/min [2025-11-03T19:26:00.734958] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-11. [2025-11-03T19:26:01.362339] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-11-03T19:26:01.534895] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-11-03T19:26:01.892949] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T19:26:01.894954] [INFO ] [REMOTE ] HOG: Full fetch complete (74232 records). [2025-11-03T19:26:01.895109] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-11-03T19:26:02.309920] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-11-03T19:26:02.310014] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-11-03T19:26:02.311010] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-11-03T19:26:02.311089] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-11-03T19:26:02.312581] [DEBUG] [LOCAL ] HOG: Trimmed 74232 records to 50439 (keeping 200 days of data) [2025-11-03T19:26:02.364382] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-11-03T19:26:02.618072] [DEBUG] [LOCAL ] HOG: Primary data saved (50439 records). [2025-11-03T19:26:02.618325] [INFO ] [MAIN ] HOG: Full history saved. [2025-11-03T19:26:02.618424] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HOG took 39.0s. Estimated remaining: 3h 6m 46s. Rate: 7.1 symbols/min [2025-11-03T19:26:02.753072] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T19:26:03.134919] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-11. [2025-11-03T19:26:03.499071] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T19:26:03.934842] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-11-03T19:26:04.018064] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T19:26:04.019412] [INFO ] [REMOTE ] HOMB: Full fetch complete (64363 records). [2025-11-03T19:26:04.019485] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-11-03T19:26:04.401269] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-11-03T19:26:04.401361] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-11-03T19:26:04.402301] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-11-03T19:26:04.402364] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-11-03T19:26:04.403707] [DEBUG] [LOCAL ] HOMB: Trimmed 64363 records to 43479 (keeping 200 days of data) [2025-11-03T19:26:04.654335] [DEBUG] [LOCAL ] HOMB: Primary data saved (43479 records). [2025-11-03T19:26:04.654477] [INFO ] [MAIN ] HOMB: Full history saved. [2025-11-03T19:26:04.654593] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOMB took 36.3s. Estimated remaining: 3h 6m 29s. Rate: 7.1 symbols/min [2025-11-03T19:26:05.230150] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T19:26:05.241528] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-11-03T19:26:06.519549] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T19:26:06.533484] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-11. [2025-11-03T19:26:07.689116] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T19:26:07.690530] [INFO ] [REMOTE ] HOUS: Full fetch complete (64888 records). [2025-11-03T19:26:07.690632] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-11-03T19:26:08.079313] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-11-03T19:26:08.079396] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-11-03T19:26:08.080335] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-11-03T19:26:08.080399] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-11-03T19:26:08.081615] [DEBUG] [LOCAL ] HOUS: Trimmed 64888 records to 45965 (keeping 200 days of data) [2025-11-03T19:26:08.331909] [DEBUG] [LOCAL ] HOUS: Primary data saved (45965 records). [2025-11-03T19:26:08.332036] [INFO ] [MAIN ] HOUS: Full history saved. [2025-11-03T19:26:08.332113] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HOUS took 35.8s. Estimated remaining: 3h 6m 15s. Rate: 7.1 symbols/min [2025-11-03T19:26:09.034580] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:09.093703] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:09.080407] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:09.176457] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:09.177519] [DEBUG] [LOCAL ] HPI: Loaded 10649 existing records from primary storage. [2025-11-03T19:26:09.178429] [INFO ] [MAIN ] HPI: Loaded 10649 existing records. [2025-11-03T19:26:09.236777] [DEBUG] [LOCAL ] HPF: Loaded 7368 existing records from primary storage. [2025-11-03T19:26:09.261435] [INFO ] [MAIN ] HPF: Loaded 7368 existing records. [2025-11-03T19:26:09.587089] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:09.605632] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-11-03T19:26:09.626714] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-11-03T19:26:09.632018] [DEBUG] [LOCAL ] HPE: Loaded 54477 existing records from primary storage. [2025-11-03T19:26:09.641981] [DEBUG] [LOCAL ] HP: Loaded 51930 existing records from primary storage. [2025-11-03T19:26:09.648217] [INFO ] [MAIN ] HPE: Loaded 54477 existing records. [2025-11-03T19:26:09.649022] [INFO ] [MAIN ] HP: Loaded 51930 existing records. [2025-11-03T19:26:09.667825] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-11-03T19:26:09.678958] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-11-03T19:26:09.683273] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:09.733583] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-11-03T19:26:09.748684] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-11-03T19:26:09.877719] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-11-03T19:26:09.898404] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-11-03T19:26:10.317271] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:10.364322] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:10.400785] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-11-03T19:26:10.430532] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-11-03T19:26:10.466468] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-11-03T19:26:10.471849] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-11-03T19:26:10.530277] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-11-03T19:26:10.547665] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-11-03T19:26:10.552887] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-11-03T19:26:10.618028] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-11-03T19:26:10.973422] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:11.074232] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:11.085184] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-11-03T19:26:11.122280] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-11-03T19:26:11.557051] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:11.553025] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:11.557342] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-11-03T19:26:11.557587] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-11-03T19:26:11.734771] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-11-03T19:26:11.737017] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-11-03T19:26:11.762119] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-11-03T19:26:11.764389] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-11-03T19:26:12.124683] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T19:26:12.126515] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-11-03T19:26:12.169953] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T19:26:12.172953] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-11-03T19:26:12.602473] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T19:26:12.716379] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-11-03T19:26:12.734807] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-11-03T19:26:13.047691] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-11-03T19:26:13.279844] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-11-03T19:26:13.477432] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-11-03T19:26:13.534849] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-11-03T19:26:14.334861] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-11-03T19:26:14.937819] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T19:26:15.134885] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-11-03T19:26:15.645286] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-11-03T19:26:15.707035] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T19:26:15.934829] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-11-03T19:26:16.734913] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-11-03T19:26:17.221963] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:26:17.534848] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-11-03T19:26:18.264090] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-11-03T19:26:18.334841] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-11-03T19:26:18.925805] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T19:26:19.134859] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-11-03T19:26:19.545504] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-11-03T19:26:19.752572] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T19:26:19.934837] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-11-03T19:26:20.403704] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-11-03T19:26:20.734890] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-11-03T19:26:21.296272] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-11-03T19:26:21.534858] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-11-03T19:26:22.334900] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-11-03T19:26:22.777360] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T19:26:22.778187] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T19:26:23.134866] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-11-03T19:26:23.934878] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-11-03T19:26:24.371139] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-11-03T19:26:24.439156] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T19:26:24.734857] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-11-03T19:26:25.534888] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-11-03T19:26:26.053846] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-11-03T19:26:26.179451] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T19:26:26.334858] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-11-03T19:26:27.134917] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-11-03T19:26:27.613065] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T19:26:27.743568] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T19:26:27.934956] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-11-03T19:26:28.598248] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T19:26:28.734888] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-11-03T19:26:29.534910] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-11-03T19:26:30.252388] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-11-03T19:26:30.334825] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-11-03T19:26:30.826053] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-11-03T19:26:31.134842] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-11-03T19:26:31.600431] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-11-03T19:26:31.919501] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-11-03T19:26:31.934805] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-11-03T19:26:32.400247] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T19:26:32.734852] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-11-03T19:26:33.298403] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-11-03T19:26:33.534827] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-11-03T19:26:33.953259] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T19:26:34.334857] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-11. [2025-11-03T19:26:34.794544] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-11 (0.46 seconds). [2025-11-03T19:26:34.795310] [INFO ] [REMOTE ] HPI: Full fetch complete (13778 records). [2025-11-03T19:26:34.795381] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-11-03T19:26:35.139338] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-11. [2025-11-03T19:26:35.224929] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-11-03T19:26:35.225056] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-11-03T19:26:35.225407] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-11-03T19:26:35.225468] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-11-03T19:26:35.226325] [DEBUG] [LOCAL ] HPI: Trimmed 13778 records to 10543 (keeping 200 days of data) [2025-11-03T19:26:35.289810] [DEBUG] [LOCAL ] HPI: Primary data saved (10543 records). [2025-11-03T19:26:35.289935] [INFO ] [MAIN ] HPI: Full history saved. [2025-11-03T19:26:35.290011] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HPI took 27.0s. Estimated remaining: 3h 6m 30s. Rate: 7.1 symbols/min [2025-11-03T19:26:35.459265] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:35.503059] [DEBUG] [LOCAL ] HPP: Loaded 51981 existing records from primary storage. [2025-11-03T19:26:35.503382] [INFO ] [MAIN ] HPP: Loaded 51981 existing records. [2025-11-03T19:26:35.611617] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-11 (0.47 seconds). [2025-11-03T19:26:35.612769] [INFO ] [REMOTE ] HPF: Full fetch complete (10282 records). [2025-11-03T19:26:35.628489] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-11-03T19:26:35.796258] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:35.807338] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-11-03T19:26:35.812994] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-11-03T19:26:35.824068] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-11-03T19:26:35.856359] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-11-03T19:26:35.944041] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-11-03T19:26:36.358086] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-11-03T19:26:36.358391] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-11-03T19:26:36.358682] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-11-03T19:26:36.358764] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-11-03T19:26:36.369753] [DEBUG] [LOCAL ] HPF: Trimmed 10282 records to 7279 (keeping 200 days of data) [2025-11-03T19:26:36.470055] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:36.482761] [DEBUG] [LOCAL ] HPF: Primary data saved (7279 records). [2025-11-03T19:26:36.482830] [INFO ] [MAIN ] HPF: Full history saved. [2025-11-03T19:26:36.482894] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPF took 28.1s. Estimated remaining: 3h 6m 12s. Rate: 7.1 symbols/min [2025-11-03T19:26:36.654028] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:36.700941] [DEBUG] [LOCAL ] HPQ: Loaded 54449 existing records from primary storage. [2025-11-03T19:26:36.701237] [INFO ] [MAIN ] HPQ: Loaded 54449 existing records. [2025-11-03T19:26:36.744635] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-11-03T19:26:36.885703] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:36.885948] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-11-03T19:26:36.886002] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-11-03T19:26:36.886893] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-11-03T19:26:36.886951] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-11-03T19:26:37.255450] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:37.486601] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-11-03T19:26:37.534863] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-11-03T19:26:37.916204] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:26:38.334867] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-11-03T19:26:38.849825] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:26:39.134856] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-11-03T19:26:39.737270] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T19:26:39.934894] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-11-03T19:26:40.274516] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:26:40.734897] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-11-03T19:26:40.973740] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T19:26:41.534873] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-11-03T19:26:42.036153] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T19:26:42.334918] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-11-03T19:26:43.134899] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-11-03T19:26:43.272689] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-11-03T19:26:43.802712] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T19:26:43.934874] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-11. [2025-11-03T19:26:44.317444] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T19:26:44.734873] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-11-03T19:26:45.215212] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T19:26:45.216724] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-11-03T19:26:45.216826] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-11-03T19:26:45.541752] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-11-03T19:26:45.602227] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-11-03T19:26:45.602338] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-11-03T19:26:45.603445] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-11-03T19:26:45.603509] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-11-03T19:26:45.605166] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-11-03T19:26:45.953868] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-11-03T19:26:45.966202] [INFO ] [MAIN ] HPE: Full history saved. [2025-11-03T19:26:45.966333] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HPE took 37.6s. Estimated remaining: 3h 6m 5s. Rate: 7.1 symbols/min [2025-11-03T19:26:46.053547] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T19:26:46.151408] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:46.161781] [DEBUG] [LOCAL ] HPS: Loaded 10214 existing records from primary storage. [2025-11-03T19:26:46.161998] [INFO ] [MAIN ] HPS: Loaded 10214 existing records. [2025-11-03T19:26:46.335807] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:46.336613] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-11-03T19:26:46.336771] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-11-03T19:26:46.335938] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-11-03T19:26:46.338171] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-11-03T19:26:46.338272] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-11-03T19:26:46.735615] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:47.131502] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-11-03T19:26:47.141804] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-11-03T19:26:47.570807] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T19:26:47.695094] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T19:26:47.934916] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-11-03T19:26:48.734880] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-11-03T19:26:49.142952] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T19:26:49.534870] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-11-03T19:26:49.966976] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T19:26:50.334861] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-11-03T19:26:50.903824] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-11-03T19:26:50.952842] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T19:26:51.134924] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-11-03T19:26:51.934922] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-11. [2025-11-03T19:26:52.330320] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T19:26:52.734891] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-11-03T19:26:52.892573] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T19:26:52.894242] [INFO ] [REMOTE ] HP: Full fetch complete (74152 records). [2025-11-03T19:26:52.894339] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-11-03T19:26:53.291789] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-11-03T19:26:53.367297] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-11-03T19:26:53.367390] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-11-03T19:26:53.368365] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-11-03T19:26:53.368426] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-11-03T19:26:53.369860] [DEBUG] [LOCAL ] HP: Trimmed 74152 records to 51133 (keeping 200 days of data) [2025-11-03T19:26:53.540172] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-11-03T19:26:53.675906] [DEBUG] [LOCAL ] HP: Primary data saved (51133 records). [2025-11-03T19:26:53.676050] [INFO ] [MAIN ] HP: Full history saved. [2025-11-03T19:26:53.676133] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HP took 45.3s. Estimated remaining: 3h 5m 56s. Rate: 7.1 symbols/min [2025-11-03T19:26:53.856902] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:26:53.881532] [DEBUG] [LOCAL ] HQH: Loaded 25837 existing records from primary storage. [2025-11-03T19:26:53.881858] [INFO ] [MAIN ] HQH: Loaded 25837 existing records. [2025-11-03T19:26:54.057084] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:26:54.057317] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-11-03T19:26:54.057388] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-11-03T19:26:54.057947] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-11-03T19:26:54.058004] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-11-03T19:26:54.336265] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-11-03T19:26:54.417248] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:26:54.943425] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-11-03T19:26:54.976513] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-11-03T19:26:55.134850] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-11-03T19:26:55.934878] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-11-03T19:26:56.581073] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-11-03T19:26:56.617565] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-11-03T19:26:56.734841] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-11-03T19:26:57.534851] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-11-03T19:26:58.077542] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T19:26:58.168603] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T19:26:58.334838] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-11-03T19:26:59.134872] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-11-03T19:26:59.589358] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:26:59.934844] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-11-03T19:26:59.962102] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T19:27:00.734895] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-11-03T19:27:01.296823] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T19:27:01.534907] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-11-03T19:27:01.944618] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:27:02.071857] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T19:27:02.334878] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-11-03T19:27:03.134858] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-11-03T19:27:03.868603] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T19:27:03.893817] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T19:27:03.934850] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-11. [2025-11-03T19:27:04.734897] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-11-03T19:27:05.156777] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-11 (1.22 seconds). [2025-11-03T19:27:05.158308] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-11-03T19:27:05.158416] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-11-03T19:27:05.398511] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-11-03T19:27:05.542699] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-11-03T19:27:05.566825] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-11-03T19:27:05.566910] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-11-03T19:27:05.567960] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-11-03T19:27:05.568026] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-11-03T19:27:05.569468] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-11-03T19:27:05.925002] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-11-03T19:27:05.925257] [INFO ] [MAIN ] HPQ: Full history saved. [2025-11-03T19:27:05.925363] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HPQ took 29.4s. Estimated remaining: 3h 5m 52s. Rate: 7.1 symbols/min [2025-11-03T19:27:06.136784] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:06.154712] [DEBUG] [LOCAL ] HQL: Loaded 17731 existing records from primary storage. [2025-11-03T19:27:06.155000] [INFO ] [MAIN ] HQL: Loaded 17731 existing records. [2025-11-03T19:27:06.262929] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T19:27:06.342405] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:06.338616] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-11-03T19:27:06.343586] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-11-03T19:27:06.343687] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-11-03T19:27:06.344104] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-11-03T19:27:06.344165] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-11-03T19:27:06.688440] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:07.134830] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-11-03T19:27:07.213082] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-11-03T19:27:07.934895] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-11-03T19:27:08.506327] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T19:27:08.606549] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-11-03T19:27:08.734866] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-11-03T19:27:09.394751] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-11-03T19:27:09.534847] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-11. [2025-11-03T19:27:10.334856] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-11-03T19:27:10.630602] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:27:10.632087] [INFO ] [REMOTE ] HPP: Full fetch complete (73430 records). [2025-11-03T19:27:10.632184] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-11-03T19:27:10.943142] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-11-03T19:27:11.035185] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-11-03T19:27:11.035277] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-11-03T19:27:11.036238] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-11-03T19:27:11.036304] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-11-03T19:27:11.037775] [DEBUG] [LOCAL ] HPP: Trimmed 73430 records to 51272 (keeping 200 days of data) [2025-11-03T19:27:11.134867] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-11-03T19:27:11.315884] [DEBUG] [LOCAL ] HPP: Primary data saved (51272 records). [2025-11-03T19:27:11.316015] [INFO ] [MAIN ] HPP: Full history saved. [2025-11-03T19:27:11.316094] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPP took 36.0s. Estimated remaining: 3h 5m 40s. Rate: 7.1 symbols/min [2025-11-03T19:27:11.485301] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:11.533300] [DEBUG] [LOCAL ] HR: Loaded 52859 existing records from primary storage. [2025-11-03T19:27:11.533668] [INFO ] [MAIN ] HR: Loaded 52859 existing records. [2025-11-03T19:27:11.733242] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:11.733468] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-11-03T19:27:11.733540] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-11-03T19:27:11.734401] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-11-03T19:27:11.734461] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-11-03T19:27:11.939124] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-11-03T19:27:11.976489] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-11-03T19:27:12.125140] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:12.493673] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-11-03T19:27:12.734894] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-11. [2025-11-03T19:27:13.325366] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-11 (0.59 seconds). [2025-11-03T19:27:13.326157] [INFO ] [REMOTE ] HPS: Full fetch complete (14883 records). [2025-11-03T19:27:13.326225] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-11-03T19:27:13.539941] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-11-03T19:27:13.719288] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-11-03T19:27:13.719365] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-11-03T19:27:13.719739] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-11-03T19:27:13.719804] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-11-03T19:27:13.720266] [DEBUG] [LOCAL ] HPS: Trimmed 14883 records to 10137 (keeping 200 days of data) [2025-11-03T19:27:13.780838] [DEBUG] [LOCAL ] HPS: Primary data saved (10137 records). [2025-11-03T19:27:13.780961] [INFO ] [MAIN ] HPS: Full history saved. [2025-11-03T19:27:13.781037] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPS took 27.8s. Estimated remaining: 3h 5m 24s. Rate: 7.1 symbols/min [2025-11-03T19:27:13.955603] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:13.996673] [DEBUG] [LOCAL ] HRB: Loaded 48640 existing records from primary storage. [2025-11-03T19:27:13.996996] [INFO ] [MAIN ] HRB: Loaded 48640 existing records. [2025-11-03T19:27:14.193468] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:14.193744] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-11-03T19:27:14.193806] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-11-03T19:27:14.194884] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-11-03T19:27:14.194945] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-11-03T19:27:14.338187] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-11-03T19:27:14.426054] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T19:27:14.653209] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:15.134863] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-11-03T19:27:15.559329] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T19:27:15.934855] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-11-03T19:27:16.250536] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-11-03T19:27:16.734926] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-11-03T19:27:16.990719] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T19:27:17.337120] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T19:27:17.534886] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-11-03T19:27:18.122538] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T19:27:18.334883] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-11-03T19:27:19.134932] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-11-03T19:27:19.528467] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-11-03T19:27:19.843720] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T19:27:19.934852] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-11-03T19:27:20.551848] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:27:20.734874] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-11-03T19:27:21.534886] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-11-03T19:27:21.928398] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:27:22.290188] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T19:27:22.334877] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-11-03T19:27:23.134891] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-11-03T19:27:23.643446] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:27:23.934893] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-11-03T19:27:23.980517] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-11-03T19:27:24.734877] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-11-03T19:27:25.237484] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T19:27:25.523640] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T19:27:25.534850] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-11-03T19:27:26.334880] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-11-03T19:27:26.809360] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T19:27:27.134872] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-11-03T19:27:27.443579] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:27:27.884859] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T19:27:27.934894] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-11-03T19:27:28.734874] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-11-03T19:27:29.147430] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T19:27:29.540017] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-11. [2025-11-03T19:27:29.552891] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T19:27:30.328122] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T19:27:30.329269] [INFO ] [REMOTE ] HQL: Full fetch complete (25686 records). [2025-11-03T19:27:30.329345] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-11-03T19:27:30.340747] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-11-03T19:27:30.722432] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-11-03T19:27:30.722509] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-11-03T19:27:30.723052] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-11-03T19:27:30.723112] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-11-03T19:27:30.723812] [DEBUG] [LOCAL ] HQL: Trimmed 25686 records to 17676 (keeping 200 days of data) [2025-11-03T19:27:30.827454] [DEBUG] [LOCAL ] HQL: Primary data saved (17676 records). [2025-11-03T19:27:30.827591] [INFO ] [MAIN ] HQL: Full history saved. [2025-11-03T19:27:30.827697] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HQL took 24.9s. Estimated remaining: 3h 5m 26s. Rate: 7.1 symbols/min [2025-11-03T19:27:30.991427] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:31.023159] [DEBUG] [LOCAL ] HRI: Loaded 32586 existing records from primary storage. [2025-11-03T19:27:31.023453] [INFO ] [MAIN ] HRI: Loaded 32586 existing records. [2025-11-03T19:27:31.140060] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-11-03T19:27:31.201096] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:31.201764] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-11-03T19:27:31.201817] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-11-03T19:27:31.202403] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-11-03T19:27:31.202458] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-11-03T19:27:31.560230] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:31.605376] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T19:27:31.934874] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-11-03T19:27:32.533439] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T19:27:32.734861] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-11-03T19:27:32.787293] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T19:27:33.534909] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-11-03T19:27:33.911138] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T19:27:34.334863] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-11-03T19:27:34.662540] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:27:35.134836] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-11-03T19:27:35.319834] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T19:27:35.934902] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-11-03T19:27:36.233552] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:27:36.734906] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-11-03T19:27:37.136089] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T19:27:37.534907] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-11-03T19:27:37.828602] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T19:27:38.334919] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-11-03T19:27:38.800383] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:27:39.134855] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-11-03T19:27:39.647747] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T19:27:39.934872] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-11. [2025-11-03T19:27:40.297948] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T19:27:40.734849] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-11-03T19:27:40.897979] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T19:27:40.899574] [INFO ] [REMOTE ] HR: Full fetch complete (75199 records). [2025-11-03T19:27:40.899694] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-11-03T19:27:41.289184] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-11-03T19:27:41.289268] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-11-03T19:27:41.290209] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-11-03T19:27:41.290271] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-11-03T19:27:41.291609] [DEBUG] [LOCAL ] HR: Trimmed 75199 records to 52099 (keeping 200 days of data) [2025-11-03T19:27:41.553743] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-11-03T19:27:41.603168] [DEBUG] [LOCAL ] HR: Primary data saved (52099 records). [2025-11-03T19:27:41.603407] [INFO ] [MAIN ] HR: Full history saved. [2025-11-03T19:27:41.603574] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HR took 30.3s. Estimated remaining: 3h 5m 21s. Rate: 7.1 symbols/min [2025-11-03T19:27:41.782867] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:41.805337] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T19:27:41.854252] [DEBUG] [LOCAL ] HRL: Loaded 53893 existing records from primary storage. [2025-11-03T19:27:41.854596] [INFO ] [MAIN ] HRL: Loaded 53893 existing records. [2025-11-03T19:27:42.030094] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:42.030303] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-11-03T19:27:42.030353] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-11-03T19:27:42.031307] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-11-03T19:27:42.031366] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-11-03T19:27:42.340060] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-11-03T19:27:42.394423] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:42.706004] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T19:27:43.134950] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-11-03T19:27:43.276408] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T19:27:43.934879] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-11-03T19:27:44.303898] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:27:44.742714] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-11-03T19:27:44.744930] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-11-03T19:27:45.534904] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-11-03T19:27:45.763724] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T19:27:46.334851] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-11-03T19:27:46.918300] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-11-03T19:27:47.134881] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-11-03T19:27:47.421682] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T19:27:47.934830] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-11-03T19:27:48.076352] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T19:27:48.734879] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-11. [2025-11-03T19:27:48.785243] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T19:27:49.534924] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-11-03T19:27:49.678003] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T19:27:49.679470] [INFO ] [REMOTE ] HRB: Full fetch complete (69837 records). [2025-11-03T19:27:49.679555] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-11-03T19:27:50.059101] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-11-03T19:27:50.059179] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-11-03T19:27:50.060084] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-11-03T19:27:50.060146] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-11-03T19:27:50.061450] [DEBUG] [LOCAL ] HRB: Trimmed 69837 records to 47854 (keeping 200 days of data) [2025-11-03T19:27:50.334930] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-11-03T19:27:50.344583] [DEBUG] [LOCAL ] HRB: Primary data saved (47854 records). [2025-11-03T19:27:50.344743] [INFO ] [MAIN ] HRB: Full history saved. [2025-11-03T19:27:50.344828] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HRB took 36.6s. Estimated remaining: 3h 5m 13s. Rate: 7.1 symbols/min [2025-11-03T19:27:50.511168] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:50.541510] [DEBUG] [LOCAL ] HRTG: Loaded 34670 existing records from primary storage. [2025-11-03T19:27:50.541806] [INFO ] [MAIN ] HRTG: Loaded 34670 existing records. [2025-11-03T19:27:50.721176] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:50.721529] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-11-03T19:27:50.721601] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-11-03T19:27:50.722172] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-11-03T19:27:50.722259] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-11-03T19:27:50.930935] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T19:27:51.150982] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-11-03T19:27:51.155752] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:51.220478] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T19:27:51.934844] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-11-03T19:27:52.013117] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T19:27:52.734838] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-11. [2025-11-03T19:27:53.279763] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T19:27:53.465719] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-11 (0.73 seconds). [2025-11-03T19:27:53.466845] [INFO ] [REMOTE ] HQH: Full fetch complete (36728 records). [2025-11-03T19:27:53.466919] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-11-03T19:27:53.540014] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-11-03T19:27:53.841858] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-11-03T19:27:53.841937] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-11-03T19:27:53.842614] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-11-03T19:27:53.842697] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-11-03T19:27:53.843463] [DEBUG] [LOCAL ] HQH: Trimmed 36728 records to 25566 (keeping 200 days of data) [2025-11-03T19:27:53.990281] [DEBUG] [LOCAL ] HQH: Primary data saved (25566 records). [2025-11-03T19:27:53.990399] [INFO ] [MAIN ] HQH: Full history saved. [2025-11-03T19:27:53.990476] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HQH took 1m 0s. Estimated remaining: 3h 4m 58s. Rate: 7.1 symbols/min [2025-11-03T19:27:54.159976] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:54.205099] [DEBUG] [LOCAL ] HSBC: Loaded 51719 existing records from primary storage. [2025-11-03T19:27:54.205406] [INFO ] [MAIN ] HSBC: Loaded 51719 existing records. [2025-11-03T19:27:54.343091] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-11-03T19:27:54.383692] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:27:54.384150] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-11-03T19:27:54.384299] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-11-03T19:27:54.385243] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-11-03T19:27:54.385302] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-11-03T19:27:54.763817] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:27:54.759672] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T19:27:55.134893] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-11-03T19:27:55.763294] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-11-03T19:27:55.934861] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-11-03T19:27:56.494897] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T19:27:56.734839] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-11-03T19:27:57.174205] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T19:27:57.534852] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-11-03T19:27:58.046228] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T19:27:58.334882] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-11. [2025-11-03T19:27:58.724842] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-11-03T19:27:59.113731] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T19:27:59.114872] [INFO ] [REMOTE ] HRI: Full fetch complete (47063 records). [2025-11-03T19:27:59.114961] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-11-03T19:27:59.140110] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-11-03T19:27:59.508566] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-11-03T19:27:59.508679] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-11-03T19:27:59.509440] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-11-03T19:27:59.509502] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-11-03T19:27:59.510565] [DEBUG] [LOCAL ] HRI: Trimmed 47063 records to 32069 (keeping 200 days of data) [2025-11-03T19:27:59.708370] [DEBUG] [LOCAL ] HRI: Primary data saved (32069 records). [2025-11-03T19:27:59.708509] [INFO ] [MAIN ] HRI: Full history saved. [2025-11-03T19:27:59.708597] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HRI took 28.9s. Estimated remaining: 3h 4m 46s. Rate: 7.1 symbols/min [2025-11-03T19:27:59.876562] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:27:59.890251] [DEBUG] [LOCAL ] HSHP: Loaded 14011 existing records from primary storage. [2025-11-03T19:27:59.890460] [INFO ] [MAIN ] HSHP: Loaded 14011 existing records. [2025-11-03T19:27:59.944882] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-11-03T19:28:00.073006] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:28:00.073205] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-11-03T19:28:00.073253] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-11-03T19:28:00.073633] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-11-03T19:28:00.073721] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-11-03T19:28:00.424270] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:00.542167] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T19:28:00.717844] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:28:00.734818] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-11-03T19:28:01.433009] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T19:28:01.534879] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-11-03T19:28:02.343695] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-11-03T19:28:02.346217] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T19:28:03.134899] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-11-03T19:28:03.883088] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-11-03T19:28:03.934833] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-11-03T19:28:04.101613] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T19:28:04.734910] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-11-03T19:28:05.370963] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T19:28:05.534873] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-11-03T19:28:06.328092] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-11-03T19:28:06.338347] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-11-03T19:28:06.615204] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-11-03T19:28:07.034294] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-11-03T19:28:07.134837] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-11-03T19:28:07.842134] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T19:28:07.934874] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-11-03T19:28:08.652135] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T19:28:08.734849] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-11-03T19:28:09.406319] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T19:28:09.534849] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-11-03T19:28:10.334870] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-11-03T19:28:10.890386] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-11-03T19:28:11.087989] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-11-03T19:28:11.134832] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-11-03T19:28:11.801878] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T19:28:11.934891] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-11. [2025-11-03T19:28:12.734855] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-11-03T19:28:13.203213] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-11 (1.27 seconds). [2025-11-03T19:28:13.204725] [INFO ] [REMOTE ] HRL: Full fetch complete (77047 records). [2025-11-03T19:28:13.204821] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-11-03T19:28:13.538337] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-11-03T19:28:13.599792] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-11-03T19:28:13.599887] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-11-03T19:28:13.600927] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-11-03T19:28:13.600998] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-11-03T19:28:13.602520] [DEBUG] [LOCAL ] HRL: Trimmed 77047 records to 53149 (keeping 200 days of data) [2025-11-03T19:28:13.860807] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:28:13.965478] [DEBUG] [LOCAL ] HRL: Primary data saved (53149 records). [2025-11-03T19:28:13.965606] [INFO ] [MAIN ] HRL: Full history saved. [2025-11-03T19:28:13.965706] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRL took 32.4s. Estimated remaining: 3h 4m 45s. Rate: 7.1 symbols/min [2025-11-03T19:28:14.130345] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:14.176406] [DEBUG] [LOCAL ] HSY: Loaded 51086 existing records from primary storage. [2025-11-03T19:28:14.176903] [INFO ] [MAIN ] HSY: Loaded 51086 existing records. [2025-11-03T19:28:14.294035] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T19:28:14.341559] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-11-03T19:28:14.371241] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:28:14.371530] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-11-03T19:28:14.371584] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-11-03T19:28:14.372415] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-11-03T19:28:14.372472] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-11-03T19:28:14.720441] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:15.134902] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-11-03T19:28:15.838974] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-11-03T19:28:15.934842] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-11-03T19:28:16.160241] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:28:16.734853] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-11-03T19:28:17.233987] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T19:28:17.336932] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-11-03T19:28:17.534907] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-11-03T19:28:18.334853] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-11-03T19:28:18.947905] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T19:28:19.051459] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T19:28:19.134830] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-11-03T19:28:19.692084] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-11-03T19:28:19.934836] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-11-03T19:28:20.734850] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-11-03T19:28:21.272636] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:28:21.534912] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-11. [2025-11-03T19:28:21.692811] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T19:28:22.288255] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-11 (0.75 seconds). [2025-11-03T19:28:22.289079] [INFO ] [REMOTE ] HSHP: Full fetch complete (22643 records). [2025-11-03T19:28:22.289147] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-11-03T19:28:22.341673] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-11-03T19:28:22.650808] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-11-03T19:28:22.650886] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-11-03T19:28:22.651340] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-11-03T19:28:22.651378] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-11-03T19:28:22.652029] [DEBUG] [LOCAL ] HSHP: Trimmed 22643 records to 13694 (keeping 200 days of data) [2025-11-03T19:28:22.727438] [DEBUG] [LOCAL ] HSHP: Primary data saved (13694 records). [2025-11-03T19:28:22.727559] [INFO ] [MAIN ] HSHP: Full history saved. [2025-11-03T19:28:22.727634] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HSHP took 23.0s. Estimated remaining: 3h 4m 37s. Rate: 7.1 symbols/min [2025-11-03T19:28:22.908984] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:22.909202] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-11-03T19:28:22.909268] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-11-03T19:28:22.909401] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-11-03T19:28:22.909447] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-11-03T19:28:22.909488] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-11-03T19:28:22.909519] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-11-03T19:28:23.140494] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-11-03T19:28:23.265563] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:23.621896] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T19:28:23.934874] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-11-03T19:28:24.658050] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-11-03T19:28:24.734913] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-11-03T19:28:24.907891] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:28:24.908454] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-11-03T19:28:24.908583] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:28:24.908708] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-11-03T19:28:24.908801] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:28:24.908895] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-11-03T19:28:24.908995] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-11-03T19:28:24.909059] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-11-03T19:28:24.909127] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-11-03T19:28:24.909197] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HTB took 2.2s. Estimated remaining: 3h 4m 21s. Rate: 7.1 symbols/min [2025-11-03T19:28:25.120070] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:25.135979] [DEBUG] [LOCAL ] HTD: Loaded 14175 existing records from primary storage. [2025-11-03T19:28:25.136222] [INFO ] [MAIN ] HTD: Loaded 14175 existing records. [2025-11-03T19:28:25.316854] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:28:25.317166] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-11-03T19:28:25.317245] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-11-03T19:28:25.317736] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-11-03T19:28:25.317807] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-11-03T19:28:25.540149] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-11-03T19:28:25.551565] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-11-03T19:28:25.712860] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:26.334911] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-11-03T19:28:26.597937] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-11-03T19:28:27.134867] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-11. [2025-11-03T19:28:27.719703] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T19:28:27.934810] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-11-03T19:28:27.968324] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-11 (0.83 seconds). [2025-11-03T19:28:27.969395] [INFO ] [REMOTE ] HRTG: Full fetch complete (44723 records). [2025-11-03T19:28:27.969464] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-11-03T19:28:28.340014] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-11-03T19:28:28.340105] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-11-03T19:28:28.340822] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-11-03T19:28:28.340882] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-11-03T19:28:28.341768] [DEBUG] [LOCAL ] HRTG: Trimmed 44723 records to 34179 (keeping 200 days of data) [2025-11-03T19:28:28.533095] [DEBUG] [LOCAL ] HRTG: Primary data saved (34179 records). [2025-11-03T19:28:28.533219] [INFO ] [MAIN ] HRTG: Full history saved. [2025-11-03T19:28:28.533299] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HRTG took 38.2s. Estimated remaining: 3h 4m 7s. Rate: 7.1 symbols/min [2025-11-03T19:28:28.700559] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:28.700734] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-11-03T19:28:28.700791] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-11-03T19:28:28.700898] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-11-03T19:28:28.700938] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-11-03T19:28:28.700978] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-11-03T19:28:28.701009] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-11-03T19:28:28.742563] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-11-03T19:28:29.056759] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:29.406690] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-11-03T19:28:29.534816] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-11. [2025-11-03T19:28:30.178636] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T19:28:30.334921] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-11-03T19:28:30.564129] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-11-03T19:28:30.874152] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-11 (1.34 seconds). [2025-11-03T19:28:30.875632] [INFO ] [REMOTE ] HSBC: Full fetch complete (74300 records). [2025-11-03T19:28:30.875798] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-11-03T19:28:31.139995] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-11-03T19:28:31.264589] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-11-03T19:28:31.264712] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-11-03T19:28:31.265690] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-11-03T19:28:31.265753] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-11-03T19:28:31.267121] [DEBUG] [LOCAL ] HSBC: Trimmed 74300 records to 50916 (keeping 200 days of data) [2025-11-03T19:28:31.450805] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-11-03T19:28:31.571511] [DEBUG] [LOCAL ] HSBC: Primary data saved (50916 records). [2025-11-03T19:28:31.571633] [INFO ] [MAIN ] HSBC: Full history saved. [2025-11-03T19:28:31.572485] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSBC took 37.6s. Estimated remaining: 3h 3m 52s. Rate: 7.1 symbols/min [2025-11-03T19:28:31.744241] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:31.787152] [DEBUG] [LOCAL ] HTGC: Loaded 48184 existing records from primary storage. [2025-11-03T19:28:31.787490] [INFO ] [MAIN ] HTGC: Loaded 48184 existing records. [2025-11-03T19:28:31.944184] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-11-03T19:28:31.975602] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:28:31.975890] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-11-03T19:28:31.975937] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-11-03T19:28:31.976743] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-11-03T19:28:31.976802] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-11-03T19:28:32.331327] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:32.734851] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-11-03T19:28:33.361798] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T19:28:33.534882] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-11-03T19:28:34.108496] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T19:28:34.334940] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-11-03T19:28:34.569494] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-11-03T19:28:34.936524] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-11-03T19:28:35.134897] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-11-03T19:28:35.739825] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T19:28:35.934933] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-11-03T19:28:36.734967] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-11-03T19:28:37.143142] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-11-03T19:28:37.146606] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T19:28:37.534930] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-11-03T19:28:38.334937] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-11-03T19:28:38.639265] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T19:28:39.134878] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-11-03T19:28:39.694181] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T19:28:39.693883] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T19:28:39.934892] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-11-03T19:28:40.734866] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-11-03T19:28:41.226045] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:28:41.534868] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-11-03T19:28:41.968596] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T19:28:42.118793] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T19:28:42.334917] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-11-03T19:28:43.134924] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-11-03T19:28:43.386092] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-11-03T19:28:43.637699] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T19:28:43.934905] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-11-03T19:28:44.734907] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-11-03T19:28:45.244448] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T19:28:45.313038] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-11-03T19:28:45.534863] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-11-03T19:28:45.754542] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-11-03T19:28:46.334859] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-11-03T19:28:46.514721] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-11-03T19:28:47.134822] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-11-03T19:28:47.934861] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-11-03T19:28:48.158438] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-11-03T19:28:48.434300] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T19:28:48.734858] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-11-03T19:28:48.975222] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-11-03T19:28:49.534854] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-11-03T19:28:49.803339] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.27 seconds). [2025-11-03T19:28:50.334867] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-11. [2025-11-03T19:28:50.729812] [DEBUG] [REMOTE ] HTFC: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:28:50.730145] [WARN ] [REMOTE ] HTFC: No data returned for month 2025-11 [2025-11-03T19:28:50.730237] [FATAL] [REMOTE ] HTFC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:28:50.730310] [FATAL] [MAIN ] HTFC: Failed to fetch primary data. [2025-11-03T19:28:50.730386] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:28:50.730467] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-11-03T19:28:50.730534] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-11-03T19:28:50.730572] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-11-03T19:28:50.730615] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-11-03T19:28:50.730694] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTFC took 22.2s. Estimated remaining: 3h 3m 56s. Rate: 7.1 symbols/min [2025-11-03T19:28:50.911486] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:50.939511] [DEBUG] [LOCAL ] HTH: Loaded 32738 existing records from primary storage. [2025-11-03T19:28:50.939799] [INFO ] [MAIN ] HTH: Loaded 32738 existing records. [2025-11-03T19:28:51.117821] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:28:51.118061] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-11-03T19:28:51.118114] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-11-03T19:28:51.118742] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-11-03T19:28:51.118802] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-11-03T19:28:51.140019] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-11-03T19:28:51.498630] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:28:51.934848] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-11-03T19:28:52.370014] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:28:52.734934] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-11-03T19:28:53.308208] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-11-03T19:28:53.376491] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T19:28:53.534954] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-11-03T19:28:54.119612] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-11-03T19:28:54.334873] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-11-03T19:28:55.134942] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-11-03T19:28:55.578621] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-11-03T19:28:55.843122] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-11-03T19:28:55.934898] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-11-03T19:28:56.734847] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-11-03T19:28:56.799759] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T19:28:57.534842] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-11. [2025-11-03T19:28:57.697806] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T19:28:58.334922] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-11-03T19:28:58.638240] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:28:58.639764] [INFO ] [REMOTE ] HSY: Full fetch complete (73544 records). [2025-11-03T19:28:58.639875] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-11-03T19:28:59.034527] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-11-03T19:28:59.034623] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-11-03T19:28:59.035687] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-11-03T19:28:59.035764] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-11-03T19:28:59.037302] [DEBUG] [LOCAL ] HSY: Trimmed 73544 records to 50347 (keeping 200 days of data) [2025-11-03T19:28:59.135692] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-11-03T19:28:59.343669] [DEBUG] [LOCAL ] HSY: Primary data saved (50347 records). [2025-11-03T19:28:59.344179] [INFO ] [MAIN ] HSY: Full history saved. [2025-11-03T19:28:59.344259] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HSY took 45.4s. Estimated remaining: 3h 3m 48s. Rate: 7.1 symbols/min [2025-11-03T19:28:59.513179] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:28:59.544430] [DEBUG] [LOCAL ] HUBB: Loaded 36171 existing records from primary storage. [2025-11-03T19:28:59.544713] [INFO ] [MAIN ] HUBB: Loaded 36171 existing records. [2025-11-03T19:28:59.752234] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:28:59.752769] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-11-03T19:28:59.753069] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-11-03T19:28:59.754209] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T19:28:59.757592] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-11-03T19:28:59.763547] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-11-03T19:28:59.939760] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-11-03T19:29:00.126579] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:00.142451] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T19:29:00.734858] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-11-03T19:29:01.319595] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T19:29:01.534860] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-11-03T19:29:02.151188] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T19:29:02.334832] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-11-03T19:29:03.053257] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-11-03T19:29:03.134818] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-11-03T19:29:03.307789] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T19:29:03.710703] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-11-03T19:29:03.934850] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-11-03T19:29:04.601569] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-11-03T19:29:04.734902] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-11-03T19:29:05.424370] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T19:29:05.534831] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-11-03T19:29:06.334900] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-11. [2025-11-03T19:29:06.773769] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-11-03T19:29:07.134876] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-11-03T19:29:07.406158] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-11 (1.07 seconds). [2025-11-03T19:29:07.407611] [INFO ] [REMOTE ] HTGC: Full fetch complete (69014 records). [2025-11-03T19:29:07.407737] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-11-03T19:29:07.796327] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-11-03T19:29:07.796408] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-11-03T19:29:07.797298] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-11-03T19:29:07.797360] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-11-03T19:29:07.798728] [DEBUG] [LOCAL ] HTGC: Trimmed 69014 records to 47480 (keeping 200 days of data) [2025-11-03T19:29:07.969926] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-11. [2025-11-03T19:29:08.085430] [DEBUG] [LOCAL ] HTGC: Primary data saved (47480 records). [2025-11-03T19:29:08.085553] [INFO ] [MAIN ] HTGC: Full history saved. [2025-11-03T19:29:08.086417] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HTGC took 36.5s. Estimated remaining: 3h 3m 40s. Rate: 7.1 symbols/min [2025-11-03T19:29:08.276881] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:29:08.303964] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:29:08.343129] [DEBUG] [LOCAL ] HUBS: Loaded 40118 existing records from primary storage. [2025-11-03T19:29:08.343398] [INFO ] [MAIN ] HUBS: Loaded 40118 existing records. [2025-11-03T19:29:08.518344] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:29:08.518569] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-11-03T19:29:08.518624] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-11-03T19:29:08.519303] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-11-03T19:29:08.519362] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-11-03T19:29:08.606398] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T19:29:08.630797] [INFO ] [REMOTE ] HTD: Full fetch complete (19481 records). [2025-11-03T19:29:08.630950] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-11-03T19:29:08.760581] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-11-03T19:29:09.225944] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:09.324545] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-11-03T19:29:09.324635] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-11-03T19:29:09.325145] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-11-03T19:29:09.325207] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-11-03T19:29:09.325853] [DEBUG] [LOCAL ] HTD: Trimmed 19481 records to 13973 (keeping 200 days of data) [2025-11-03T19:29:09.421861] [DEBUG] [LOCAL ] HTD: Primary data saved (13973 records). [2025-11-03T19:29:09.422000] [INFO ] [MAIN ] HTD: Full history saved. [2025-11-03T19:29:09.422084] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HTD took 44.5s. Estimated remaining: 3h 3m 23s. Rate: 7.1 symbols/min [2025-11-03T19:29:09.544816] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-11-03T19:29:09.630031] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:29:09.677390] [DEBUG] [LOCAL ] HUM: Loaded 49647 existing records from primary storage. [2025-11-03T19:29:09.677801] [INFO ] [MAIN ] HUM: Loaded 49647 existing records. [2025-11-03T19:29:09.865732] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:29:09.866097] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-11-03T19:29:09.866169] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-11-03T19:29:09.873227] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-11-03T19:29:09.884897] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-11-03T19:29:09.950033] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:29:10.278445] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:10.334823] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-11-03T19:29:10.573618] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T19:29:11.134859] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-11-03T19:29:11.646274] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:29:11.934823] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-11-03T19:29:11.971826] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T19:29:12.734862] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-11-03T19:29:13.260711] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T19:29:13.534890] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-11-03T19:29:13.686952] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-11-03T19:29:14.334820] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-11-03T19:29:14.810542] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T19:29:15.134898] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-11-03T19:29:15.615680] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T19:29:15.934868] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-11-03T19:29:16.239684] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T19:29:16.734934] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-11-03T19:29:17.077247] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T19:29:17.534844] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-11-03T19:29:18.126775] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T19:29:18.334826] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-11-03T19:29:18.468162] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T19:29:19.134869] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-11-03T19:29:19.325247] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-11-03T19:29:19.934874] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-11-03T19:29:20.280085] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-11-03T19:29:20.734858] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-11-03T19:29:21.506585] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-11-03T19:29:21.534825] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-11-03T19:29:21.712229] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:29:22.334910] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-11-03T19:29:22.887861] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T19:29:23.134838] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-11-03T19:29:23.289333] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-11-03T19:29:23.934850] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-11. [2025-11-03T19:29:24.391977] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:29:24.672754] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-11 (0.74 seconds). [2025-11-03T19:29:24.674051] [INFO ] [REMOTE ] HTH: Full fetch complete (47285 records). [2025-11-03T19:29:24.674149] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-11-03T19:29:24.739984] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-11-03T19:29:25.063197] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-11-03T19:29:25.063274] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-11-03T19:29:25.064081] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-11-03T19:29:25.064142] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-11-03T19:29:25.065104] [DEBUG] [LOCAL ] HTH: Trimmed 47285 records to 32465 (keeping 200 days of data) [2025-11-03T19:29:25.262950] [DEBUG] [LOCAL ] HTH: Primary data saved (32465 records). [2025-11-03T19:29:25.263094] [INFO ] [MAIN ] HTH: Full history saved. [2025-11-03T19:29:25.263177] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HTH took 34.5s. Estimated remaining: 3h 3m 24s. Rate: 7.1 symbols/min [2025-11-03T19:29:25.438005] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:29:25.484892] [DEBUG] [LOCAL ] HUN: Loaded 53985 existing records from primary storage. [2025-11-03T19:29:25.485190] [INFO ] [MAIN ] HUN: Loaded 53985 existing records. [2025-11-03T19:29:25.540769] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-11-03T19:29:25.669185] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:29:25.669398] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-11-03T19:29:25.669446] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-11-03T19:29:25.670325] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-11-03T19:29:25.670383] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-11-03T19:29:26.045142] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:26.069748] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T19:29:26.334815] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-11-03T19:29:27.051470] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T19:29:27.134817] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-11-03T19:29:27.285060] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-11-03T19:29:27.934862] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-11-03T19:29:28.243220] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T19:29:28.734862] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-11-03T19:29:29.044345] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:29:29.534850] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-11-03T19:29:30.065555] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T19:29:30.334840] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-11-03T19:29:30.766393] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T19:29:31.134858] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-11-03T19:29:31.385337] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T19:29:31.934941] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-11-03T19:29:32.565099] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-11-03T19:29:32.734868] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-11. [2025-11-03T19:29:33.096762] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:29:33.534855] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-11-03T19:29:33.959417] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-11 (1.22 seconds). [2025-11-03T19:29:33.961407] [INFO ] [REMOTE ] HUM: Full fetch complete (71097 records). [2025-11-03T19:29:33.961517] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-11-03T19:29:34.336709] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-11-03T19:29:34.382678] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-11-03T19:29:34.382780] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-11-03T19:29:34.383752] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-11-03T19:29:34.383816] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-11-03T19:29:34.385527] [DEBUG] [LOCAL ] HUM: Trimmed 71097 records to 48954 (keeping 200 days of data) [2025-11-03T19:29:34.697149] [DEBUG] [LOCAL ] HUM: Primary data saved (48954 records). [2025-11-03T19:29:34.697285] [INFO ] [MAIN ] HUM: Full history saved. [2025-11-03T19:29:34.697362] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HUM took 25.3s. Estimated remaining: 3h 3m 16s. Rate: 7.1 symbols/min [2025-11-03T19:29:34.872974] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:29:34.910150] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T19:29:34.954539] [DEBUG] [LOCAL ] HUYA: Loaded 44131 existing records from primary storage. [2025-11-03T19:29:34.954883] [INFO ] [MAIN ] HUYA: Loaded 44131 existing records. [2025-11-03T19:29:35.127549] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:29:35.127761] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-11-03T19:29:35.127810] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-11-03T19:29:35.128471] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-11-03T19:29:35.128529] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-11-03T19:29:35.141033] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-11-03T19:29:35.484984] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:35.508935] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:29:35.934852] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-11-03T19:29:36.580361] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T19:29:36.734881] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-11-03T19:29:37.290089] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T19:29:37.534921] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-11-03T19:29:37.879784] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T19:29:38.334892] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-11-03T19:29:38.492372] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T19:29:39.134880] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-11-03T19:29:39.356624] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-11-03T19:29:39.934867] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-11-03T19:29:40.337767] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:29:40.734880] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-11-03T19:29:41.210473] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T19:29:41.534842] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-11-03T19:29:41.969419] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T19:29:42.334871] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-11-03T19:29:42.721148] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T19:29:43.134847] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-11-03T19:29:43.396383] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-11-03T19:29:43.934913] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-11. [2025-11-03T19:29:44.184206] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T19:29:44.734883] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-11. [2025-11-03T19:29:44.739762] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-11 (0.80 seconds). [2025-11-03T19:29:44.741332] [INFO ] [REMOTE ] HUBB: Full fetch complete (54423 records). [2025-11-03T19:29:44.741457] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-11-03T19:29:45.129934] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-11-03T19:29:45.130018] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-11-03T19:29:45.130811] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-11-03T19:29:45.130899] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-11-03T19:29:45.131957] [DEBUG] [LOCAL ] HUBB: Trimmed 54423 records to 35612 (keeping 200 days of data) [2025-11-03T19:29:45.349796] [DEBUG] [LOCAL ] HUBB: Primary data saved (35612 records). [2025-11-03T19:29:45.349928] [INFO ] [MAIN ] HUBB: Full history saved. [2025-11-03T19:29:45.350051] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HUBB took 46.0s. Estimated remaining: 3h 3m 11s. Rate: 7.1 symbols/min [2025-11-03T19:29:45.517059] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:29:45.531323] [DEBUG] [LOCAL ] HVT: Loaded 14720 existing records from primary storage. [2025-11-03T19:29:45.531551] [INFO ] [MAIN ] HVT: Loaded 14720 existing records. [2025-11-03T19:29:45.542556] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-11-03T19:29:45.713116] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:29:45.713363] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-11-03T19:29:45.713412] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-11-03T19:29:45.713829] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-11-03T19:29:45.713885] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-11-03T19:29:45.827830] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-11 (1.09 seconds). [2025-11-03T19:29:45.868019] [INFO ] [REMOTE ] HUBS: Full fetch complete (57485 records). [2025-11-03T19:29:45.893330] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-11-03T19:29:46.238267] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:46.343298] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-11-03T19:29:46.458389] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-11-03T19:29:46.458473] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-11-03T19:29:46.459303] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-11-03T19:29:46.459365] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-11-03T19:29:46.460490] [DEBUG] [LOCAL ] HUBS: Trimmed 57485 records to 39514 (keeping 200 days of data) [2025-11-03T19:29:46.699107] [DEBUG] [LOCAL ] HUBS: Primary data saved (39514 records). [2025-11-03T19:29:46.699256] [INFO ] [MAIN ] HUBS: Full history saved. [2025-11-03T19:29:46.700088] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUBS took 38.6s. Estimated remaining: 3h 2m 54s. Rate: 7.1 symbols/min [2025-11-03T19:29:46.874103] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:29:46.908699] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T19:29:46.965616] [DEBUG] [LOCAL ] HWM: Loaded 53393 existing records from primary storage. [2025-11-03T19:29:46.965956] [INFO ] [MAIN ] HWM: Loaded 53393 existing records. [2025-11-03T19:29:47.091421] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T19:29:47.146086] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-11-03T19:29:47.186797] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:29:47.187028] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-11-03T19:29:47.187079] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-11-03T19:29:47.188075] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-11-03T19:29:47.188134] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-11-03T19:29:47.536491] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:29:47.843237] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T19:29:47.934943] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-11-03T19:29:48.734861] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-11-03T19:29:49.212471] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T19:29:49.534863] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-11-03T19:29:50.286926] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-11-03T19:29:50.334915] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-11-03T19:29:50.697062] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T19:29:51.134867] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-11-03T19:29:51.688101] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T19:29:51.934848] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-11-03T19:29:52.342558] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T19:29:52.682326] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-11-03T19:29:52.734815] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-11-03T19:29:53.509181] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T19:29:53.534810] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-11-03T19:29:54.183794] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T19:29:54.334856] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-11-03T19:29:54.987244] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T19:29:55.134833] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-11-03T19:29:55.934855] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-11-03T19:29:56.588057] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-11-03T19:29:56.734872] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-11-03T19:29:57.204177] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T19:29:57.534862] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-11-03T19:29:58.142106] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-11-03T19:29:58.334872] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-11-03T19:29:58.758923] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-11-03T19:29:59.134905] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-11. [2025-11-03T19:29:59.427938] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-11-03T19:29:59.934883] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-11-03T19:30:00.273504] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:30:00.275042] [INFO ] [REMOTE ] HUN: Full fetch complete (77044 records). [2025-11-03T19:30:00.275134] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-11-03T19:30:00.686736] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-11-03T19:30:00.687209] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-11-03T19:30:00.687130] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T19:30:00.688524] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-11-03T19:30:00.692321] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-11-03T19:30:00.694144] [DEBUG] [LOCAL ] HUN: Trimmed 77044 records to 53214 (keeping 200 days of data) [2025-11-03T19:30:00.746074] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-11-03T19:30:01.013604] [DEBUG] [LOCAL ] HUN: Primary data saved (53214 records). [2025-11-03T19:30:01.013833] [INFO ] [MAIN ] HUN: Full history saved. [2025-11-03T19:30:01.013940] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUN took 35.8s. Estimated remaining: 3h 2m 52s. Rate: 7.1 symbols/min [2025-11-03T19:30:01.187697] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:01.230608] [DEBUG] [LOCAL ] HXL: Loaded 46459 existing records from primary storage. [2025-11-03T19:30:01.230929] [INFO ] [MAIN ] HXL: Loaded 46459 existing records. [2025-11-03T19:30:01.407429] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:30:01.407700] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-11-03T19:30:01.407757] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-11-03T19:30:01.408596] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-11-03T19:30:01.408720] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-11-03T19:30:01.534903] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-11-03T19:30:01.723628] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T19:30:01.808419] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:02.334872] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-11-03T19:30:03.134818] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-11-03T19:30:03.288290] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T19:30:03.934923] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-11-03T19:30:04.008428] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-11-03T19:30:04.418682] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T19:30:04.734929] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-11-03T19:30:05.410502] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-11-03T19:30:05.534900] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-11-03T19:30:05.935117] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T19:30:06.334853] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-11-03T19:30:06.996278] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T19:30:07.134871] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-11-03T19:30:07.498126] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:30:07.874812] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-11-03T19:30:07.934875] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-11. [2025-11-03T19:30:08.527596] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-11 (0.59 seconds). [2025-11-03T19:30:08.528515] [INFO ] [REMOTE ] HVT: Full fetch complete (23000 records). [2025-11-03T19:30:08.528584] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-11-03T19:30:08.739929] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-11-03T19:30:08.913906] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-11-03T19:30:08.913982] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-11-03T19:30:08.914510] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-11-03T19:30:08.914548] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-11-03T19:30:08.915139] [DEBUG] [LOCAL ] HVT: Trimmed 23000 records to 14497 (keeping 200 days of data) [2025-11-03T19:30:08.998177] [DEBUG] [LOCAL ] HVT: Primary data saved (14497 records). [2025-11-03T19:30:08.998311] [INFO ] [MAIN ] HVT: Full history saved. [2025-11-03T19:30:08.998387] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HVT took 23.6s. Estimated remaining: 3h 2m 43s. Rate: 7.1 symbols/min [2025-11-03T19:30:09.166149] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:09.175538] [DEBUG] [LOCAL ] HY: Loaded 9636 existing records from primary storage. [2025-11-03T19:30:09.175764] [INFO ] [MAIN ] HY: Loaded 9636 existing records. [2025-11-03T19:30:09.354631] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:30:09.354899] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-11-03T19:30:09.354955] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-11-03T19:30:09.355194] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-11-03T19:30:09.355233] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-11-03T19:30:09.540512] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-11-03T19:30:09.709423] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:10.180396] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T19:30:10.334851] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-11-03T19:30:10.854156] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T19:30:10.917155] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-11-03T19:30:11.134861] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-11-03T19:30:11.934845] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-11-03T19:30:12.561797] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T19:30:12.734861] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-11-03T19:30:13.354009] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T19:30:13.534878] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-11. [2025-11-03T19:30:14.334889] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-11-03T19:30:14.477188] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-11-03T19:30:14.556030] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-11 (1.02 seconds). [2025-11-03T19:30:14.557507] [INFO ] [REMOTE ] HUYA: Full fetch complete (63990 records). [2025-11-03T19:30:14.557604] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-11-03T19:30:14.948998] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-11-03T19:30:14.949101] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-11-03T19:30:14.950014] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-11-03T19:30:14.950076] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-11-03T19:30:14.951318] [DEBUG] [LOCAL ] HUYA: Trimmed 63990 records to 43564 (keeping 200 days of data) [2025-11-03T19:30:15.138790] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-11-03T19:30:15.192374] [DEBUG] [LOCAL ] HUYA: Primary data saved (43564 records). [2025-11-03T19:30:15.192499] [INFO ] [MAIN ] HUYA: Full history saved. [2025-11-03T19:30:15.192603] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HUYA took 40.5s. Estimated remaining: 3h 2m 32s. Rate: 7.1 symbols/min [2025-11-03T19:30:15.376635] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:15.376902] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-11-03T19:30:15.376989] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-11-03T19:30:15.377093] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-11-03T19:30:15.377134] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-11-03T19:30:15.377175] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-11-03T19:30:15.377207] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-11-03T19:30:15.755999] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T19:30:15.789033] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:15.827358] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T19:30:15.934870] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-11-03T19:30:16.157912] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-11-03T19:30:16.734890] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-11-03T19:30:17.534890] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-11-03T19:30:18.036351] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T19:30:18.334899] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-11-03T19:30:18.915497] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T19:30:19.007240] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T19:30:19.134862] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-11-03T19:30:19.934852] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-11-03T19:30:20.166219] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-11-03T19:30:20.734862] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-11-03T19:30:20.790005] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-11-03T19:30:20.926521] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-11-03T19:30:21.534860] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-11-03T19:30:21.767334] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-11-03T19:30:22.334865] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-11-03T19:30:23.134908] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-11-03T19:30:23.703308] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T19:30:23.840137] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T19:30:23.934852] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-11-03T19:30:24.734847] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-11. [2025-11-03T19:30:25.437583] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-11-03T19:30:25.534851] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-11-03T19:30:26.039125] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T19:30:26.040691] [INFO ] [REMOTE ] HWM: Full fetch complete (76577 records). [2025-11-03T19:30:26.040829] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-11-03T19:30:26.189125] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-11-03T19:30:26.339975] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-11-03T19:30:26.460130] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-11-03T19:30:26.460219] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-11-03T19:30:26.461256] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-11-03T19:30:26.461322] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-11-03T19:30:26.462816] [DEBUG] [LOCAL ] HWM: Trimmed 76577 records to 52614 (keeping 200 days of data) [2025-11-03T19:30:26.676978] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-11-03T19:30:26.801079] [DEBUG] [LOCAL ] HWM: Primary data saved (52614 records). [2025-11-03T19:30:26.801225] [INFO ] [MAIN ] HWM: Full history saved. [2025-11-03T19:30:26.802204] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HWM took 40.1s. Estimated remaining: 3h 2m 27s. Rate: 7.1 symbols/min [2025-11-03T19:30:26.975799] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:26.975963] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-11-03T19:30:26.975999] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-11-03T19:30:26.976106] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-11-03T19:30:26.976149] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-11-03T19:30:26.976232] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-11-03T19:30:26.976284] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-11-03T19:30:27.141205] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-11-03T19:30:27.352860] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:27.760466] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T19:30:27.934853] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-11-03T19:30:28.442144] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T19:30:28.734865] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-11-03T19:30:29.357092] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:30:29.534908] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-11-03T19:30:30.144955] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-11-03T19:30:30.334853] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-11-03T19:30:31.134921] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-11-03T19:30:31.394080] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-11-03T19:30:31.507841] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T19:30:31.934874] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-11-03T19:30:32.123461] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-11-03T19:30:32.734892] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-11-03T19:30:32.928015] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.19 seconds). [2025-11-03T19:30:33.534854] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-11-03T19:30:33.774263] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-11-03T19:30:34.334867] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-11-03T19:30:34.733676] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T19:30:35.134909] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-11-03T19:30:35.372057] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-11-03T19:30:35.934827] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-11. [2025-11-03T19:30:36.459897] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-11 (0.53 seconds). [2025-11-03T19:30:36.460632] [INFO ] [REMOTE ] HY: Full fetch complete (14576 records). [2025-11-03T19:30:36.460724] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-11-03T19:30:36.740036] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-11-03T19:30:36.833197] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-11-03T19:30:36.833296] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-11-03T19:30:36.833553] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-11-03T19:30:36.833592] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-11-03T19:30:36.834068] [DEBUG] [LOCAL ] HY: Trimmed 14576 records to 9422 (keeping 200 days of data) [2025-11-03T19:30:36.888407] [DEBUG] [LOCAL ] HY: Primary data saved (9422 records). [2025-11-03T19:30:36.888517] [INFO ] [MAIN ] HY: Full history saved. [2025-11-03T19:30:36.888590] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HY took 27.9s. Estimated remaining: 3h 2m 21s. Rate: 7.1 symbols/min [2025-11-03T19:30:37.034014] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:30:37.063973] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:37.075186] [DEBUG] [LOCAL ] HYI: Loaded 9633 existing records from primary storage. [2025-11-03T19:30:37.075461] [INFO ] [MAIN ] HYI: Loaded 9633 existing records. [2025-11-03T19:30:37.247854] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:30:37.248075] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-11-03T19:30:37.248130] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-11-03T19:30:37.248424] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-11-03T19:30:37.248481] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-11-03T19:30:37.540022] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-11-03T19:30:37.597449] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:37.872099] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-11-03T19:30:38.334909] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-11-03T19:30:38.841929] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T19:30:39.134906] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-11-03T19:30:39.934865] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-11-03T19:30:40.290052] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-11-03T19:30:40.326527] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:30:40.734941] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-11-03T19:30:41.223675] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T19:30:41.534911] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-11-03T19:30:41.760752] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-11-03T19:30:42.334869] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-11-03T19:30:42.916273] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-11-03T19:30:43.134859] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-11-03T19:30:43.378301] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-11-03T19:30:43.934887] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-11-03T19:30:44.734898] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-11-03T19:30:45.299442] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T19:30:45.444113] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-11-03T19:30:45.534885] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-11-03T19:30:46.020210] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T19:30:46.334885] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-11-03T19:30:46.534915] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.20 seconds). [2025-11-03T19:30:47.134892] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-11. [2025-11-03T19:30:47.934879] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-11-03T19:30:48.133847] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-11-03T19:30:48.270580] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:30:48.272092] [INFO ] [REMOTE ] HXL: Full fetch complete (66826 records). [2025-11-03T19:30:48.272181] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-11-03T19:30:48.694203] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-11-03T19:30:48.694294] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-11-03T19:30:48.695281] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-11-03T19:30:48.695358] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-11-03T19:30:48.696993] [DEBUG] [LOCAL ] HXL: Trimmed 66826 records to 45787 (keeping 200 days of data) [2025-11-03T19:30:48.750391] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-11-03T19:30:48.980063] [DEBUG] [LOCAL ] HXL: Primary data saved (45787 records). [2025-11-03T19:30:48.980191] [INFO ] [MAIN ] HXL: Full history saved. [2025-11-03T19:30:48.980292] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HXL took 48.0s. Estimated remaining: 3h 2m 17s. Rate: 7.1 symbols/min [2025-11-03T19:30:49.156094] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:49.184337] [DEBUG] [LOCAL ] HYT: Loaded 33310 existing records from primary storage. [2025-11-03T19:30:49.184592] [INFO ] [MAIN ] HYT: Loaded 33310 existing records. [2025-11-03T19:30:49.366589] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-11-03T19:30:49.371869] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:30:49.374694] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-11-03T19:30:49.374757] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-11-03T19:30:49.375319] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-11-03T19:30:49.375377] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-11-03T19:30:49.536509] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-11-03T19:30:49.740668] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:50.142538] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-11-03T19:30:50.334869] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-11-03T19:30:51.134862] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-11-03T19:30:51.385514] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-11-03T19:30:51.761624] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-11-03T19:30:51.934900] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-11-03T19:30:52.460087] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-11-03T19:30:52.734870] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-11-03T19:30:52.905554] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-11-03T19:30:53.534870] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-11-03T19:30:54.334865] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-11-03T19:30:54.448077] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-11-03T19:30:54.579959] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.25 seconds). [2025-11-03T19:30:55.134907] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-11. [2025-11-03T19:30:55.439918] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-11 (0.31 seconds). [2025-11-03T19:30:55.440755] [INFO ] [REMOTE ] HYBX: Full fetch complete (681 records). [2025-11-03T19:30:55.440832] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-11-03T19:30:55.656556] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-11-03T19:30:55.656820] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:30:55.656892] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:30:55.656945] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-11-03T19:30:55.657012] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-11-03T19:30:55.657049] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-11-03T19:30:55.657089] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-11-03T19:30:55.657153] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HYBX took 28.9s. Estimated remaining: 3h 2m 6s. Rate: 7.1 symbols/min [2025-11-03T19:30:55.843837] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:55.848819] [DEBUG] [LOCAL ] HYTR: Loaded 3118 existing records from primary storage. [2025-11-03T19:30:55.848979] [INFO ] [MAIN ] HYTR: Loaded 3118 existing records. [2025-11-03T19:30:55.940094] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-11-03T19:30:56.047267] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:30:56.047570] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-11-03T19:30:56.047623] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-11-03T19:30:56.047933] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-11-03T19:30:56.047991] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-11-03T19:30:56.318295] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-11-03T19:30:56.464446] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:56.734928] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-11. [2025-11-03T19:30:57.139064] [DEBUG] [REMOTE ] HYAC: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:30:57.139377] [WARN ] [REMOTE ] HYAC: No data returned for month 2025-11 [2025-11-03T19:30:57.139464] [FATAL] [REMOTE ] HYAC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:30:57.139541] [FATAL] [MAIN ] HYAC: Failed to fetch primary data. [2025-11-03T19:30:57.139602] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:30:57.139703] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-11-03T19:30:57.139770] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-11-03T19:30:57.139804] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-11-03T19:30:57.139843] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-11-03T19:30:57.139886] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HYAC took 41.9s. Estimated remaining: 3h 1m 50s. Rate: 7.1 symbols/min [2025-11-03T19:30:57.308823] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:30:57.308986] [DEBUG] [LOCAL ] HZO: No existing data file found in primary storage. [2025-11-03T19:30:57.309045] [WARN ] [MAIN ] HZO: No existing data found, performing full refresh instead. [2025-11-03T19:30:57.309159] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-11-03T19:30:57.309199] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-11-03T19:30:57.309239] [DEBUG] [LOCAL ] HZO: No primary data file found to delete. [2025-11-03T19:30:57.309270] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-11-03T19:30:57.542004] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-11-03T19:30:57.674974] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:30:57.962405] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-11-03T19:30:58.334884] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-11-03T19:30:59.134864] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-11-03T19:30:59.393519] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T19:30:59.935329] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-11-03T19:30:59.936623] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T19:31:00.734877] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-11-03T19:31:00.784457] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-11-03T19:31:01.534912] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-11-03T19:31:01.928245] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T19:31:01.985728] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:31:02.334903] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-11. [2025-11-03T19:31:02.882513] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-11 (0.55 seconds). [2025-11-03T19:31:02.883326] [INFO ] [REMOTE ] HYI: Full fetch complete (14174 records). [2025-11-03T19:31:02.883397] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-11-03T19:31:03.139958] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-11-03T19:31:03.293795] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-11-03T19:31:03.293884] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-11-03T19:31:03.294243] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-11-03T19:31:03.294282] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-11-03T19:31:03.294868] [DEBUG] [LOCAL ] HYI: Trimmed 14174 records to 9599 (keeping 200 days of data) [2025-11-03T19:31:03.353684] [DEBUG] [LOCAL ] HYI: Primary data saved (9599 records). [2025-11-03T19:31:03.353828] [INFO ] [MAIN ] HYI: Full history saved. [2025-11-03T19:31:03.353911] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYI took 26.5s. Estimated remaining: 3h 1m 38s. Rate: 7.1 symbols/min [2025-11-03T19:31:03.528169] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:03.535755] [DEBUG] [LOCAL ] IAE: Loaded 6584 existing records from primary storage. [2025-11-03T19:31:03.535990] [INFO ] [MAIN ] IAE: Loaded 6584 existing records. [2025-11-03T19:31:03.729027] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:03.729238] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-11-03T19:31:03.729285] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-11-03T19:31:03.729532] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-11-03T19:31:03.729589] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-11-03T19:31:03.934833] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-11-03T19:31:04.113007] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:04.126493] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T19:31:04.734875] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-11-03T19:31:05.005241] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-11-03T19:31:05.534910] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-11-03T19:31:05.559299] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T19:31:05.956293] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T19:31:06.334924] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-11-03T19:31:06.711874] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T19:31:07.134871] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-11-03T19:31:07.519853] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-11-03T19:31:07.934884] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-11-03T19:31:08.734877] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-11-03T19:31:08.922205] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T19:31:09.186085] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-11-03T19:31:09.534862] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-11-03T19:31:09.886367] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-11-03T19:31:10.334870] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-11-03T19:31:10.842062] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T19:31:11.134915] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-11-03T19:31:11.934879] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-11-03T19:31:12.023506] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T19:31:12.734929] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-11-03T19:31:12.910571] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:31:13.148798] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-11-03T19:31:13.534866] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-11-03T19:31:14.334873] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-11-03T19:31:14.573868] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:31:14.778560] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-11-03T19:31:15.134857] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-11-03T19:31:15.934836] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-11-03T19:31:16.111621] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T19:31:16.404692] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-11-03T19:31:16.734862] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-11-03T19:31:17.534850] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-11-03T19:31:17.570802] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T19:31:18.009894] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T19:31:18.334857] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-11-03T19:31:18.722433] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T19:31:19.134890] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-11-03T19:31:19.554785] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-11-03T19:31:19.934857] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-11-03T19:31:20.343496] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-11-03T19:31:20.734859] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-11-03T19:31:21.282369] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-11-03T19:31:21.534904] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-11-03T19:31:22.129028] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-11-03T19:31:22.334880] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-11-03T19:31:22.681864] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-11-03T19:31:23.134835] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-11-03T19:31:23.934825] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-11-03T19:31:24.094182] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T19:31:24.734826] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-11-03T19:31:24.871931] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-11-03T19:31:25.534912] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-11-03T19:31:25.758954] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T19:31:25.813890] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-11-03T19:31:26.334872] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-11. [2025-11-03T19:31:26.842428] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T19:31:26.843138] [INFO ] [REMOTE ] IAE: Full fetch complete (9215 records). [2025-11-03T19:31:26.843204] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-11-03T19:31:27.140004] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-11. [2025-11-03T19:31:27.208921] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-11-03T19:31:27.209005] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-11-03T19:31:27.209267] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-11-03T19:31:27.209307] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-11-03T19:31:27.209901] [DEBUG] [LOCAL ] IAE: Trimmed 9215 records to 6534 (keeping 200 days of data) [2025-11-03T19:31:27.248221] [DEBUG] [LOCAL ] IAE: Primary data saved (6534 records). [2025-11-03T19:31:27.248353] [INFO ] [MAIN ] IAE: Full history saved. [2025-11-03T19:31:27.248429] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. IAE took 23.9s. Estimated remaining: 3h 1m 49s. Rate: 7.1 symbols/min [2025-11-03T19:31:27.421164] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:27.467757] [DEBUG] [LOCAL ] IAG: Loaded 54272 existing records from primary storage. [2025-11-03T19:31:27.468066] [INFO ] [MAIN ] IAG: Loaded 54272 existing records. [2025-11-03T19:31:27.642390] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:27.642579] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-11-03T19:31:27.642628] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-11-03T19:31:27.643593] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-11-03T19:31:27.643679] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-11-03T19:31:27.939979] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-11-03T19:31:27.990890] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:28.074751] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T19:31:28.075985] [INFO ] [REMOTE ] HYT: Full fetch complete (47484 records). [2025-11-03T19:31:28.076079] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-11-03T19:31:28.448057] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-11-03T19:31:28.448134] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-11-03T19:31:28.448818] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-11-03T19:31:28.448879] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-11-03T19:31:28.449867] [DEBUG] [LOCAL ] HYT: Trimmed 47484 records to 32603 (keeping 200 days of data) [2025-11-03T19:31:28.634325] [DEBUG] [LOCAL ] HYT: Primary data saved (32603 records). [2025-11-03T19:31:28.634453] [INFO ] [MAIN ] HYT: Full history saved. [2025-11-03T19:31:28.634527] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HYT took 39.7s. Estimated remaining: 3h 1m 32s. Rate: 7.1 symbols/min [2025-11-03T19:31:28.739912] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-11-03T19:31:28.805272] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:28.853291] [DEBUG] [LOCAL ] IBM: Loaded 54408 existing records from primary storage. [2025-11-03T19:31:28.853619] [INFO ] [MAIN ] IBM: Loaded 54408 existing records. [2025-11-03T19:31:29.029528] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:29.029865] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-11-03T19:31:29.030026] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-11-03T19:31:29.036139] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-11-03T19:31:29.044752] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-11-03T19:31:29.076773] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T19:31:29.157042] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T19:31:29.406357] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:29.534833] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-11-03T19:31:30.334853] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-11. [2025-11-03T19:31:30.729530] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-11 (0.39 seconds). [2025-11-03T19:31:30.730225] [INFO ] [REMOTE ] HYTR: Full fetch complete (4732 records). [2025-11-03T19:31:30.730291] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-11-03T19:31:31.134495] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-11-03T19:31:31.134719] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-11-03T19:31:31.134872] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-11-03T19:31:31.135122] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-11-03T19:31:31.136379] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-11-03T19:31:31.137199] [DEBUG] [LOCAL ] HYTR: Trimmed 4732 records to 3079 (keeping 200 days of data) [2025-11-03T19:31:31.157606] [DEBUG] [LOCAL ] HYTR: Primary data saved (3079 records). [2025-11-03T19:31:31.158035] [INFO ] [MAIN ] HYTR: Full history saved. [2025-11-03T19:31:31.158153] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. HYTR took 35.5s. Estimated remaining: 3h 1m 16s. Rate: 7.1 symbols/min [2025-11-03T19:31:31.193034] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T19:31:31.934876] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-11-03T19:31:31.965346] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-11-03T19:31:32.734909] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-11-03T19:31:33.392586] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T19:31:33.534823] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-11-03T19:31:34.339964] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-11-03T19:31:34.357979] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-11-03T19:31:34.480530] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-11-03T19:31:35.134915] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-11-03T19:31:35.788159] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-11-03T19:31:35.934853] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-11-03T19:31:36.734892] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-11. [2025-11-03T19:31:36.914251] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-11-03T19:31:37.069627] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T19:31:37.407960] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-11 (0.67 seconds). [2025-11-03T19:31:37.409364] [INFO ] [REMOTE ] HZO: Full fetch complete (41551 records). [2025-11-03T19:31:37.409470] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-11-03T19:31:37.540004] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-11-03T19:31:37.806373] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-11-03T19:31:37.806448] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-11-03T19:31:37.807136] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-11-03T19:31:37.807198] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-11-03T19:31:37.808085] [DEBUG] [LOCAL ] HZO: Trimmed 41551 records to 27635 (keeping 200 days of data) [2025-11-03T19:31:37.962578] [DEBUG] [LOCAL ] HZO: Primary data saved (27635 records). [2025-11-03T19:31:37.962730] [INFO ] [MAIN ] HZO: Full history saved. [2025-11-03T19:31:37.962812] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HZO took 40.8s. Estimated remaining: 3h 1m 6s. Rate: 7.1 symbols/min [2025-11-03T19:31:38.334902] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-11-03T19:31:39.024552] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T19:31:39.134844] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-11-03T19:31:40.131892] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-11-03T19:31:40.143184] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-11-03T19:31:40.733777] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-11-03T19:31:40.744784] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-11-03T19:31:42.036986] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T19:31:42.048397] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-11-03T19:31:42.081951] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-11-03T19:31:42.334913] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-11-03T19:31:43.491158] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-11-03T19:31:43.502805] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-11-03T19:31:43.942424] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-11-03T19:31:43.953197] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-11-03T19:31:44.875856] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T19:31:44.888044] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-11-03T19:31:46.021337] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-11-03T19:31:46.032979] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-11-03T19:31:46.374751] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T19:31:46.386108] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-11-03T19:31:48.103348] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-11-03T19:31:48.114987] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-11-03T19:31:48.151512] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-11-03T19:31:48.163905] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-11. [2025-11-03T19:31:49.428329] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-11 (1.26 seconds). [2025-11-03T19:31:49.430027] [INFO ] [REMOTE ] IAG: Full fetch complete (77550 records). [2025-11-03T19:31:49.430188] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-11-03T19:31:49.841101] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-11-03T19:31:49.841191] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-11-03T19:31:49.842157] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-11-03T19:31:49.842223] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-11-03T19:31:49.843669] [DEBUG] [LOCAL ] IAG: Trimmed 77550 records to 53491 (keeping 200 days of data) [2025-11-03T19:31:50.150539] [DEBUG] [LOCAL ] IAG: Primary data saved (53491 records). [2025-11-03T19:31:50.150769] [INFO ] [MAIN ] IAG: Full history saved. [2025-11-03T19:31:50.150866] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAG took 22.9s. Estimated remaining: 3h 1m 2s. Rate: 7.1 symbols/min [2025-11-03T19:31:50.299289] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-11-03T19:31:50.310596] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-11-03T19:31:52.356332] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-11-03T19:31:52.369253] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-11. [2025-11-03T19:31:54.300639] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-11 (1.93 seconds). [2025-11-03T19:31:54.302799] [INFO ] [REMOTE ] IBM: Full fetch complete (77750 records). [2025-11-03T19:31:54.302947] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-11-03T19:31:54.757736] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-11-03T19:31:54.757862] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-11-03T19:31:54.759130] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-11-03T19:31:54.759226] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-11-03T19:31:54.761091] [DEBUG] [LOCAL ] IBM: Trimmed 77750 records to 53631 (keeping 200 days of data) [2025-11-03T19:31:55.100595] [DEBUG] [LOCAL ] IBM: Primary data saved (53631 records). [2025-11-03T19:31:55.100757] [INFO ] [MAIN ] IBM: Full history saved. [2025-11-03T19:31:55.100844] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. IBM took 26.5s. Estimated remaining: 3h 0m 49s. Rate: 7.1 symbols/min [2025-11-03T19:31:55.728088] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:55.765301] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:55.766237] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:55.841296] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:31:55.875397] [DEBUG] [LOCAL ] IBTA: Loaded 35767 existing records from primary storage. [2025-11-03T19:31:55.875889] [INFO ] [MAIN ] IBTA: Loaded 35767 existing records. [2025-11-03T19:31:55.989871] [DEBUG] [LOCAL ] IBP: Loaded 28404 existing records from primary storage. [2025-11-03T19:31:56.032472] [INFO ] [MAIN ] IBP: Loaded 28404 existing records. [2025-11-03T19:31:56.192258] [DEBUG] [LOCAL ] ICE: Loaded 53787 existing records from primary storage. [2025-11-03T19:31:56.176477] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:56.235545] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-11-03T19:31:56.202949] [INFO ] [MAIN ] ICE: Loaded 53787 existing records. [2025-11-03T19:31:56.235760] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-11-03T19:31:56.236596] [DEBUG] [LOCAL ] IBN: Loaded 53556 existing records from primary storage. [2025-11-03T19:31:56.292956] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-11-03T19:31:56.312566] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-11-03T19:31:56.293143] [INFO ] [MAIN ] IBN: Loaded 53556 existing records. [2025-11-03T19:31:56.546870] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:56.567814] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-11-03T19:31:56.636461] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-11-03T19:31:56.706748] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-11-03T19:31:56.770331] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-11-03T19:31:56.729962] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:56.825611] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-11-03T19:31:56.910463] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-11-03T19:31:57.022070] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:31:57.032297] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-11-03T19:31:57.060695] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-11-03T19:31:57.065954] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-11-03T19:31:57.076385] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-11-03T19:31:57.162952] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-11-03T19:31:57.172988] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-11-03T19:31:57.594301] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:57.656989] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-11-03T19:31:58.131969] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:58.177400] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-11-03T19:31:58.214289] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:58.236411] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-11-03T19:31:58.291503] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:31:58.291872] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-11-03T19:31:58.611433] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T19:31:58.617041] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-11-03T19:31:58.932034] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-11-03T19:31:58.937126] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-11-03T19:31:59.299590] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T19:31:59.305223] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-11-03T19:31:59.604497] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T19:31:59.621364] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-11-03T19:31:59.767422] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-11-03T19:31:59.801982] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-11-03T19:31:59.807986] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:31:59.818923] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-11-03T19:32:01.184919] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-11-03T19:32:01.196216] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-11-03T19:32:01.236147] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T19:32:01.248965] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-11-03T19:32:01.281537] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T19:32:01.289729] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-11-03T19:32:01.323615] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-11-03T19:32:01.334727] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-11-03T19:32:02.200531] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-11-03T19:32:02.207225] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-11-03T19:32:02.445955] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T19:32:02.458121] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-11-03T19:32:02.557451] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-11-03T19:32:02.864076] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-11-03T19:32:03.135261] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-11-03T19:32:03.136061] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T19:32:03.873932] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T19:32:03.934810] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-11-03T19:32:04.132423] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-11-03T19:32:04.704120] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-11-03T19:32:04.734834] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-11-03T19:32:05.534868] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-11-03T19:32:05.766278] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:32:06.334836] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-11-03T19:32:06.464598] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T19:32:07.134875] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-11-03T19:32:07.877185] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-11-03T19:32:07.934815] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-11-03T19:32:08.024387] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-11-03T19:32:08.734869] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-11-03T19:32:09.264439] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:32:09.534865] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-11-03T19:32:09.727354] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T19:32:10.334928] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-11-03T19:32:10.519843] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T19:32:11.134870] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-11-03T19:32:11.730025] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T19:32:11.934827] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-11-03T19:32:12.064367] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T19:32:12.734848] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-11-03T19:32:13.343740] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-11-03T19:32:13.534895] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-11-03T19:32:14.166053] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T19:32:14.334831] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-11-03T19:32:14.445146] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T19:32:15.134856] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-11-03T19:32:15.555840] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T19:32:15.934852] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-11-03T19:32:16.637555] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T19:32:16.734848] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-11. [2025-11-03T19:32:17.445675] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T19:32:17.534870] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-11-03T19:32:17.716528] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T19:32:17.717929] [INFO ] [REMOTE ] IBP: Full fetch complete (41213 records). [2025-11-03T19:32:17.718008] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-11-03T19:32:18.092045] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-11-03T19:32:18.092121] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-11-03T19:32:18.092786] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-11-03T19:32:18.092848] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-11-03T19:32:18.093682] [DEBUG] [LOCAL ] IBP: Trimmed 41213 records to 28107 (keeping 200 days of data) [2025-11-03T19:32:18.267133] [DEBUG] [LOCAL ] IBP: Primary data saved (28107 records). [2025-11-03T19:32:18.267274] [INFO ] [MAIN ] IBP: Full history saved. [2025-11-03T19:32:18.267353] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. IBP took 23.1s. Estimated remaining: 3h 0m 58s. Rate: 7.1 symbols/min [2025-11-03T19:32:18.339923] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-11-03T19:32:18.439713] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:32:18.471490] [DEBUG] [LOCAL ] ICL: Loaded 37947 existing records from primary storage. [2025-11-03T19:32:18.471809] [INFO ] [MAIN ] ICL: Loaded 37947 existing records. [2025-11-03T19:32:18.650717] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:32:18.650870] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-11-03T19:32:18.650918] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-11-03T19:32:18.651497] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-11-03T19:32:18.651554] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-11-03T19:32:19.025017] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:32:19.056633] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-11-03T19:32:19.134818] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-11-03T19:32:19.567677] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T19:32:19.934890] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-11-03T19:32:20.242311] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T19:32:20.734867] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-11-03T19:32:20.987746] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-11-03T19:32:21.534926] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-11-03T19:32:22.094232] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T19:32:22.334864] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-11-03T19:32:23.134858] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-11-03T19:32:23.289321] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T19:32:23.432875] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-11-03T19:32:23.934878] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-11-03T19:32:24.075164] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-11-03T19:32:24.734845] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-11-03T19:32:25.534911] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-11. [2025-11-03T19:32:25.604673] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T19:32:25.991207] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T19:32:26.334901] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-11-03T19:32:26.797940] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-11 (1.26 seconds). [2025-11-03T19:32:26.799409] [INFO ] [REMOTE ] ICE: Full fetch complete (77031 records). [2025-11-03T19:32:26.799501] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-11-03T19:32:27.143703] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-11. [2025-11-03T19:32:27.191433] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-11-03T19:32:27.191511] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-11-03T19:32:27.192492] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-11-03T19:32:27.192556] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-11-03T19:32:27.193908] [DEBUG] [LOCAL ] ICE: Trimmed 77031 records to 53012 (keeping 200 days of data) [2025-11-03T19:32:27.526935] [DEBUG] [LOCAL ] ICE: Primary data saved (53012 records). [2025-11-03T19:32:27.527349] [INFO ] [MAIN ] ICE: Full history saved. [2025-11-03T19:32:27.527485] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. ICE took 32.4s. Estimated remaining: 3h 0m 51s. Rate: 7.1 symbols/min [2025-11-03T19:32:27.676453] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T19:32:27.747094] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:32:27.778914] [DEBUG] [LOCAL ] IDA: Loaded 32990 existing records from primary storage. [2025-11-03T19:32:27.779216] [INFO ] [MAIN ] IDA: Loaded 32990 existing records. [2025-11-03T19:32:27.955803] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-11-03T19:32:27.961461] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:32:27.961773] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-11-03T19:32:27.961824] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-11-03T19:32:27.962595] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-11-03T19:32:27.962681] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-11-03T19:32:28.317937] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-11 (1.17 seconds). [2025-11-03T19:32:28.325049] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:32:28.325177] [INFO ] [REMOTE ] IBN: Full fetch complete (76664 records). [2025-11-03T19:32:28.325383] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-11-03T19:32:28.712811] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-11-03T19:32:28.712888] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-11-03T19:32:28.713833] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-11-03T19:32:28.713905] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-11-03T19:32:28.715255] [DEBUG] [LOCAL ] IBN: Trimmed 76664 records to 52765 (keeping 200 days of data) [2025-11-03T19:32:28.768069] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-11-03T19:32:29.028535] [DEBUG] [LOCAL ] IBN: Primary data saved (52765 records). [2025-11-03T19:32:29.028679] [INFO ] [MAIN ] IBN: Full history saved. [2025-11-03T19:32:29.028769] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IBN took 33.9s. Estimated remaining: 3h 0m 34s. Rate: 7.1 symbols/min [2025-11-03T19:32:29.211316] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:32:29.228279] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:32:29.244497] [DEBUG] [LOCAL ] IDE: Loaded 9258 existing records from primary storage. [2025-11-03T19:32:29.244750] [INFO ] [MAIN ] IDE: Loaded 9258 existing records. [2025-11-03T19:32:29.421472] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:32:29.421726] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-11-03T19:32:29.421780] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-11-03T19:32:29.422052] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-11-03T19:32:29.422108] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-11-03T19:32:29.540099] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-11-03T19:32:29.789067] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:32:29.808889] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T19:32:30.334890] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-11-03T19:32:30.786178] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T19:32:31.130035] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-11-03T19:32:31.135219] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-11-03T19:32:31.934905] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-11. [2025-11-03T19:32:32.226076] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T19:32:32.734855] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-11-03T19:32:32.851425] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-11 (0.92 seconds). [2025-11-03T19:32:32.852841] [INFO ] [REMOTE ] IBTA: Full fetch complete (51272 records). [2025-11-03T19:32:32.852923] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-11-03T19:32:33.277795] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-11-03T19:32:33.277875] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-11-03T19:32:33.278605] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-11-03T19:32:33.278666] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-11-03T19:32:33.279714] [DEBUG] [LOCAL ] IBTA: Trimmed 51272 records to 35017 (keeping 200 days of data) [2025-11-03T19:32:33.482216] [DEBUG] [LOCAL ] IBTA: Primary data saved (35017 records). [2025-11-03T19:32:33.482402] [INFO ] [MAIN ] IBTA: Full history saved. [2025-11-03T19:32:33.482520] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBTA took 38.4s. Estimated remaining: 3h 0m 21s. Rate: 7.1 symbols/min [2025-11-03T19:32:33.549608] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-11-03T19:32:33.659966] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:32:33.690291] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T19:32:33.715180] [DEBUG] [LOCAL ] IDT: Loaded 18726 existing records from primary storage. [2025-11-03T19:32:33.715500] [INFO ] [MAIN ] IDT: Loaded 18726 existing records. [2025-11-03T19:32:33.925475] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:32:33.925756] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-11-03T19:32:33.925811] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-11-03T19:32:33.926270] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-11-03T19:32:33.926329] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-11-03T19:32:34.295595] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:32:34.334824] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-11-03T19:32:34.420943] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-11-03T19:32:34.914035] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-11-03T19:32:35.134866] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-11-03T19:32:35.715505] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-11-03T19:32:35.934915] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-11-03T19:32:36.576008] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T19:32:36.734882] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-11-03T19:32:37.441822] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T19:32:37.534857] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-11-03T19:32:38.289422] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T19:32:38.334816] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-11-03T19:32:39.024336] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-11-03T19:32:39.134901] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-11-03T19:32:39.656386] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T19:32:39.934871] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-11-03T19:32:40.582433] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T19:32:40.734865] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-11-03T19:32:41.534846] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-11-03T19:32:41.558148] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T19:32:42.334897] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-11-03T19:32:42.563010] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-11-03T19:32:43.073114] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T19:32:43.134816] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-11-03T19:32:43.894292] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T19:32:43.934860] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-11-03T19:32:44.366134] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T19:32:44.734848] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-11-03T19:32:45.534866] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-11-03T19:32:45.870392] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-11-03T19:32:46.334905] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-11-03T19:32:46.659701] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T19:32:46.870392] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T19:32:47.134903] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-11-03T19:32:47.934879] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-11-03T19:32:48.282408] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T19:32:48.734841] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-11. [2025-11-03T19:32:48.886497] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-11-03T19:32:49.534877] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-11-03T19:32:49.651891] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-11 (0.92 seconds). [2025-11-03T19:32:49.653184] [INFO ] [REMOTE ] ICL: Full fetch complete (55525 records). [2025-11-03T19:32:49.653263] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-11-03T19:32:50.039504] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-11-03T19:32:50.039604] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-11-03T19:32:50.040474] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-11-03T19:32:50.040538] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-11-03T19:32:50.041822] [DEBUG] [LOCAL ] ICL: Trimmed 55525 records to 37401 (keeping 200 days of data) [2025-11-03T19:32:50.246271] [DEBUG] [LOCAL ] ICL: Primary data saved (37401 records). [2025-11-03T19:32:50.246420] [INFO ] [MAIN ] ICL: Full history saved. [2025-11-03T19:32:50.246511] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. ICL took 32.0s. Estimated remaining: 3h 0m 22s. Rate: 7.1 symbols/min [2025-11-03T19:32:50.344735] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-11-03T19:32:50.421979] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:32:50.459788] [DEBUG] [LOCAL ] IEX: Loaded 38584 existing records from primary storage. [2025-11-03T19:32:50.460097] [INFO ] [MAIN ] IEX: Loaded 38584 existing records. [2025-11-03T19:32:50.648868] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:32:50.649145] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-11-03T19:32:50.649355] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-11-03T19:32:50.650145] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-11-03T19:32:50.650209] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-11-03T19:32:50.934465] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T19:32:51.027465] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-11-03T19:32:51.071527] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:32:51.134848] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-11-03T19:32:51.934863] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-11-03T19:32:52.233700] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T19:32:52.734884] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-11-03T19:32:52.814608] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T19:32:53.534881] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-11-03T19:32:53.691441] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T19:32:54.334858] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-11-03T19:32:54.820304] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T19:32:54.961247] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:32:55.134860] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-11-03T19:32:55.615049] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T19:32:55.934887] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-11-03T19:32:56.477467] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-11-03T19:32:56.734887] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-11-03T19:32:57.534950] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-11. [2025-11-03T19:32:57.995776] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T19:32:58.334861] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-11-03T19:32:58.404053] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:32:58.404934] [INFO ] [REMOTE ] IDT: Full fetch complete (24377 records). [2025-11-03T19:32:58.405006] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-11-03T19:32:58.778730] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-11-03T19:32:58.778831] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-11-03T19:32:58.779325] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-11-03T19:32:58.779368] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-11-03T19:32:58.780100] [DEBUG] [LOCAL ] IDT: Trimmed 24377 records to 18591 (keeping 200 days of data) [2025-11-03T19:32:58.891001] [DEBUG] [LOCAL ] IDT: Primary data saved (18591 records). [2025-11-03T19:32:58.891136] [INFO ] [MAIN ] IDT: Full history saved. [2025-11-03T19:32:58.891213] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. IDT took 25.4s. Estimated remaining: 3h 0m 14s. Rate: 7.1 symbols/min [2025-11-03T19:32:59.061142] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:32:59.105488] [DEBUG] [LOCAL ] IFF: Loaded 51958 existing records from primary storage. [2025-11-03T19:32:59.105800] [INFO ] [MAIN ] IFF: Loaded 51958 existing records. [2025-11-03T19:32:59.140034] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-11-03T19:32:59.292323] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:32:59.292673] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-11-03T19:32:59.292762] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-11-03T19:32:59.293573] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-11-03T19:32:59.293632] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-11-03T19:32:59.570455] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:32:59.679335] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:32:59.702768] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T19:32:59.934849] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-11-03T19:33:00.734934] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-10. [2025-11-03T19:33:01.540896] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-11-03T19:33:01.557452] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T19:33:02.109160] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-11-03T19:33:02.334884] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-11. [2025-11-03T19:33:02.558372] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T19:33:03.134857] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-11-03T19:33:03.212168] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T19:33:03.213356] [INFO ] [REMOTE ] IDA: Full fetch complete (45394 records). [2025-11-03T19:33:03.213442] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-11-03T19:33:03.589481] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-11-03T19:33:03.589579] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-11-03T19:33:03.590377] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-11-03T19:33:03.590442] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-11-03T19:33:03.591415] [DEBUG] [LOCAL ] IDA: Trimmed 45394 records to 32540 (keeping 200 days of data) [2025-11-03T19:33:03.785974] [DEBUG] [LOCAL ] IDA: Primary data saved (32540 records). [2025-11-03T19:33:03.786100] [INFO ] [MAIN ] IDA: Full history saved. [2025-11-03T19:33:03.786177] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. IDA took 36.3s. Estimated remaining: 3h 0m 2s. Rate: 7.1 symbols/min [2025-11-03T19:33:03.937855] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-11. [2025-11-03T19:33:03.956727] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:03.974006] [DEBUG] [LOCAL ] IFN: Loaded 18322 existing records from primary storage. [2025-11-03T19:33:03.974250] [INFO ] [MAIN ] IFN: Loaded 18322 existing records. [2025-11-03T19:33:04.156202] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:04.156394] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-11-03T19:33:04.156440] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-11-03T19:33:04.156853] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-11-03T19:33:04.156911] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-11-03T19:33:04.468914] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-11 (0.53 seconds). [2025-11-03T19:33:04.519861] [INFO ] [REMOTE ] IDE: Full fetch complete (12559 records). [2025-11-03T19:33:04.544241] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:04.544919] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-11-03T19:33:04.739389] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-11-03T19:33:04.897155] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-11-03T19:33:04.958710] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-11-03T19:33:04.958784] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-11-03T19:33:04.959055] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-11-03T19:33:04.959092] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-11-03T19:33:04.959546] [DEBUG] [LOCAL ] IDE: Trimmed 12559 records to 9165 (keeping 200 days of data) [2025-11-03T19:33:05.013849] [DEBUG] [LOCAL ] IDE: Primary data saved (9165 records). [2025-11-03T19:33:05.013965] [INFO ] [MAIN ] IDE: Full history saved. [2025-11-03T19:33:05.014044] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. IDE took 36.0s. Estimated remaining: 2h 59m 45s. Rate: 7.1 symbols/min [2025-11-03T19:33:05.185343] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:05.205001] [DEBUG] [LOCAL ] IFS: Loaded 21948 existing records from primary storage. [2025-11-03T19:33:05.205261] [INFO ] [MAIN ] IFS: Loaded 21948 existing records. [2025-11-03T19:33:05.382297] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:05.382482] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-11-03T19:33:05.382526] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-11-03T19:33:05.382921] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-11-03T19:33:05.382977] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-11-03T19:33:05.544247] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-11-03T19:33:05.749140] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:06.173187] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T19:33:06.334826] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-11-03T19:33:06.501969] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:33:07.134849] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-11-03T19:33:07.523962] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:33:07.933930] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T19:33:07.937961] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-11-03T19:33:08.734848] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-11-03T19:33:08.951547] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-11-03T19:33:09.534858] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-11-03T19:33:10.134721] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-11-03T19:33:10.334835] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-11-03T19:33:10.400011] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:33:11.134861] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-11-03T19:33:11.718183] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T19:33:11.784374] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-11-03T19:33:11.934866] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-11-03T19:33:12.734825] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-11-03T19:33:12.865448] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-11-03T19:33:13.495928] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T19:33:13.534904] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-11-03T19:33:14.325672] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-11-03T19:33:14.334803] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-11-03T19:33:15.129831] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-11-03T19:33:15.134803] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-11-03T19:33:15.892694] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T19:33:15.934811] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-11-03T19:33:16.666886] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T19:33:16.734813] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-11-03T19:33:17.488167] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-11-03T19:33:17.534889] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-11-03T19:33:18.318156] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-11-03T19:33:18.334829] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-11-03T19:33:19.034925] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T19:33:19.134869] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-11. [2025-11-03T19:33:19.723569] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-11 (0.59 seconds). [2025-11-03T19:33:19.724443] [INFO ] [REMOTE ] IFN: Full fetch complete (27286 records). [2025-11-03T19:33:19.724515] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-11-03T19:33:19.939995] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-11-03T19:33:20.093428] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-11-03T19:33:20.093501] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-11-03T19:33:20.094062] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-11-03T19:33:20.094123] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-11-03T19:33:20.094743] [DEBUG] [LOCAL ] IFN: Trimmed 27286 records to 18072 (keeping 200 days of data) [2025-11-03T19:33:20.205221] [DEBUG] [LOCAL ] IFN: Primary data saved (18072 records). [2025-11-03T19:33:20.205402] [INFO ] [MAIN ] IFN: Full history saved. [2025-11-03T19:33:20.205491] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IFN took 16.4s. Estimated remaining: 2h 59m 44s. Rate: 7.1 symbols/min [2025-11-03T19:33:20.374826] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:20.384126] [DEBUG] [LOCAL ] IGA: Loaded 9880 existing records from primary storage. [2025-11-03T19:33:20.384291] [INFO ] [MAIN ] IGA: Loaded 9880 existing records. [2025-11-03T19:33:20.556692] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:20.556880] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-11-03T19:33:20.556927] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-11-03T19:33:20.557209] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-11-03T19:33:20.557267] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-11-03T19:33:20.740237] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-11-03T19:33:20.968741] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:21.404620] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T19:33:21.534861] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-11-03T19:33:21.821492] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T19:33:22.334864] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-11-03T19:33:22.789635] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-11-03T19:33:22.947208] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-11-03T19:33:23.134931] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-11-03T19:33:23.626278] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T19:33:23.934939] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-11-03T19:33:24.734858] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-11-03T19:33:24.979068] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T19:33:25.230277] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-11-03T19:33:25.534961] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-11-03T19:33:26.334858] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-11-03T19:33:26.614109] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-11-03T19:33:27.134829] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-11-03T19:33:27.155423] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T19:33:27.934906] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-11-03T19:33:28.248225] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T19:33:28.734891] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-11-03T19:33:29.401830] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-11-03T19:33:29.492305] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-11-03T19:33:29.534862] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-11-03T19:33:30.334859] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-11-03T19:33:30.848226] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-11-03T19:33:31.125997] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T19:33:31.134807] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-11-03T19:33:31.935269] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-11-03T19:33:31.936384] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-11-03T19:33:32.734868] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-11-03T19:33:33.274191] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T19:33:33.377154] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-11-03T19:33:33.534922] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-11-03T19:33:34.334857] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-11-03T19:33:34.838868] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-11-03T19:33:35.134852] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-11-03T19:33:35.934957] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-11-03T19:33:35.995734] [DEBUG] [REMOTE ] IGA: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-11-03T19:33:35.996047] [WARN ] [REMOTE ] IGA: No data returned for month 2025-05 [2025-11-03T19:33:35.996136] [FATAL] [REMOTE ] IGA: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:33:35.996211] [FATAL] [MAIN ] IGA: Failed to fetch primary data. [2025-11-03T19:33:35.996272] [WARN ] [MAIN ] IGA: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:33:35.996341] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-11-03T19:33:35.996402] [DEBUG] [LOCAL ] IGA: No primary data file found to delete. [2025-11-03T19:33:35.996437] [INFO ] [LOCAL ] IGA: Starting deletion of derivative data. [2025-11-03T19:33:35.996609] [DEBUG] [LOCAL ] IGA: Deleted derivative data file. [2025-11-03T19:33:35.996726] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IGA took 15.8s. Estimated remaining: 2h 59m 44s. Rate: 7.1 symbols/min [2025-11-03T19:33:36.176947] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:36.195364] [DEBUG] [LOCAL ] IGD: Loaded 19582 existing records from primary storage. [2025-11-03T19:33:36.195689] [INFO ] [MAIN ] IGD: Loaded 19582 existing records. [2025-11-03T19:33:36.408861] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:36.409374] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-11-03T19:33:36.409504] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-11-03T19:33:36.410344] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-11-03T19:33:36.410427] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-11-03T19:33:36.563174] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-11-03T19:33:36.735069] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-11-03T19:33:36.742607] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-11-03T19:33:36.871532] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:37.534928] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-11. [2025-11-03T19:33:37.620256] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T19:33:38.334934] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-11. [2025-11-03T19:33:38.568696] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T19:33:38.570347] [INFO ] [REMOTE ] IEX: Full fetch complete (54129 records). [2025-11-03T19:33:38.570446] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-11-03T19:33:38.968896] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-11-03T19:33:38.969035] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-11-03T19:33:38.970378] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-11-03T19:33:38.970446] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-11-03T19:33:38.972080] [DEBUG] [LOCAL ] IEX: Trimmed 54129 records to 38044 (keeping 200 days of data) [2025-11-03T19:33:39.076108] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-11 (0.74 seconds). [2025-11-03T19:33:39.082759] [INFO ] [REMOTE ] IFS: Full fetch complete (32414 records). [2025-11-03T19:33:39.085695] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-11-03T19:33:39.137801] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-11-03T19:33:39.539321] [DEBUG] [LOCAL ] IEX: Primary data saved (38044 records). [2025-11-03T19:33:39.544673] [INFO ] [MAIN ] IEX: Full history saved. [2025-11-03T19:33:39.598635] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IEX took 49.4s. Estimated remaining: 2h 59m 30s. Rate: 7.1 symbols/min [2025-11-03T19:33:39.614030] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-11-03T19:33:39.614343] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-11-03T19:33:39.635362] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-11-03T19:33:39.644229] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-11-03T19:33:39.728896] [DEBUG] [LOCAL ] IFS: Trimmed 32414 records to 21527 (keeping 200 days of data) [2025-11-03T19:33:39.951714] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-11. [2025-11-03T19:33:40.005005] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:40.052688] [DEBUG] [LOCAL ] IGI: Loaded 4131 existing records from primary storage. [2025-11-03T19:33:40.071265] [DEBUG] [LOCAL ] IFS: Primary data saved (21527 records). [2025-11-03T19:33:40.071451] [INFO ] [MAIN ] IFS: Full history saved. [2025-11-03T19:33:40.068048] [INFO ] [MAIN ] IGI: Loaded 4131 existing records. [2025-11-03T19:33:40.071604] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IFS took 35.1s. Estimated remaining: 2h 59m 12s. Rate: 7.1 symbols/min [2025-11-03T19:33:40.444951] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:33:40.605034] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:40.629795] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:40.630128] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-11-03T19:33:40.630217] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-11-03T19:33:40.630469] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-11-03T19:33:40.630537] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-11-03T19:33:40.740877] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-11-03T19:33:40.855090] [DEBUG] [LOCAL ] IGR: Loaded 30347 existing records from primary storage. [2025-11-03T19:33:40.927442] [INFO ] [MAIN ] IGR: Loaded 30347 existing records. [2025-11-03T19:33:41.197259] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:41.229639] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:41.229796] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-11-03T19:33:41.229841] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-11-03T19:33:41.230344] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-11-03T19:33:41.230399] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-11-03T19:33:41.536368] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-11-03T19:33:41.602527] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-11-03T19:33:41.606706] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:42.003063] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-11-03T19:33:42.017189] [DEBUG] [REMOTE ] IFF: Error fetching primary data for 2025-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:33:42.017453] [WARN ] [REMOTE ] IFF: No data returned for month 2025-11 [2025-11-03T19:33:42.017544] [FATAL] [REMOTE ] IFF: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:33:42.017621] [FATAL] [MAIN ] IFF: Failed to fetch primary data. [2025-11-03T19:33:42.017725] [WARN ] [MAIN ] IFF: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:33:42.017807] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-11-03T19:33:42.017886] [DEBUG] [LOCAL ] IFF: No primary data file found to delete. [2025-11-03T19:33:42.017935] [INFO ] [LOCAL ] IFF: Starting deletion of derivative data. [2025-11-03T19:33:42.018130] [DEBUG] [LOCAL ] IFF: Deleted derivative data file. [2025-11-03T19:33:42.018227] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IFF took 43.1s. Estimated remaining: 2h 58m 56s. Rate: 7.1 symbols/min [2025-11-03T19:33:42.185624] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:33:42.189469] [DEBUG] [LOCAL ] IH: Loaded 2682 existing records from primary storage. [2025-11-03T19:33:42.189614] [INFO ] [MAIN ] IH: Loaded 2682 existing records. [2025-11-03T19:33:42.338506] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-11-03T19:33:42.367111] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:33:42.367465] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-11-03T19:33:42.367519] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-11-03T19:33:42.367735] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-11-03T19:33:42.367793] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-11-03T19:33:42.714056] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:33:43.134835] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-11-03T19:33:43.235176] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-11-03T19:33:43.435113] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-11-03T19:33:43.934866] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-11-03T19:33:44.734869] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-11-03T19:33:45.044795] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T19:33:45.235591] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T19:33:45.534899] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-11-03T19:33:46.036357] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T19:33:46.334837] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-11-03T19:33:47.134844] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-11-03T19:33:47.323925] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T19:33:47.934986] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-11-03T19:33:48.023187] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-11-03T19:33:48.487622] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-11-03T19:33:48.734924] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-11-03T19:33:49.059744] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-11-03T19:33:49.534882] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-11-03T19:33:49.961994] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-11-03T19:33:50.334868] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-11-03T19:33:51.134858] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-11-03T19:33:51.266881] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T19:33:51.903915] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T19:33:51.934854] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-11-03T19:33:52.674100] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T19:33:52.734893] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-11-03T19:33:53.534921] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-11-03T19:33:53.706754] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T19:33:53.796553] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-11-03T19:33:54.334887] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-11-03T19:33:55.134911] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-11-03T19:33:55.362801] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T19:33:55.405009] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-11-03T19:33:55.934882] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-11-03T19:33:56.669217] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T19:33:56.734887] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-11-03T19:33:57.211938] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T19:33:57.534881] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-11-03T19:33:57.868513] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-11-03T19:33:58.334906] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-11-03T19:33:59.134848] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-11-03T19:33:59.204912] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-11-03T19:33:59.520189] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T19:33:59.934928] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-11-03T19:34:00.648613] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-11-03T19:34:00.734882] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-11-03T19:34:01.534896] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-11-03T19:34:02.066843] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T19:34:02.334878] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-11-03T19:34:02.343284] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-11-03T19:34:02.742762] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-11-03T19:34:03.134865] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-11-03T19:34:03.573087] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T19:34:03.934876] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-11-03T19:34:04.734862] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-11-03T19:34:05.167997] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-11-03T19:34:05.185165] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T19:34:05.534856] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-11-03T19:34:06.306117] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T19:34:06.334841] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-11-03T19:34:07.059162] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T19:34:07.134847] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-11-03T19:34:07.934862] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-11-03T19:34:08.053193] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T19:34:08.734851] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-11. [2025-11-03T19:34:08.993814] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T19:34:09.453910] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-11 (0.72 seconds). [2025-11-03T19:34:09.454887] [INFO ] [REMOTE ] IGD: Full fetch complete (29581 records). [2025-11-03T19:34:09.454957] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-11-03T19:34:09.539987] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-11-03T19:34:09.827178] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-11-03T19:34:09.827264] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-11-03T19:34:09.827944] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-11-03T19:34:09.828005] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-11-03T19:34:09.828790] [DEBUG] [LOCAL ] IGD: Trimmed 29581 records to 19263 (keeping 200 days of data) [2025-11-03T19:34:09.934220] [DEBUG] [LOCAL ] IGD: Primary data saved (19263 records). [2025-11-03T19:34:09.934352] [INFO ] [MAIN ] IGD: Full history saved. [2025-11-03T19:34:09.934427] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IGD took 33.9s. Estimated remaining: 2h 59m 11s. Rate: 7.1 symbols/min [2025-11-03T19:34:10.102606] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:10.110117] [DEBUG] [LOCAL ] IHD: Loaded 7428 existing records from primary storage. [2025-11-03T19:34:10.110279] [INFO ] [MAIN ] IHD: Loaded 7428 existing records. [2025-11-03T19:34:10.283893] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:10.284108] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-11-03T19:34:10.284153] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-11-03T19:34:10.284403] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-11-03T19:34:10.284469] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-11-03T19:34:10.346236] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-11. [2025-11-03T19:34:10.642172] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:10.658949] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-11-03T19:34:10.914227] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-11 (0.57 seconds). [2025-11-03T19:34:10.914903] [INFO ] [REMOTE ] IH: Full fetch complete (5077 records). [2025-11-03T19:34:10.914969] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-11-03T19:34:11.143212] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-11-03T19:34:11.321605] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-11-03T19:34:11.321720] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-11-03T19:34:11.321892] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-11-03T19:34:11.321933] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-11-03T19:34:11.322313] [DEBUG] [LOCAL ] IH: Trimmed 5077 records to 2659 (keeping 200 days of data) [2025-11-03T19:34:11.337062] [DEBUG] [LOCAL ] IH: Primary data saved (2659 records). [2025-11-03T19:34:11.337177] [INFO ] [MAIN ] IH: Full history saved. [2025-11-03T19:34:11.337301] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IH took 29.3s. Estimated remaining: 2h 58m 54s. Rate: 7.1 symbols/min [2025-11-03T19:34:11.508189] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:11.530028] [DEBUG] [LOCAL ] IHG: Loaded 23759 existing records from primary storage. [2025-11-03T19:34:11.530276] [INFO ] [MAIN ] IHG: Loaded 23759 existing records. [2025-11-03T19:34:11.707462] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:11.707699] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-11-03T19:34:11.707758] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-11-03T19:34:11.708270] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-11-03T19:34:11.708329] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-11-03T19:34:11.941056] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-11-03T19:34:12.069155] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:12.228498] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T19:34:12.400745] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-11-03T19:34:12.734889] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-11-03T19:34:13.534847] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-11-03T19:34:13.644940] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-11-03T19:34:14.063725] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-11-03T19:34:14.334915] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-11. [2025-11-03T19:34:14.770163] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-11 (0.44 seconds). [2025-11-03T19:34:14.770939] [INFO ] [REMOTE ] IGI: Full fetch complete (5660 records). [2025-11-03T19:34:14.771008] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-11-03T19:34:15.124172] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-11-03T19:34:15.124265] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-11-03T19:34:15.124413] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-11-03T19:34:15.124450] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-11-03T19:34:15.124833] [DEBUG] [LOCAL ] IGI: Trimmed 5660 records to 4159 (keeping 200 days of data) [2025-11-03T19:34:15.135285] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-11-03T19:34:15.150283] [DEBUG] [LOCAL ] IGI: Primary data saved (4159 records). [2025-11-03T19:34:15.150349] [INFO ] [MAIN ] IGI: Full history saved. [2025-11-03T19:34:15.150417] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGI took 35.5s. Estimated remaining: 2h 58m 40s. Rate: 7.1 symbols/min [2025-11-03T19:34:15.320178] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:15.352165] [DEBUG] [LOCAL ] IHS: Loaded 37281 existing records from primary storage. [2025-11-03T19:34:15.352441] [INFO ] [MAIN ] IHS: Loaded 37281 existing records. [2025-11-03T19:34:15.531227] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:15.531436] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-11-03T19:34:15.531483] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-11-03T19:34:15.532042] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-11-03T19:34:15.532101] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-11-03T19:34:15.901592] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:15.940888] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-11-03T19:34:15.943100] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-11-03T19:34:16.734864] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-11-03T19:34:17.086580] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:34:17.534861] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-11-03T19:34:17.628699] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T19:34:18.300960] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T19:34:18.334843] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-11-03T19:34:19.134928] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-11-03T19:34:19.418620] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T19:34:19.906713] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:34:19.934876] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-11-03T19:34:20.452636] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-11-03T19:34:20.734854] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-11. [2025-11-03T19:34:21.534880] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-11-03T19:34:21.708315] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T19:34:21.709567] [INFO ] [REMOTE ] IGR: Full fetch complete (44310 records). [2025-11-03T19:34:21.709717] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-11-03T19:34:22.107244] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-11-03T19:34:22.107328] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-11-03T19:34:22.108057] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-11-03T19:34:22.108121] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-11-03T19:34:22.109129] [DEBUG] [LOCAL ] IGR: Trimmed 44310 records to 29933 (keeping 200 days of data) [2025-11-03T19:34:22.274722] [DEBUG] [LOCAL ] IGR: Primary data saved (29933 records). [2025-11-03T19:34:22.274849] [INFO ] [MAIN ] IGR: Full history saved. [2025-11-03T19:34:22.274924] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IGR took 42.2s. Estimated remaining: 2h 58m 30s. Rate: 7.1 symbols/min [2025-11-03T19:34:22.340015] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-11-03T19:34:22.447229] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:22.456363] [DEBUG] [LOCAL ] IIF: Loaded 4977 existing records from primary storage. [2025-11-03T19:34:22.456544] [INFO ] [MAIN ] IIF: Loaded 4977 existing records. [2025-11-03T19:34:22.636174] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:22.636390] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-11-03T19:34:22.636459] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-11-03T19:34:22.651424] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-11-03T19:34:22.651950] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T19:34:22.652061] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-11-03T19:34:23.023171] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:23.134816] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-11-03T19:34:23.516919] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T19:34:23.934824] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-11-03T19:34:23.981787] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T19:34:24.734846] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-11-03T19:34:24.967788] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-11-03T19:34:25.534815] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-11-03T19:34:25.646929] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T19:34:26.077432] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-11-03T19:34:26.334849] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-11-03T19:34:27.134867] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-11-03T19:34:27.370321] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:34:27.934848] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-11-03T19:34:28.734888] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-11-03T19:34:28.846352] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-11-03T19:34:28.870592] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T19:34:29.150345] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T19:34:29.534868] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-11-03T19:34:30.082559] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-11-03T19:34:30.334854] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-11-03T19:34:31.134864] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-11-03T19:34:31.520152] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T19:34:31.821356] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-11-03T19:34:31.934848] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-11-03T19:34:32.734855] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-11-03T19:34:32.850222] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T19:34:33.534903] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-11-03T19:34:33.839825] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-11-03T19:34:33.882836] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T19:34:34.334866] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-11-03T19:34:34.766529] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-11-03T19:34:35.134847] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-11-03T19:34:35.610110] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-11-03T19:34:35.934864] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-11. [2025-11-03T19:34:36.715737] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T19:34:36.716735] [INFO ] [REMOTE ] IHG: Full fetch complete (34943 records). [2025-11-03T19:34:36.716811] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-11-03T19:34:36.739924] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-11-03T19:34:37.096443] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-11-03T19:34:37.096577] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-11-03T19:34:37.097224] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-11-03T19:34:37.097306] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-11-03T19:34:37.098335] [DEBUG] [LOCAL ] IHG: Trimmed 34943 records to 23315 (keeping 200 days of data) [2025-11-03T19:34:37.243184] [DEBUG] [LOCAL ] IHG: Primary data saved (23315 records). [2025-11-03T19:34:37.243303] [INFO ] [MAIN ] IHG: Full history saved. [2025-11-03T19:34:37.243378] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IHG took 25.9s. Estimated remaining: 2h 58m 29s. Rate: 7.1 symbols/min [2025-11-03T19:34:37.374541] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-11-03T19:34:37.425028] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:37.439742] [DEBUG] [LOCAL ] IIIN: Loaded 16131 existing records from primary storage. [2025-11-03T19:34:37.439952] [INFO ] [MAIN ] IIIN: Loaded 16131 existing records. [2025-11-03T19:34:37.540079] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-11-03T19:34:37.617911] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:37.618123] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-11-03T19:34:37.618171] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-11-03T19:34:37.618540] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-11-03T19:34:37.618597] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-11-03T19:34:37.991782] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:38.334856] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-11-03T19:34:38.733624] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T19:34:38.752438] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-11-03T19:34:39.134881] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-11-03T19:34:39.934866] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-11-03T19:34:40.294837] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T19:34:40.742618] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-11-03T19:34:40.747103] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-11-03T19:34:41.157207] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-11-03T19:34:41.534853] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-11-03T19:34:42.039161] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-11-03T19:34:42.334848] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-11-03T19:34:42.839254] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-11-03T19:34:43.134840] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-11-03T19:34:43.934824] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-11-03T19:34:44.107102] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T19:34:44.672510] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T19:34:44.734821] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-11. [2025-11-03T19:34:45.534883] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-11-03T19:34:45.602397] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:34:45.603604] [INFO ] [REMOTE ] IHS: Full fetch complete (51722 records). [2025-11-03T19:34:45.603724] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-11-03T19:34:45.934609] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T19:34:46.011724] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-11-03T19:34:46.011814] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-11-03T19:34:46.012569] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-11-03T19:34:46.012631] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-11-03T19:34:46.013773] [DEBUG] [LOCAL ] IHS: Trimmed 51722 records to 36822 (keeping 200 days of data) [2025-11-03T19:34:46.211466] [DEBUG] [LOCAL ] IHS: Primary data saved (36822 records). [2025-11-03T19:34:46.211608] [INFO ] [MAIN ] IHS: Full history saved. [2025-11-03T19:34:46.211715] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IHS took 31.1s. Estimated remaining: 2h 58m 21s. Rate: 7.1 symbols/min [2025-11-03T19:34:46.350080] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-11-03T19:34:46.382867] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:46.398269] [DEBUG] [LOCAL ] IIM: Loaded 15515 existing records from primary storage. [2025-11-03T19:34:46.398491] [INFO ] [MAIN ] IIM: Loaded 15515 existing records. [2025-11-03T19:34:46.602828] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:46.603062] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-11-03T19:34:46.603116] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-11-03T19:34:46.603461] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-11-03T19:34:46.603501] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-11-03T19:34:46.956238] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:47.134817] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-11-03T19:34:47.175133] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-11-03T19:34:47.499146] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T19:34:47.934848] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-11-03T19:34:48.410707] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-11-03T19:34:48.734947] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-11-03T19:34:49.195681] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-11-03T19:34:49.534917] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-11-03T19:34:50.334870] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-11. [2025-11-03T19:34:50.540279] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T19:34:50.669183] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-11 (0.33 seconds). [2025-11-03T19:34:50.669923] [INFO ] [REMOTE ] IIF: Full fetch complete (8170 records). [2025-11-03T19:34:50.669992] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-11-03T19:34:51.017917] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-11-03T19:34:51.017991] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-11-03T19:34:51.018192] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-11-03T19:34:51.018230] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-11-03T19:34:51.018602] [DEBUG] [LOCAL ] IIF: Trimmed 8170 records to 4811 (keeping 200 days of data) [2025-11-03T19:34:51.045660] [DEBUG] [LOCAL ] IIF: Primary data saved (4811 records). [2025-11-03T19:34:51.045732] [INFO ] [MAIN ] IIF: Full history saved. [2025-11-03T19:34:51.045801] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IIF took 28.8s. Estimated remaining: 2h 58m 9s. Rate: 7.1 symbols/min [2025-11-03T19:34:51.141519] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-11-03T19:34:51.215790] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:34:51.241722] [DEBUG] [LOCAL ] IIPR: Loaded 28775 existing records from primary storage. [2025-11-03T19:34:51.242011] [INFO ] [MAIN ] IIPR: Loaded 28775 existing records. [2025-11-03T19:34:51.418690] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:34:51.418927] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-11-03T19:34:51.418984] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-11-03T19:34:51.419614] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-11-03T19:34:51.419706] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-11-03T19:34:51.764515] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:34:51.934207] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-11-03T19:34:51.938856] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-11-03T19:34:52.734820] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-11-03T19:34:52.999559] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T19:34:53.452623] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-11-03T19:34:53.534838] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-11-03T19:34:54.334912] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-11-03T19:34:54.535195] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T19:34:54.945590] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-11-03T19:34:55.134852] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-11-03T19:34:55.934832] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-11-03T19:34:56.135864] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T19:34:56.582469] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T19:34:56.734883] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-11-03T19:34:57.206182] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-11-03T19:34:57.534855] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-11-03T19:34:58.334856] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-11-03T19:34:58.383724] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-11-03T19:34:59.106195] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-11-03T19:34:59.134816] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-11-03T19:34:59.900616] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T19:34:59.934815] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-11-03T19:35:00.734859] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-11-03T19:35:01.056537] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T19:35:01.534891] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-11-03T19:35:02.307858] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-11-03T19:35:02.326165] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-11-03T19:35:02.334802] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-11-03T19:35:03.134843] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-11. [2025-11-03T19:35:03.506265] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T19:35:03.806412] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-11 (0.67 seconds). [2025-11-03T19:35:03.807210] [INFO ] [REMOTE ] IHD: Full fetch complete (11597 records). [2025-11-03T19:35:03.807277] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-11-03T19:35:03.944414] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-11-03T19:35:04.169178] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-11-03T19:35:04.169260] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-11-03T19:35:04.169574] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-11-03T19:35:04.169612] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-11-03T19:35:04.170052] [DEBUG] [LOCAL ] IHD: Trimmed 11597 records to 7391 (keeping 200 days of data) [2025-11-03T19:35:04.211740] [DEBUG] [LOCAL ] IHD: Primary data saved (7391 records). [2025-11-03T19:35:04.211874] [INFO ] [MAIN ] IHD: Full history saved. [2025-11-03T19:35:04.211955] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IHD took 54.3s. Estimated remaining: 2h 58m 6s. Rate: 7.1 symbols/min [2025-11-03T19:35:04.381571] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:04.417418] [DEBUG] [LOCAL ] IMAX: Loaded 44012 existing records from primary storage. [2025-11-03T19:35:04.417740] [INFO ] [MAIN ] IMAX: Loaded 44012 existing records. [2025-11-03T19:35:04.587914] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:04.588136] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-11-03T19:35:04.588192] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-11-03T19:35:04.588960] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-11-03T19:35:04.589017] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-11-03T19:35:04.740032] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-11-03T19:35:04.945189] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:35:04.960881] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T19:35:05.484639] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T19:35:05.534848] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-11-03T19:35:06.334909] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-11-03T19:35:06.828006] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T19:35:07.065743] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-11-03T19:35:07.134864] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-11-03T19:35:07.716304] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-11-03T19:35:07.934858] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-11-03T19:35:08.637709] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-11-03T19:35:08.734872] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-11-03T19:35:09.534904] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-11-03T19:35:09.822985] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T19:35:10.334937] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-11-03T19:35:10.436136] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-11-03T19:35:10.881815] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-11-03T19:35:11.134867] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-11-03T19:35:11.934910] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-11. [2025-11-03T19:35:12.266160] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T19:35:12.613459] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-11 (0.68 seconds). [2025-11-03T19:35:12.614468] [INFO ] [REMOTE ] IIIN: Full fetch complete (24898 records). [2025-11-03T19:35:12.614543] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-11-03T19:35:12.739987] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-11-03T19:35:13.002047] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-11-03T19:35:13.002123] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-11-03T19:35:13.002725] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-11-03T19:35:13.002836] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-11-03T19:35:13.003461] [DEBUG] [LOCAL ] IIIN: Trimmed 24898 records to 15785 (keeping 200 days of data) [2025-11-03T19:35:13.096631] [DEBUG] [LOCAL ] IIIN: Primary data saved (15785 records). [2025-11-03T19:35:13.096910] [INFO ] [MAIN ] IIIN: Full history saved. [2025-11-03T19:35:13.096987] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IIIN took 35.9s. Estimated remaining: 2h 57m 58s. Rate: 7.1 symbols/min [2025-11-03T19:35:13.278935] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:13.319164] [DEBUG] [LOCAL ] INFA: Loaded 48781 existing records from primary storage. [2025-11-03T19:35:13.319456] [INFO ] [MAIN ] INFA: Loaded 48781 existing records. [2025-11-03T19:35:13.506427] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:13.506681] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-11-03T19:35:13.506740] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-11-03T19:35:13.507470] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-11-03T19:35:13.507527] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-11-03T19:35:13.540140] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-11-03T19:35:13.869839] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:35:13.891407] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T19:35:14.334844] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-11-03T19:35:14.860181] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T19:35:15.134856] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-11-03T19:35:15.341586] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-11-03T19:35:15.934859] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-11-03T19:35:16.232267] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:35:16.508894] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T19:35:16.734872] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-11-03T19:35:17.534871] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-11-03T19:35:17.936434] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:35:18.334853] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-11-03T19:35:18.762807] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-11-03T19:35:19.134864] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-11-03T19:35:19.471829] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-11-03T19:35:19.934861] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-11-03T19:35:20.237042] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-11-03T19:35:20.734892] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-11-03T19:35:21.146093] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T19:35:21.534903] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-11-03T19:35:22.039974] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-11-03T19:35:22.251834] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-11-03T19:35:22.334884] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-11-03T19:35:23.134874] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-11. [2025-11-03T19:35:23.587950] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T19:35:23.934880] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-11-03T19:35:24.232334] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:35:24.233590] [INFO ] [REMOTE ] IIPR: Full fetch complete (43384 records). [2025-11-03T19:35:24.233686] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-11-03T19:35:24.602913] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-11-03T19:35:24.603000] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-11-03T19:35:24.604233] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-11-03T19:35:24.604297] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-11-03T19:35:24.605364] [DEBUG] [LOCAL ] IIPR: Trimmed 43384 records to 28465 (keeping 200 days of data) [2025-11-03T19:35:24.748699] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-11-03T19:35:24.782994] [DEBUG] [LOCAL ] IIPR: Primary data saved (28465 records). [2025-11-03T19:35:24.783283] [INFO ] [MAIN ] IIPR: Full history saved. [2025-11-03T19:35:24.783373] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IIPR took 33.7s. Estimated remaining: 2h 57m 53s. Rate: 7.1 symbols/min [2025-11-03T19:35:24.958767] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:25.008559] [DEBUG] [LOCAL ] INFY: Loaded 54374 existing records from primary storage. [2025-11-03T19:35:25.008924] [INFO ] [MAIN ] INFY: Loaded 54374 existing records. [2025-11-03T19:35:25.197556] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:25.197925] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-11-03T19:35:25.198016] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-11-03T19:35:25.199078] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-11-03T19:35:25.199136] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-11-03T19:35:25.527960] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-11-03T19:35:25.544586] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-11. [2025-11-03T19:35:25.617087] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:35:25.649766] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-11-03T19:35:26.167484] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T19:35:26.168392] [INFO ] [REMOTE ] IIM: Full fetch complete (24439 records). [2025-11-03T19:35:26.168461] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-11-03T19:35:26.350311] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-11-03T19:35:26.541038] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-11-03T19:35:26.541110] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-11-03T19:35:26.541609] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-11-03T19:35:26.541669] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-11-03T19:35:26.542273] [DEBUG] [LOCAL ] IIM: Trimmed 24439 records to 15357 (keeping 200 days of data) [2025-11-03T19:35:26.632308] [DEBUG] [LOCAL ] IIM: Primary data saved (15357 records). [2025-11-03T19:35:26.632437] [INFO ] [MAIN ] IIM: Full history saved. [2025-11-03T19:35:26.632513] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IIM took 40.4s. Estimated remaining: 2h 57m 37s. Rate: 7.1 symbols/min [2025-11-03T19:35:26.797075] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:26.841867] [DEBUG] [LOCAL ] ING: Loaded 51363 existing records from primary storage. [2025-11-03T19:35:26.842158] [INFO ] [MAIN ] ING: Loaded 51363 existing records. [2025-11-03T19:35:27.022402] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:27.022669] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-11-03T19:35:27.022759] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-11-03T19:35:27.023578] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-11-03T19:35:27.023635] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-11-03T19:35:27.140034] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-11-03T19:35:27.378053] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:35:27.826216] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-11-03T19:35:27.934831] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-11. [2025-11-03T19:35:28.734860] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-11-03T19:35:28.873591] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-11-03T19:35:28.990752] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:35:28.992101] [INFO ] [REMOTE ] IMAX: Full fetch complete (61716 records). [2025-11-03T19:35:28.992192] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-11-03T19:35:29.393529] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-11-03T19:35:29.393630] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-11-03T19:35:29.394515] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-11-03T19:35:29.394577] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-11-03T19:35:29.395900] [DEBUG] [LOCAL ] IMAX: Trimmed 61716 records to 43313 (keeping 200 days of data) [2025-11-03T19:35:29.565157] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-11-03T19:35:29.654849] [DEBUG] [LOCAL ] IMAX: Primary data saved (43313 records). [2025-11-03T19:35:29.654981] [INFO ] [MAIN ] IMAX: Full history saved. [2025-11-03T19:35:29.655064] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. IMAX took 25.4s. Estimated remaining: 2h 57m 22s. Rate: 7.1 symbols/min [2025-11-03T19:35:29.833245] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:29.858135] [DEBUG] [LOCAL ] INGM: Loaded 28133 existing records from primary storage. [2025-11-03T19:35:29.858404] [INFO ] [MAIN ] INGM: Loaded 28133 existing records. [2025-11-03T19:35:30.032336] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:30.032589] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-11-03T19:35:30.032639] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-11-03T19:35:30.033221] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-11-03T19:35:30.033276] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-11-03T19:35:30.335761] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-11-03T19:35:30.395676] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:35:30.424269] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T19:35:30.881185] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T19:35:31.134882] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-11-03T19:35:31.607527] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T19:35:31.934881] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-11-03T19:35:32.517533] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T19:35:32.734823] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-11-03T19:35:33.307071] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-11-03T19:35:33.534853] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-11-03T19:35:34.008822] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:35:34.334848] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-11-03T19:35:34.643517] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:35:35.134847] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-11-03T19:35:35.712571] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T19:35:35.934926] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-11-03T19:35:36.492273] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T19:35:36.734926] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-11-03T19:35:36.955411] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T19:35:37.534903] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-11-03T19:35:38.072796] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T19:35:38.334862] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-11-03T19:35:38.676744] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T19:35:39.134871] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-11-03T19:35:39.525385] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T19:35:39.934871] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-11-03T19:35:40.424431] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T19:35:40.734881] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-11-03T19:35:40.869794] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T19:35:41.534860] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-11-03T19:35:41.997996] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T19:35:42.334903] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-11-03T19:35:42.634092] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-11-03T19:35:43.134873] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-11-03T19:35:43.609570] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:35:43.873738] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T19:35:43.934885] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-11. [2025-11-03T19:35:44.734894] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-11-03T19:35:44.777761] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T19:35:44.779231] [INFO ] [REMOTE ] INFA: Full fetch complete (70524 records). [2025-11-03T19:35:44.779320] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-11-03T19:35:45.193478] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-11-03T19:35:45.193564] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-11-03T19:35:45.194483] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-11-03T19:35:45.194547] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-11-03T19:35:45.195911] [DEBUG] [LOCAL ] INFA: Trimmed 70524 records to 48017 (keeping 200 days of data) [2025-11-03T19:35:45.481696] [DEBUG] [LOCAL ] INFA: Primary data saved (48017 records). [2025-11-03T19:35:45.481834] [INFO ] [MAIN ] INFA: Full history saved. [2025-11-03T19:35:45.481911] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. INFA took 32.4s. Estimated remaining: 2h 57m 22s. Rate: 7.1 symbols/min [2025-11-03T19:35:45.539953] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-11-03T19:35:45.658370] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:45.690682] [DEBUG] [LOCAL ] INGR: Loaded 34154 existing records from primary storage. [2025-11-03T19:35:45.690949] [INFO ] [MAIN ] INGR: Loaded 34154 existing records. [2025-11-03T19:35:45.873268] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:45.873500] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-11-03T19:35:45.873549] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-11-03T19:35:45.874183] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-11-03T19:35:45.874239] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-11-03T19:35:46.245371] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:35:46.278384] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-11-03T19:35:46.334816] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-11-03T19:35:46.811490] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:35:47.134834] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-11-03T19:35:47.680567] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T19:35:47.934889] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-11-03T19:35:48.290170] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T19:35:48.734896] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-11-03T19:35:49.363194] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T19:35:49.534879] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-11-03T19:35:49.816857] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:35:50.334875] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-11-03T19:35:50.801246] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:35:51.134887] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-11-03T19:35:51.390879] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T19:35:51.934884] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-11-03T19:35:52.376585] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:35:52.734949] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-11-03T19:35:52.997637] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T19:35:53.534853] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-11-03T19:35:53.795192] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T19:35:54.334881] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-11-03T19:35:54.454965] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-11-03T19:35:55.134850] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-11-03T19:35:55.775824] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T19:35:55.934868] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-11-03T19:35:55.988363] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-11-03T19:35:56.734887] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-11-03T19:35:57.386396] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-11-03T19:35:57.534831] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-11. [2025-11-03T19:35:57.636101] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T19:35:58.334848] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-10. [2025-11-03T19:35:58.658600] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T19:35:58.660093] [INFO ] [REMOTE ] INFY: Full fetch complete (77751 records). [2025-11-03T19:35:58.660182] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-11-03T19:35:59.042715] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-11-03T19:35:59.042804] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-11-03T19:35:59.043838] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-11-03T19:35:59.043918] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-11-03T19:35:59.045330] [DEBUG] [LOCAL ] INFY: Trimmed 77751 records to 53594 (keeping 200 days of data) [2025-11-03T19:35:59.134928] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-11-03T19:35:59.374908] [DEBUG] [LOCAL ] INFY: Primary data saved (53594 records). [2025-11-03T19:35:59.375054] [INFO ] [MAIN ] INFY: Full history saved. [2025-11-03T19:35:59.375849] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. INFY took 34.6s. Estimated remaining: 2h 57m 20s. Rate: 7.1 symbols/min [2025-11-03T19:35:59.554711] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:35:59.592684] [DEBUG] [LOCAL ] INN: Loaded 41450 existing records from primary storage. [2025-11-03T19:35:59.592973] [INFO ] [MAIN ] INN: Loaded 41450 existing records. [2025-11-03T19:35:59.793072] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:35:59.793315] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-11-03T19:35:59.793392] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-11-03T19:35:59.794113] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-11-03T19:35:59.794183] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-11-03T19:35:59.936085] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-11-03T19:36:00.050452] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-11-03T19:36:00.197289] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:00.218162] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T19:36:00.734861] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-11-03T19:36:01.454367] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-11-03T19:36:01.534832] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-11-03T19:36:02.334850] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-11-03T19:36:02.672624] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:36:02.699547] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-11-03T19:36:03.134829] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-11-03T19:36:03.252096] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T19:36:03.934838] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-11. [2025-11-03T19:36:04.119012] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:36:04.734872] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-11-03T19:36:05.098955] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T19:36:05.100529] [INFO ] [REMOTE ] ING: Full fetch complete (73800 records). [2025-11-03T19:36:05.100629] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-11-03T19:36:05.520038] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-11-03T19:36:05.520228] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-11-03T19:36:05.521378] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-11-03T19:36:05.521505] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-11-03T19:36:05.523098] [DEBUG] [LOCAL ] ING: Trimmed 73800 records to 50598 (keeping 200 days of data) [2025-11-03T19:36:05.575459] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-11-03T19:36:05.669539] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-11-03T19:36:05.852990] [DEBUG] [LOCAL ] ING: Primary data saved (50598 records). [2025-11-03T19:36:05.853120] [INFO ] [MAIN ] ING: Full history saved. [2025-11-03T19:36:05.853199] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. ING took 39.2s. Estimated remaining: 2h 57m 10s. Rate: 7.1 symbols/min [2025-11-03T19:36:06.023443] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:36:06.023679] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-11-03T19:36:06.023733] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-11-03T19:36:06.023839] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-11-03T19:36:06.023880] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-11-03T19:36:06.023921] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-11-03T19:36:06.023953] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-11-03T19:36:06.341571] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-11-03T19:36:06.382263] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:06.679681] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-11-03T19:36:07.134843] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-11-03T19:36:07.324837] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T19:36:07.488541] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-11-03T19:36:07.934913] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-11-03T19:36:08.734879] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-11. [2025-11-03T19:36:08.971995] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T19:36:09.376757] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-11 (0.64 seconds). [2025-11-03T19:36:09.377993] [INFO ] [REMOTE ] INGM: Full fetch complete (41943 records). [2025-11-03T19:36:09.378063] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-11-03T19:36:09.545713] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-11-03T19:36:09.746287] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-11-03T19:36:09.746363] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-11-03T19:36:09.747044] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-11-03T19:36:09.747105] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-11-03T19:36:09.748012] [DEBUG] [LOCAL ] INGM: Trimmed 41943 records to 27565 (keeping 200 days of data) [2025-11-03T19:36:09.910353] [DEBUG] [LOCAL ] INGM: Primary data saved (27565 records). [2025-11-03T19:36:09.910483] [INFO ] [MAIN ] INGM: Full history saved. [2025-11-03T19:36:09.910562] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. INGM took 40.3s. Estimated remaining: 2h 56m 56s. Rate: 7.1 symbols/min [2025-11-03T19:36:10.079563] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:36:10.114425] [DEBUG] [LOCAL ] INSP: Loaded 39422 existing records from primary storage. [2025-11-03T19:36:10.114740] [INFO ] [MAIN ] INSP: Loaded 39422 existing records. [2025-11-03T19:36:10.294354] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:36:10.294598] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-11-03T19:36:10.294667] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-11-03T19:36:10.295367] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-11-03T19:36:10.295425] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-11-03T19:36:10.339972] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-11-03T19:36:10.681979] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:10.797062] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:36:11.134853] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-11-03T19:36:11.367474] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T19:36:11.934858] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-11-03T19:36:12.401608] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:36:12.734836] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-11-03T19:36:12.759152] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T19:36:13.534878] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-11-03T19:36:13.830395] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T19:36:14.334822] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-11-03T19:36:14.460885] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T19:36:15.134903] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-11-03T19:36:15.382279] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T19:36:15.934875] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-11-03T19:36:16.198729] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T19:36:16.734829] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-11-03T19:36:16.764920] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T19:36:17.534922] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-11-03T19:36:17.749793] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T19:36:18.334928] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-11-03T19:36:18.565729] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:36:19.134920] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-11-03T19:36:19.377033] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T19:36:19.934841] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-11-03T19:36:19.976272] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-11-03T19:36:20.734855] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-11-03T19:36:21.123113] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:36:21.534865] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-11-03T19:36:21.773442] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T19:36:22.319121] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-11-03T19:36:22.334808] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-11-03T19:36:23.134847] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-11-03T19:36:23.470059] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-11-03T19:36:23.934914] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-11. [2025-11-03T19:36:24.210325] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:36:24.734924] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-11-03T19:36:24.758134] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T19:36:24.759938] [INFO ] [REMOTE ] INGR: Full fetch complete (50736 records). [2025-11-03T19:36:24.760069] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-11-03T19:36:25.165285] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-11-03T19:36:25.165429] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-11-03T19:36:25.166830] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-11-03T19:36:25.166895] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-11-03T19:36:25.168368] [DEBUG] [LOCAL ] INGR: Trimmed 50736 records to 33874 (keeping 200 days of data) [2025-11-03T19:36:25.403405] [DEBUG] [LOCAL ] INGR: Primary data saved (33874 records). [2025-11-03T19:36:25.403689] [INFO ] [MAIN ] INGR: Full history saved. [2025-11-03T19:36:25.403810] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. INGR took 39.9s. Estimated remaining: 2h 56m 56s. Rate: 7.1 symbols/min [2025-11-03T19:36:25.540012] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-11-03T19:36:25.605841] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:36:25.660109] [DEBUG] [LOCAL ] INSW: Loaded 39166 existing records from primary storage. [2025-11-03T19:36:25.660732] [INFO ] [MAIN ] INSW: Loaded 39166 existing records. [2025-11-03T19:36:25.868975] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:36:25.869500] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-11-03T19:36:25.869588] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-11-03T19:36:25.877208] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-11-03T19:36:25.877299] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-11-03T19:36:25.986343] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:36:26.326542] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:26.334825] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-11-03T19:36:26.506369] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-11-03T19:36:27.134864] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-11-03T19:36:27.618630] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T19:36:27.934889] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-11-03T19:36:28.054184] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T19:36:28.734940] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-11-03T19:36:29.110740] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T19:36:29.539941] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-11-03T19:36:29.552635] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-11-03T19:36:30.334826] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-11-03T19:36:30.432243] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T19:36:31.134828] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-11-03T19:36:31.308459] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-11-03T19:36:31.934860] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-11-03T19:36:32.194576] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T19:36:32.734901] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-11. [2025-11-03T19:36:33.063420] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:36:33.517179] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T19:36:33.518356] [INFO ] [REMOTE ] INR: Full fetch complete (38923 records). [2025-11-03T19:36:33.518440] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-11-03T19:36:33.540044] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-11. [2025-11-03T19:36:33.712820] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-11-03T19:36:33.713370] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:36:33.713455] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:36:33.713520] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-11-03T19:36:33.713586] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-11-03T19:36:33.713626] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-11-03T19:36:33.713709] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-11-03T19:36:33.713789] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INR took 27.9s. Estimated remaining: 2h 56m 47s. Rate: 7.1 symbols/min [2025-11-03T19:36:33.910726] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:36:33.957846] [DEBUG] [LOCAL ] INVH: Loaded 53959 existing records from primary storage. [2025-11-03T19:36:33.958156] [INFO ] [MAIN ] INVH: Loaded 53959 existing records. [2025-11-03T19:36:34.149130] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:36:34.149396] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-11-03T19:36:34.149445] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-11-03T19:36:34.150456] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-11-03T19:36:34.150513] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-11-03T19:36:34.340085] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-11-03T19:36:34.503366] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:34.669432] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T19:36:34.671691] [INFO ] [REMOTE ] INN: Full fetch complete (57870 records). [2025-11-03T19:36:34.671832] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-11-03T19:36:35.052038] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-11-03T19:36:35.052114] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-11-03T19:36:35.053001] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-11-03T19:36:35.053090] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-11-03T19:36:35.054229] [DEBUG] [LOCAL ] INN: Trimmed 57870 records to 40812 (keeping 200 days of data) [2025-11-03T19:36:35.140756] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-11-03T19:36:35.289546] [DEBUG] [LOCAL ] INN: Primary data saved (40812 records). [2025-11-03T19:36:35.289692] [INFO ] [MAIN ] INN: Full history saved. [2025-11-03T19:36:35.290515] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INN took 35.9s. Estimated remaining: 2h 56m 31s. Rate: 7.1 symbols/min [2025-11-03T19:36:35.456397] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:36:35.484984] [DEBUG] [LOCAL ] INVX: Loaded 28837 existing records from primary storage. [2025-11-03T19:36:35.485217] [INFO ] [MAIN ] INVX: Loaded 28837 existing records. [2025-11-03T19:36:35.668344] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:36:35.668709] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-11-03T19:36:35.668792] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-11-03T19:36:35.669398] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-11-03T19:36:35.669456] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-11-03T19:36:35.944918] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-11-03T19:36:35.999208] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-11-03T19:36:36.090078] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:36.443858] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:36:36.734856] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-11-03T19:36:37.317907] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-11-03T19:36:37.534856] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-11-03T19:36:38.033934] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:36:38.334890] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-11-03T19:36:38.799011] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T19:36:39.134850] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-11-03T19:36:39.551182] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T19:36:39.934897] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-11-03T19:36:40.450392] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T19:36:40.734872] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-11-03T19:36:41.255545] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T19:36:41.534826] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-11. [2025-11-03T19:36:42.009687] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:36:42.334851] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-11-03T19:36:42.589958] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:36:42.591410] [INFO ] [REMOTE ] INSP: Full fetch complete (54157 records). [2025-11-03T19:36:42.591508] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-11-03T19:36:42.989370] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-11-03T19:36:42.989479] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-11-03T19:36:42.990774] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-11-03T19:36:42.990845] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-11-03T19:36:42.992393] [DEBUG] [LOCAL ] INSP: Trimmed 54157 records to 39136 (keeping 200 days of data) [2025-11-03T19:36:43.170093] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-11-03T19:36:43.240571] [DEBUG] [LOCAL ] INSP: Primary data saved (39136 records). [2025-11-03T19:36:43.240842] [INFO ] [MAIN ] INSP: Full history saved. [2025-11-03T19:36:43.240996] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INSP took 33.3s. Estimated remaining: 2h 56m 22s. Rate: 7.1 symbols/min [2025-11-03T19:36:43.420454] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:36:43.440636] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:36:43.493928] [DEBUG] [LOCAL ] IONQ: Loaded 54568 existing records from primary storage. [2025-11-03T19:36:43.494304] [INFO ] [MAIN ] IONQ: Loaded 54568 existing records. [2025-11-03T19:36:43.679484] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:36:43.679763] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-11-03T19:36:43.679820] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-11-03T19:36:43.680700] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-11-03T19:36:43.680760] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-11-03T19:36:43.942617] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-11-03T19:36:44.053990] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:36:44.355412] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T19:36:44.734869] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-11-03T19:36:44.859613] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T19:36:45.534884] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-11-03T19:36:46.191570] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-11-03T19:36:46.334843] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-11-03T19:36:47.134839] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-11-03T19:36:47.707017] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T19:36:47.860485] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-11-03T19:36:47.934817] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-11-03T19:36:48.187234] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-11-03T19:36:48.734889] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-11-03T19:36:49.393147] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T19:36:49.534855] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-11-03T19:36:49.814805] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T19:36:50.334873] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-11-03T19:36:50.985606] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T19:36:51.134820] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-11-03T19:36:51.342344] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T19:36:51.934866] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-11-03T19:36:52.524775] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T19:36:52.734832] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-11-03T19:36:52.851147] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T19:36:53.534899] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-11-03T19:36:53.798454] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T19:36:54.334914] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-11-03T19:36:54.875187] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T19:36:55.134850] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-11-03T19:36:55.934830] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-11-03T19:36:55.995543] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-11-03T19:36:56.353387] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-11-03T19:36:56.734838] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-11-03T19:36:57.032760] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:36:57.429673] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-11-03T19:36:57.534858] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-11-03T19:36:58.334816] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-11-03T19:36:58.416078] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-11-03T19:36:59.134849] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-11-03T19:36:59.570841] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:36:59.934860] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-11-03T19:37:00.734856] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-11-03T19:37:01.546247] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-11-03T19:37:01.549378] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-11-03T19:37:01.802175] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-11-03T19:37:01.987938] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-11-03T19:37:02.334857] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-11. [2025-11-03T19:37:02.680056] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-11-03T19:37:03.134870] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-11-03T19:37:03.558378] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-11 (1.22 seconds). [2025-11-03T19:37:03.559937] [INFO ] [REMOTE ] INVH: Full fetch complete (77004 records). [2025-11-03T19:37:03.560075] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-11-03T19:37:03.949443] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-11. [2025-11-03T19:37:03.954071] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-11-03T19:37:03.954139] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-11-03T19:37:03.955132] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-11-03T19:37:03.955285] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-11-03T19:37:03.956786] [DEBUG] [LOCAL ] INVH: Trimmed 77004 records to 53189 (keeping 200 days of data) [2025-11-03T19:37:04.279975] [DEBUG] [LOCAL ] INVH: Primary data saved (53189 records). [2025-11-03T19:37:04.280154] [INFO ] [MAIN ] INVH: Full history saved. [2025-11-03T19:37:04.280251] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INVH took 30.6s. Estimated remaining: 2h 56m 28s. Rate: 7.1 symbols/min [2025-11-03T19:37:04.448840] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:04.495965] [DEBUG] [LOCAL ] IOT: Loaded 54212 existing records from primary storage. [2025-11-03T19:37:04.496290] [INFO ] [MAIN ] IOT: Loaded 54212 existing records. [2025-11-03T19:37:04.670062] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:04.670256] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-11-03T19:37:04.670301] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-11-03T19:37:04.671104] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-11-03T19:37:04.671160] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-11-03T19:37:04.742433] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T19:37:04.739789] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-11. [2025-11-03T19:37:04.769384] [INFO ] [REMOTE ] INVX: Full fetch complete (42333 records). [2025-11-03T19:37:04.780071] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-11-03T19:37:05.342093] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:05.438337] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-11-03T19:37:05.438466] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-11-03T19:37:05.439235] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-11-03T19:37:05.439309] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-11-03T19:37:05.440485] [DEBUG] [LOCAL ] INVX: Trimmed 42333 records to 28302 (keeping 200 days of data) [2025-11-03T19:37:05.537433] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-11-03T19:37:05.558723] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-11-03T19:37:05.642418] [DEBUG] [LOCAL ] INVX: Primary data saved (28302 records). [2025-11-03T19:37:05.642512] [INFO ] [MAIN ] INVX: Full history saved. [2025-11-03T19:37:05.642591] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INVX took 30.4s. Estimated remaining: 2h 56m 11s. Rate: 7.1 symbols/min [2025-11-03T19:37:05.801864] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:37:05.820045] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:05.821636] [INFO ] [REMOTE ] INSW: Full fetch complete (58649 records). [2025-11-03T19:37:05.821785] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-11-03T19:37:06.171915] [DEBUG] [LOCAL ] IP: Loaded 54078 existing records from primary storage. [2025-11-03T19:37:06.199417] [INFO ] [MAIN ] IP: Loaded 54078 existing records. [2025-11-03T19:37:06.334365] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-11-03T19:37:06.341711] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-11-03T19:37:06.345985] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-11-03T19:37:06.346938] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-11-03T19:37:06.357781] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-11-03T19:37:06.423420] [DEBUG] [LOCAL ] INSW: Trimmed 58649 records to 38405 (keeping 200 days of data) [2025-11-03T19:37:06.426920] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:06.427148] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-11-03T19:37:06.427748] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-11-03T19:37:06.479336] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-11-03T19:37:06.488010] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-11-03T19:37:06.996962] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:07.029582] [DEBUG] [LOCAL ] INSW: Primary data saved (38405 records). [2025-11-03T19:37:07.029818] [INFO ] [MAIN ] INSW: Full history saved. [2025-11-03T19:37:07.029925] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INSW took 41.6s. Estimated remaining: 2h 55m 55s. Rate: 7.1 symbols/min [2025-11-03T19:37:07.141886] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-11-03T19:37:07.228954] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:07.231904] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T19:37:07.286718] [DEBUG] [LOCAL ] IPG: Loaded 54105 existing records from primary storage. [2025-11-03T19:37:07.287033] [INFO ] [MAIN ] IPG: Loaded 54105 existing records. [2025-11-03T19:37:07.461588] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:07.461804] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-11-03T19:37:07.461851] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-11-03T19:37:07.462921] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-11-03T19:37:07.462978] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-11-03T19:37:07.822458] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:07.934882] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-11-03T19:37:08.395321] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-11-03T19:37:08.734840] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-11-03T19:37:08.834607] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-11-03T19:37:09.407022] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-11-03T19:37:09.534901] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-11-03T19:37:10.334896] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-11-03T19:37:11.028985] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-11-03T19:37:11.079968] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-11-03T19:37:11.134887] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-11-03T19:37:11.753934] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-11-03T19:37:11.934874] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-11-03T19:37:12.734966] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-11-03T19:37:13.313413] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T19:37:13.534838] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-11-03T19:37:13.696179] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-11-03T19:37:14.049918] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T19:37:14.334906] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-11-03T19:37:15.078991] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T19:37:15.134831] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-11-03T19:37:15.934967] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-11-03T19:37:16.648018] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-11-03T19:37:16.738521] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-11-03T19:37:16.744786] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-11-03T19:37:17.286425] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T19:37:17.534910] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-11-03T19:37:18.334881] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-11-03T19:37:18.923693] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T19:37:18.987160] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-11-03T19:37:19.134834] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-11-03T19:37:19.876446] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-11-03T19:37:19.934820] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-11-03T19:37:20.734927] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-11-03T19:37:21.461971] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T19:37:21.534866] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-11-03T19:37:21.683216] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-11-03T19:37:22.137414] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-11-03T19:37:22.334926] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-11. [2025-11-03T19:37:22.982603] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-11-03T19:37:23.134865] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-11-03T19:37:23.934847] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-11-03T19:37:24.475411] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T19:37:24.519673] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-11 (2.18 seconds). [2025-11-03T19:37:24.521186] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-11-03T19:37:24.521308] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-11-03T19:37:24.740686] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-11-03T19:37:24.919482] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-11-03T19:37:24.919559] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-11-03T19:37:24.920526] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-11-03T19:37:24.920591] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-11-03T19:37:24.921942] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-11-03T19:37:25.236516] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-11-03T19:37:25.236701] [INFO ] [MAIN ] IONQ: Full history saved. [2025-11-03T19:37:25.236810] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. IONQ took 42.0s. Estimated remaining: 2h 55m 57s. Rate: 7.1 symbols/min [2025-11-03T19:37:25.534833] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-11-03T19:37:25.565913] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-11-03T19:37:26.225834] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T19:37:26.334862] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-11-03T19:37:26.908099] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T19:37:27.134844] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-11-03T19:37:27.898610] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-11-03T19:37:27.934821] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-11-03T19:37:28.534598] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T19:37:28.734901] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-11-03T19:37:29.447206] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T19:37:29.534875] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-11-03T19:37:30.117561] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T19:37:30.334927] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-11-03T19:37:31.134858] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-11-03T19:37:31.179411] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-11-03T19:37:31.574579] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T19:37:31.934864] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-11. [2025-11-03T19:37:32.504494] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-11-03T19:37:32.734910] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-11. [2025-11-03T19:37:33.137608] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T19:37:33.139557] [INFO ] [REMOTE ] IP: Full fetch complete (77440 records). [2025-11-03T19:37:33.139724] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-11-03T19:37:33.545095] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-11-03T19:37:33.541368] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-11-03T19:37:33.546311] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-11-03T19:37:33.547340] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-11-03T19:37:33.547521] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-11-03T19:37:33.548975] [DEBUG] [LOCAL ] IP: Trimmed 77440 records to 53304 (keeping 200 days of data) [2025-11-03T19:37:33.866015] [DEBUG] [LOCAL ] IP: Primary data saved (53304 records). [2025-11-03T19:37:33.866158] [INFO ] [MAIN ] IP: Full history saved. [2025-11-03T19:37:33.867057] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. IP took 28.2s. Estimated remaining: 2h 55m 49s. Rate: 7.1 symbols/min [2025-11-03T19:37:33.873105] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:37:33.874625] [INFO ] [REMOTE ] IPG: Full fetch complete (77439 records). [2025-11-03T19:37:33.874730] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-11-03T19:37:34.261761] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-11-03T19:37:34.261840] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-11-03T19:37:34.262795] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-11-03T19:37:34.262858] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-11-03T19:37:34.264206] [DEBUG] [LOCAL ] IPG: Trimmed 77439 records to 53325 (keeping 200 days of data) [2025-11-03T19:37:34.580456] [DEBUG] [LOCAL ] IPG: Primary data saved (53325 records). [2025-11-03T19:37:34.580599] [INFO ] [MAIN ] IPG: Full history saved. [2025-11-03T19:37:34.580704] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IPG took 27.6s. Estimated remaining: 2h 55m 32s. Rate: 7.1 symbols/min [2025-11-03T19:37:35.032740] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T19:37:35.044433] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-11-03T19:37:36.669565] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-11-03T19:37:36.681072] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-11-03T19:37:38.355098] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-11-03T19:37:38.366724] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-11-03T19:37:40.074515] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-11-03T19:37:40.086997] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-11. [2025-11-03T19:37:41.290215] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T19:37:41.291739] [INFO ] [REMOTE ] IOT: Full fetch complete (77510 records). [2025-11-03T19:37:41.291828] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-11-03T19:37:41.674027] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-11-03T19:37:41.674107] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-11-03T19:37:41.675041] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-11-03T19:37:41.675102] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-11-03T19:37:41.676491] [DEBUG] [LOCAL ] IOT: Trimmed 77510 records to 53444 (keeping 200 days of data) [2025-11-03T19:37:41.975223] [DEBUG] [LOCAL ] IOT: Primary data saved (53444 records). [2025-11-03T19:37:41.975347] [INFO ] [MAIN ] IOT: Full history saved. [2025-11-03T19:37:41.975420] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IOT took 37.7s. Estimated remaining: 2h 55m 22s. Rate: 7.1 symbols/min [2025-11-03T19:37:42.544818] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:42.644705] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:42.693608] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:42.720672] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:37:42.747812] [DEBUG] [LOCAL ] IPI: Loaded 21456 existing records from primary storage. [2025-11-03T19:37:42.748488] [DEBUG] [LOCAL ] IQI: Loaded 17740 existing records from primary storage. [2025-11-03T19:37:42.748944] [INFO ] [MAIN ] IQI: Loaded 17740 existing records. [2025-11-03T19:37:42.759719] [INFO ] [MAIN ] IPI: Loaded 21456 existing records. [2025-11-03T19:37:43.011042] [DEBUG] [LOCAL ] IR: Loaded 53498 existing records from primary storage. [2025-11-03T19:37:43.060191] [INFO ] [MAIN ] IR: Loaded 53498 existing records. [2025-11-03T19:37:43.117259] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:43.189602] [DEBUG] [LOCAL ] IQV: Loaded 50593 existing records from primary storage. [2025-11-03T19:37:43.233079] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-11-03T19:37:43.242055] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:43.258076] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-11-03T19:37:43.252879] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-11-03T19:37:43.252680] [INFO ] [MAIN ] IQV: Loaded 50593 existing records. [2025-11-03T19:37:43.274147] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-11-03T19:37:43.274078] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-11-03T19:37:43.294969] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-11-03T19:37:43.312283] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-11-03T19:37:43.354542] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-11-03T19:37:43.641523] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:43.667697] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-11-03T19:37:43.683252] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-11-03T19:37:43.759578] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-11-03T19:37:43.804053] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-11-03T19:37:43.844534] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:37:43.930686] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-11-03T19:37:43.940739] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-11-03T19:37:43.985678] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-11-03T19:37:44.060016] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-11-03T19:37:44.564243] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:44.609434] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-11-03T19:37:44.892237] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:44.932167] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-11-03T19:37:45.000953] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:45.014811] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-11-03T19:37:45.102481] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:37:45.102796] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-11-03T19:37:45.759243] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:37:45.763378] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-11-03T19:37:45.852453] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T19:37:45.856083] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-11-03T19:37:46.240790] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T19:37:46.250513] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-11-03T19:37:46.317621] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:37:46.327715] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-11-03T19:37:46.562697] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T19:37:46.574070] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-11-03T19:37:46.581744] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T19:37:46.587018] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-11-03T19:37:47.313625] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-11-03T19:37:47.317773] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-11-03T19:37:47.331587] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T19:37:47.337007] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-11-03T19:37:47.365056] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:37:47.374279] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-11-03T19:37:47.700269] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T19:37:47.934826] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-11-03T19:37:48.127945] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-11-03T19:37:48.210190] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-11-03T19:37:48.548826] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:37:48.734851] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-11-03T19:37:49.363467] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T19:37:49.534821] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-11-03T19:37:50.116258] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-11-03T19:37:50.334875] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-11-03T19:37:51.005563] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-11-03T19:37:51.055079] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-11-03T19:37:51.134811] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-11-03T19:37:51.928013] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T19:37:51.934804] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-11-03T19:37:52.560456] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-11-03T19:37:52.734871] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-11-03T19:37:53.534921] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-11-03T19:37:54.086720] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-11-03T19:37:54.107883] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-11-03T19:37:54.334848] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-11-03T19:37:55.080491] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T19:37:55.134850] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-11-03T19:37:55.934826] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-11-03T19:37:55.970020] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-11-03T19:37:56.730708] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T19:37:56.735846] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-11-03T19:37:57.389817] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-11-03T19:37:57.534857] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-11-03T19:37:58.334926] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-11-03T19:37:58.941884] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T19:37:59.043605] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T19:37:59.134809] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-11-03T19:37:59.788021] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-11-03T19:37:59.934867] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-11. [2025-11-03T19:38:00.734908] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-11-03T19:38:00.892591] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T19:38:00.893537] [INFO ] [REMOTE ] IQI: Full fetch complete (26142 records). [2025-11-03T19:38:00.893626] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-11-03T19:38:01.265251] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-11-03T19:38:01.265328] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-11-03T19:38:01.265840] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-11-03T19:38:01.265902] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-11-03T19:38:01.266490] [DEBUG] [LOCAL ] IQI: Trimmed 26142 records to 17431 (keeping 200 days of data) [2025-11-03T19:38:01.374300] [DEBUG] [LOCAL ] IQI: Primary data saved (17431 records). [2025-11-03T19:38:01.374428] [INFO ] [MAIN ] IQI: Full history saved. [2025-11-03T19:38:01.374507] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 19.4s. Estimated remaining: 2h 55m 26s. Rate: 7.1 symbols/min [2025-11-03T19:38:01.540089] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-11-03T19:38:01.542824] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:01.585827] [DEBUG] [LOCAL ] IRM: Loaded 49238 existing records from primary storage. [2025-11-03T19:38:01.586110] [INFO ] [MAIN ] IRM: Loaded 49238 existing records. [2025-11-03T19:38:01.764601] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:01.764819] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-11-03T19:38:01.764897] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-11-03T19:38:01.766039] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-11-03T19:38:01.766103] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-11-03T19:38:02.142906] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:02.180906] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-11-03T19:38:02.334852] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-11-03T19:38:02.470411] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-11-03T19:38:03.134855] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-11-03T19:38:03.854148] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T19:38:03.934861] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-11-03T19:38:04.498232] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T19:38:04.734896] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-11-03T19:38:05.054361] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-11-03T19:38:05.534852] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-11-03T19:38:05.653731] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-11-03T19:38:06.334872] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-11-03T19:38:06.792255] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:38:07.134869] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-11. [2025-11-03T19:38:07.621768] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-11-03T19:38:07.782157] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T19:38:07.783080] [INFO ] [REMOTE ] IPI: Full fetch complete (30223 records). [2025-11-03T19:38:07.783155] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-11-03T19:38:07.940109] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-11-03T19:38:08.179938] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-11-03T19:38:08.180042] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-11-03T19:38:08.181023] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-11-03T19:38:08.181090] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-11-03T19:38:08.182085] [DEBUG] [LOCAL ] IPI: Trimmed 30223 records to 21043 (keeping 200 days of data) [2025-11-03T19:38:08.315811] [DEBUG] [LOCAL ] IPI: Primary data saved (21043 records). [2025-11-03T19:38:08.316013] [INFO ] [MAIN ] IPI: Full history saved. [2025-11-03T19:38:08.316129] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 26.3s. Estimated remaining: 2h 55m 16s. Rate: 7.1 symbols/min [2025-11-03T19:38:08.499158] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:08.524842] [DEBUG] [LOCAL ] IRS: Loaded 24281 existing records from primary storage. [2025-11-03T19:38:08.525211] [INFO ] [MAIN ] IRS: Loaded 24281 existing records. [2025-11-03T19:38:08.707507] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:08.707828] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-11-03T19:38:08.707887] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-11-03T19:38:08.708442] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-11-03T19:38:08.708506] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-11-03T19:38:08.740102] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-11-03T19:38:09.134944] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:09.189314] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:38:09.534936] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-11-03T19:38:10.115457] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-11-03T19:38:10.334865] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-11. [2025-11-03T19:38:10.789516] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:38:11.134864] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-11-03T19:38:11.494280] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T19:38:11.495804] [INFO ] [REMOTE ] IR: Full fetch complete (76513 records). [2025-11-03T19:38:11.495905] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-11-03T19:38:11.924531] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-11-03T19:38:11.924609] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-11-03T19:38:11.925568] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-11-03T19:38:11.925629] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-11-03T19:38:11.926982] [DEBUG] [LOCAL ] IR: Trimmed 76513 records to 52740 (keeping 200 days of data) [2025-11-03T19:38:11.980451] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-11-03T19:38:12.243473] [DEBUG] [LOCAL ] IR: Primary data saved (52740 records). [2025-11-03T19:38:12.243719] [INFO ] [MAIN ] IR: Full history saved. [2025-11-03T19:38:12.243809] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IR took 30.3s. Estimated remaining: 2h 55m 2s. Rate: 7.1 symbols/min [2025-11-03T19:38:12.423912] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:12.441140] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:38:12.495375] [DEBUG] [LOCAL ] IRT: Loaded 51059 existing records from primary storage. [2025-11-03T19:38:12.495766] [INFO ] [MAIN ] IRT: Loaded 51059 existing records. [2025-11-03T19:38:12.673125] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:12.673341] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-11-03T19:38:12.673446] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-11-03T19:38:12.674372] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-11-03T19:38:12.674429] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-11-03T19:38:12.740023] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-11-03T19:38:13.058419] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:13.263502] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T19:38:13.534852] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-11-03T19:38:14.084044] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T19:38:14.334888] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-11-03T19:38:14.879093] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:38:15.134866] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-11-03T19:38:15.746569] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-11-03T19:38:15.934905] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-11-03T19:38:16.653758] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T19:38:16.699379] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-11-03T19:38:16.734815] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-11-03T19:38:17.394750] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T19:38:17.534874] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-11-03T19:38:18.334933] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-11-03T19:38:18.660512] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:38:19.134906] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-11-03T19:38:19.576809] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T19:38:19.806603] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T19:38:19.934892] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-11. [2025-11-03T19:38:20.734913] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-11-03T19:38:21.031755] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:38:21.033169] [INFO ] [REMOTE ] IQV: Full fetch complete (72601 records). [2025-11-03T19:38:21.033261] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-11-03T19:38:21.427445] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-11-03T19:38:21.427605] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-11-03T19:38:21.428735] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-11-03T19:38:21.428800] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-11-03T19:38:21.430238] [DEBUG] [LOCAL ] IQV: Trimmed 72601 records to 49826 (keeping 200 days of data) [2025-11-03T19:38:21.535744] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-11-03T19:38:21.665257] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T19:38:21.766844] [DEBUG] [LOCAL ] IQV: Primary data saved (49826 records). [2025-11-03T19:38:21.766996] [INFO ] [MAIN ] IQV: Full history saved. [2025-11-03T19:38:21.767088] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IQV took 39.8s. Estimated remaining: 2h 54m 55s. Rate: 7.1 symbols/min [2025-11-03T19:38:21.941879] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:21.956908] [DEBUG] [LOCAL ] ISD: Loaded 15408 existing records from primary storage. [2025-11-03T19:38:21.957163] [INFO ] [MAIN ] ISD: Loaded 15408 existing records. [2025-11-03T19:38:22.130440] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:22.130704] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-11-03T19:38:22.130766] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-11-03T19:38:22.131118] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-11-03T19:38:22.131175] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-11-03T19:38:22.342183] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-11-03T19:38:22.476258] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:22.822617] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-11-03T19:38:23.134910] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-11-03T19:38:23.832367] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-11-03T19:38:23.934888] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-11-03T19:38:24.176670] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T19:38:24.734902] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-11-03T19:38:24.835442] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T19:38:25.534866] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-11-03T19:38:26.001612] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:38:26.242128] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:38:26.334854] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-11-03T19:38:27.115070] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T19:38:27.134860] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-11-03T19:38:27.909120] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-11-03T19:38:27.934819] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-11-03T19:38:28.734831] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-11-03T19:38:28.876001] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T19:38:29.358600] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T19:38:29.534926] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-11-03T19:38:30.334886] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-11-03T19:38:30.829794] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T19:38:30.957091] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-11-03T19:38:31.134892] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-11-03T19:38:31.934839] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-11-03T19:38:32.042410] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-11-03T19:38:32.739490] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-11. [2025-11-03T19:38:32.741396] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-11-03T19:38:33.527533] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T19:38:33.528715] [INFO ] [REMOTE ] IRS: Full fetch complete (33075 records). [2025-11-03T19:38:33.528792] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-11-03T19:38:33.540460] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-11-03T19:38:33.922006] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-11-03T19:38:33.922082] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-11-03T19:38:33.922719] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-11-03T19:38:33.922779] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-11-03T19:38:33.923479] [DEBUG] [LOCAL ] IRS: Trimmed 33075 records to 24001 (keeping 200 days of data) [2025-11-03T19:38:34.055859] [DEBUG] [LOCAL ] IRS: Primary data saved (24001 records). [2025-11-03T19:38:34.055979] [INFO ] [MAIN ] IRS: Full history saved. [2025-11-03T19:38:34.056054] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IRS took 25.7s. Estimated remaining: 2h 54m 51s. Rate: 7.1 symbols/min [2025-11-03T19:38:34.224603] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:34.261030] [DEBUG] [LOCAL ] IT: Loaded 42733 existing records from primary storage. [2025-11-03T19:38:34.261308] [INFO ] [MAIN ] IT: Loaded 42733 existing records. [2025-11-03T19:38:34.339973] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-11-03T19:38:34.448435] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:34.448891] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-11-03T19:38:34.448949] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-11-03T19:38:34.450017] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-11-03T19:38:34.450075] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-11-03T19:38:34.810273] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:35.011312] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:38:35.134839] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-11-03T19:38:35.700821] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T19:38:35.934853] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-11-03T19:38:36.433980] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-11-03T19:38:36.734892] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-11-03T19:38:37.170330] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:38:37.220414] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-11-03T19:38:37.534885] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-11-03T19:38:38.334873] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-11-03T19:38:38.809581] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-11-03T19:38:39.134882] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-11-03T19:38:39.719510] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T19:38:39.934913] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-11. [2025-11-03T19:38:40.164675] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-11-03T19:38:40.734911] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-11-03T19:38:40.953883] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-11 (1.02 seconds). [2025-11-03T19:38:40.955368] [INFO ] [REMOTE ] IRM: Full fetch complete (71738 records). [2025-11-03T19:38:40.955471] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-11-03T19:38:41.343406] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-11-03T19:38:41.343480] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-11-03T19:38:41.344391] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-11-03T19:38:41.344454] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-11-03T19:38:41.345880] [DEBUG] [LOCAL ] IRM: Trimmed 71738 records to 48512 (keeping 200 days of data) [2025-11-03T19:38:41.557965] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-11-03T19:38:41.641301] [DEBUG] [LOCAL ] IRM: Primary data saved (48512 records). [2025-11-03T19:38:41.641421] [INFO ] [MAIN ] IRM: Full history saved. [2025-11-03T19:38:41.642331] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IRM took 40.3s. Estimated remaining: 2h 54m 41s. Rate: 7.1 symbols/min [2025-11-03T19:38:41.813056] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:41.844176] [DEBUG] [LOCAL ] ITGR: Loaded 32079 existing records from primary storage. [2025-11-03T19:38:41.844523] [INFO ] [MAIN ] ITGR: Loaded 32079 existing records. [2025-11-03T19:38:41.953059] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T19:38:42.044639] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:42.044881] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-11-03T19:38:42.044928] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-11-03T19:38:42.045461] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-11-03T19:38:42.045518] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-11-03T19:38:42.340056] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-11-03T19:38:42.397501] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:42.724982] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-11-03T19:38:43.134889] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-11-03T19:38:43.543260] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T19:38:43.756925] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T19:38:43.934908] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-11-03T19:38:44.734908] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-11-03T19:38:45.295919] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T19:38:45.445183] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:38:45.534870] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-11-03T19:38:46.283623] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-11-03T19:38:46.334866] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-11-03T19:38:46.967258] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-11-03T19:38:47.134939] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-11-03T19:38:47.841678] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-11-03T19:38:47.934881] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-11-03T19:38:48.734849] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-11-03T19:38:48.773821] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T19:38:49.423014] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T19:38:49.534876] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-11-03T19:38:50.334896] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-11-03T19:38:50.821573] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-11-03T19:38:51.134866] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-11. [2025-11-03T19:38:51.428355] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-11-03T19:38:51.650534] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-11 (0.52 seconds). [2025-11-03T19:38:51.651364] [INFO ] [REMOTE ] ISD: Full fetch complete (23395 records). [2025-11-03T19:38:51.651430] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-11-03T19:38:51.938468] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-11-03T19:38:52.022555] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-11-03T19:38:52.022628] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-11-03T19:38:52.023132] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-11-03T19:38:52.023179] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-11-03T19:38:52.023771] [DEBUG] [LOCAL ] ISD: Trimmed 23395 records to 15098 (keeping 200 days of data) [2025-11-03T19:38:52.111607] [DEBUG] [LOCAL ] ISD: Primary data saved (15098 records). [2025-11-03T19:38:52.111754] [INFO ] [MAIN ] ISD: Full history saved. [2025-11-03T19:38:52.111833] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. ISD took 30.3s. Estimated remaining: 2h 54m 35s. Rate: 7.1 symbols/min [2025-11-03T19:38:52.281940] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:52.311791] [DEBUG] [LOCAL ] ITT: Loaded 32531 existing records from primary storage. [2025-11-03T19:38:52.312046] [INFO ] [MAIN ] ITT: Loaded 32531 existing records. [2025-11-03T19:38:52.489180] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:52.489402] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-11-03T19:38:52.489463] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-11-03T19:38:52.490093] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-11-03T19:38:52.490191] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-11-03T19:38:52.740189] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-11-03T19:38:52.853952] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:53.106478] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T19:38:53.534858] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-11. [2025-11-03T19:38:54.005921] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-11-03T19:38:54.334877] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-11-03T19:38:54.721497] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T19:38:54.722956] [INFO ] [REMOTE ] IRT: Full fetch complete (72976 records). [2025-11-03T19:38:54.723051] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-11-03T19:38:55.109937] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-11-03T19:38:55.110026] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-11-03T19:38:55.111016] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-11-03T19:38:55.111080] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-11-03T19:38:55.112503] [DEBUG] [LOCAL ] IRT: Trimmed 72976 records to 50368 (keeping 200 days of data) [2025-11-03T19:38:55.164316] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-11-03T19:38:55.428766] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-11-03T19:38:55.451016] [DEBUG] [LOCAL ] IRT: Primary data saved (50368 records). [2025-11-03T19:38:55.451121] [INFO ] [MAIN ] IRT: Full history saved. [2025-11-03T19:38:55.451208] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRT took 43.2s. Estimated remaining: 2h 54m 21s. Rate: 7.1 symbols/min [2025-11-03T19:38:55.619250] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:38:55.665082] [DEBUG] [LOCAL ] ITUB: Loaded 54073 existing records from primary storage. [2025-11-03T19:38:55.665405] [INFO ] [MAIN ] ITUB: Loaded 54073 existing records. [2025-11-03T19:38:55.844525] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:38:55.844748] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-11-03T19:38:55.844800] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-11-03T19:38:55.845690] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-11-03T19:38:55.845748] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-11-03T19:38:55.944071] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-11-03T19:38:56.254967] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:38:56.583156] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-11-03T19:38:56.734866] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-11-03T19:38:56.786909] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-11-03T19:38:57.534848] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-11-03T19:38:57.798484] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-11-03T19:38:58.334852] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-11-03T19:38:58.501035] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-11-03T19:38:59.134845] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-11-03T19:38:59.416731] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:38:59.934850] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-11-03T19:39:00.734832] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-11-03T19:39:01.153963] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-11-03T19:39:01.354157] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-11-03T19:39:01.447324] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-11-03T19:39:01.534817] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-11-03T19:39:02.334881] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-11-03T19:39:02.742415] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:39:03.134907] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-11-03T19:39:03.934933] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-11-03T19:39:04.167889] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-11-03T19:39:04.345316] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-11-03T19:39:04.734893] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-11-03T19:39:05.123053] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T19:39:05.534934] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-11-03T19:39:06.059535] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T19:39:06.334870] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-11-03T19:39:06.763326] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T19:39:07.134902] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-11-03T19:39:07.768012] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T19:39:07.934832] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-11-03T19:39:08.077289] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T19:39:08.734894] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-11. [2025-11-03T19:39:09.374865] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T19:39:09.534858] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-11-03T19:39:09.787596] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T19:39:09.788970] [INFO ] [REMOTE ] ITGR: Full fetch complete (45118 records). [2025-11-03T19:39:09.789069] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-11-03T19:39:10.167581] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-11-03T19:39:10.167678] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-11-03T19:39:10.168409] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-11-03T19:39:10.168451] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-11-03T19:39:10.169349] [DEBUG] [LOCAL ] ITGR: Trimmed 45118 records to 31278 (keeping 200 days of data) [2025-11-03T19:39:10.339014] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-11-03T19:39:10.359888] [DEBUG] [LOCAL ] ITGR: Primary data saved (31278 records). [2025-11-03T19:39:10.360309] [INFO ] [MAIN ] ITGR: Full history saved. [2025-11-03T19:39:10.360405] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. ITGR took 28.7s. Estimated remaining: 2h 54m 20s. Rate: 7.1 symbols/min [2025-11-03T19:39:10.533211] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:10.574760] [DEBUG] [LOCAL ] ITW: Loaded 46225 existing records from primary storage. [2025-11-03T19:39:10.575157] [INFO ] [MAIN ] ITW: Loaded 46225 existing records. [2025-11-03T19:39:10.763602] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:39:10.763879] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-11-03T19:39:10.764044] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-11-03T19:39:10.771740] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-11-03T19:39:10.784422] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-11-03T19:39:10.857846] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-11-03T19:39:11.135261] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-11-03T19:39:11.163084] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:11.361924] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-11-03T19:39:11.934933] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-11-03T19:39:12.448446] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T19:39:12.734839] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-11-03T19:39:13.534820] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-11-03T19:39:13.552527] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-11-03T19:39:13.587299] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-11-03T19:39:14.334857] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-11-03T19:39:14.758134] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T19:39:15.134846] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-11-03T19:39:15.559849] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T19:39:15.934848] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-11-03T19:39:16.612885] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-11-03T19:39:16.734874] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-11-03T19:39:17.407012] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-11-03T19:39:17.534831] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-11-03T19:39:17.637343] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-11-03T19:39:18.334854] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-11-03T19:39:18.812826] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-11-03T19:39:19.134884] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-11-03T19:39:19.500806] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-11-03T19:39:19.934903] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-11-03T19:39:20.541115] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:39:20.734906] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-11-03T19:39:21.428010] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-11-03T19:39:21.534862] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-11-03T19:39:21.796419] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-11-03T19:39:22.334876] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-11-03T19:39:23.065967] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T19:39:23.134859] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-11. [2025-11-03T19:39:23.611843] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T19:39:23.935061] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-11. [2025-11-03T19:39:24.036478] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T19:39:24.038035] [INFO ] [REMOTE ] ITT: Full fetch complete (48051 records). [2025-11-03T19:39:24.038158] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-11-03T19:39:24.513377] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-11-03T19:39:24.513456] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-11-03T19:39:24.514365] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-11-03T19:39:24.514427] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-11-03T19:39:24.515400] [DEBUG] [LOCAL ] ITT: Trimmed 48051 records to 31756 (keeping 200 days of data) [2025-11-03T19:39:24.706425] [DEBUG] [LOCAL ] ITT: Primary data saved (31756 records). [2025-11-03T19:39:24.706556] [INFO ] [MAIN ] ITT: Full history saved. [2025-11-03T19:39:24.706632] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. ITT took 32.6s. Estimated remaining: 2h 54m 18s. Rate: 7.1 symbols/min [2025-11-03T19:39:24.738700] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-11-03T19:39:24.911629] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:24.961336] [DEBUG] [LOCAL ] IVR: Loaded 48289 existing records from primary storage. [2025-11-03T19:39:24.961896] [INFO ] [MAIN ] IVR: Loaded 48289 existing records. [2025-11-03T19:39:25.149981] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:39:25.150894] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-11 (1.22 seconds). [2025-11-03T19:39:25.151136] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-11-03T19:39:25.152400] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-11-03T19:39:25.152862] [INFO ] [REMOTE ] IT: Full fetch complete (58620 records). [2025-11-03T19:39:25.152978] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-11-03T19:39:25.158710] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-11-03T19:39:25.198196] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-11-03T19:39:25.536163] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-11. [2025-11-03T19:39:25.890928] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:25.910160] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-11-03T19:39:25.910217] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-11-03T19:39:25.910975] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-11-03T19:39:25.911036] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-11-03T19:39:25.912176] [DEBUG] [LOCAL ] IT: Trimmed 58620 records to 42374 (keeping 200 days of data) [2025-11-03T19:39:26.170000] [DEBUG] [LOCAL ] IT: Primary data saved (42374 records). [2025-11-03T19:39:26.170187] [INFO ] [MAIN ] IT: Full history saved. [2025-11-03T19:39:26.170284] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. IT took 52.1s. Estimated remaining: 2h 54m 2s. Rate: 7.1 symbols/min [2025-11-03T19:39:26.354326] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-11-03T19:39:26.357350] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:26.385759] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T19:39:26.422886] [DEBUG] [LOCAL ] IVT: Loaded 31663 existing records from primary storage. [2025-11-03T19:39:26.423143] [INFO ] [MAIN ] IVT: Loaded 31663 existing records. [2025-11-03T19:39:26.595109] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:39:26.595344] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-11-03T19:39:26.595391] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-11-03T19:39:26.596017] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-11-03T19:39:26.596074] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-11-03T19:39:26.855098] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T19:39:26.877915] [INFO ] [REMOTE ] ITUB: Full fetch complete (77298 records). [2025-11-03T19:39:26.888560] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-11-03T19:39:27.052111] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:27.139367] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-11-03T19:39:27.350559] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-11-03T19:39:27.350666] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-11-03T19:39:27.351664] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-11-03T19:39:27.351727] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-11-03T19:39:27.353197] [DEBUG] [LOCAL ] ITUB: Trimmed 77298 records to 53298 (keeping 200 days of data) [2025-11-03T19:39:27.663343] [DEBUG] [LOCAL ] ITUB: Primary data saved (53298 records). [2025-11-03T19:39:27.663493] [INFO ] [MAIN ] ITUB: Full history saved. [2025-11-03T19:39:27.663729] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITUB took 32.2s. Estimated remaining: 2h 53m 46s. Rate: 7.1 symbols/min [2025-11-03T19:39:27.831707] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:27.862871] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T19:39:27.919366] [DEBUG] [LOCAL ] IVZ: Loaded 53906 existing records from primary storage. [2025-11-03T19:39:27.919743] [INFO ] [MAIN ] IVZ: Loaded 53906 existing records. [2025-11-03T19:39:27.940994] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-11-03T19:39:28.097575] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:39:28.097850] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-11-03T19:39:28.097927] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-11-03T19:39:28.099037] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-11-03T19:39:28.099093] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-11-03T19:39:28.468812] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:28.533932] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T19:39:28.734833] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-11-03T19:39:28.836146] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-11-03T19:39:29.534876] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-11-03T19:39:30.261479] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-11-03T19:39:30.334829] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-11-03T19:39:30.535913] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T19:39:31.134900] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-11-03T19:39:31.513748] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-11-03T19:39:31.934830] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-11-03T19:39:32.143715] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-11-03T19:39:32.734896] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-11-03T19:39:33.085728] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T19:39:33.534864] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-11-03T19:39:34.090301] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T19:39:34.334862] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-11-03T19:39:34.618985] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-11-03T19:39:35.134858] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-11-03T19:39:35.727492] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T19:39:35.934849] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-11-03T19:39:36.368570] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T19:39:36.734829] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-11-03T19:39:36.826305] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-11-03T19:39:37.534888] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-11-03T19:39:38.131596] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T19:39:38.334836] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-11-03T19:39:38.399704] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:39:39.134866] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-11-03T19:39:39.727882] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T19:39:39.934873] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-11-03T19:39:40.566549] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-11-03T19:39:40.734917] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-11-03T19:39:41.460923] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T19:39:41.534857] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-11-03T19:39:41.614319] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-11-03T19:39:42.334921] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-11-03T19:39:43.002857] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:39:43.134868] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-11-03T19:39:43.431015] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T19:39:43.934938] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-11-03T19:39:44.342123] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-11-03T19:39:44.734886] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-11-03T19:39:44.841615] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T19:39:45.534937] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-11-03T19:39:46.099842] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T19:39:46.334864] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-11-03T19:39:46.723517] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:39:47.134915] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-11-03T19:39:47.204797] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-11-03T19:39:47.934915] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-11-03T19:39:48.700384] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T19:39:48.734845] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-11-03T19:39:49.263430] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T19:39:49.534931] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-11. [2025-11-03T19:39:50.247758] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-11-03T19:39:50.334851] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-11-03T19:39:50.867278] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-11 (1.33 seconds). [2025-11-03T19:39:50.868816] [INFO ] [REMOTE ] ITW: Full fetch complete (67107 records). [2025-11-03T19:39:50.868936] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-11-03T19:39:51.140018] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-11-03T19:39:51.251328] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-11-03T19:39:51.251411] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-11-03T19:39:51.252535] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-11-03T19:39:51.252601] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-11-03T19:39:51.253941] [DEBUG] [LOCAL ] ITW: Trimmed 67107 records to 45555 (keeping 200 days of data) [2025-11-03T19:39:51.548882] [DEBUG] [LOCAL ] ITW: Primary data saved (45555 records). [2025-11-03T19:39:51.549200] [INFO ] [MAIN ] ITW: Full history saved. [2025-11-03T19:39:51.550233] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. ITW took 41.2s. Estimated remaining: 2h 53m 54s. Rate: 7.1 symbols/min [2025-11-03T19:39:51.720514] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:51.720805] [DEBUG] [LOCAL ] IX: No existing data file found in primary storage. [2025-11-03T19:39:51.720907] [WARN ] [MAIN ] IX: No existing data found, performing full refresh instead. [2025-11-03T19:39:51.721167] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-11-03T19:39:51.721300] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-11-03T19:39:51.721535] [DEBUG] [LOCAL ] IX: No primary data file found to delete. [2025-11-03T19:39:51.721603] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-11-03T19:39:51.935535] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-11-03T19:39:52.059300] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-11-03T19:39:52.142925] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:52.225231] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T19:39:52.734883] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-11-03T19:39:53.448012] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-11-03T19:39:53.534852] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-11-03T19:39:54.261040] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T19:39:54.334822] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-11. [2025-11-03T19:39:54.620445] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T19:39:55.134869] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-11-03T19:39:55.438262] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:39:55.439852] [INFO ] [REMOTE ] IVZ: Full fetch complete (77086 records). [2025-11-03T19:39:55.439954] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-11-03T19:39:55.682695] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T19:39:55.853828] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-11-03T19:39:55.853917] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-11-03T19:39:55.854936] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-11-03T19:39:55.855018] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-11-03T19:39:55.856557] [DEBUG] [LOCAL ] IVZ: Trimmed 77086 records to 53126 (keeping 200 days of data) [2025-11-03T19:39:55.947003] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-11. [2025-11-03T19:39:56.182834] [DEBUG] [LOCAL ] IVZ: Primary data saved (53126 records). [2025-11-03T19:39:56.182969] [INFO ] [MAIN ] IVZ: Full history saved. [2025-11-03T19:39:56.183531] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. IVZ took 28.5s. Estimated remaining: 2h 53m 41s. Rate: 7.1 symbols/min [2025-11-03T19:39:56.359697] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:56.400688] [DEBUG] [LOCAL ] J: Loaded 41158 existing records from primary storage. [2025-11-03T19:39:56.400970] [INFO ] [MAIN ] J: Loaded 41158 existing records. [2025-11-03T19:39:56.583678] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:39:56.583944] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-11-03T19:39:56.583991] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-11-03T19:39:56.584909] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-11-03T19:39:56.584970] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-11-03T19:39:56.738596] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-11-03T19:39:56.846007] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T19:39:56.879716] [INFO ] [REMOTE ] IVT: Full fetch complete (45843 records). [2025-11-03T19:39:56.885954] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-11-03T19:39:56.980866] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:57.352913] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-11-03T19:39:57.353011] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-11-03T19:39:57.353856] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-11-03T19:39:57.353920] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-11-03T19:39:57.355102] [DEBUG] [LOCAL ] IVT: Trimmed 45843 records to 31214 (keeping 200 days of data) [2025-11-03T19:39:57.540296] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-11-03T19:39:57.540182] [DEBUG] [LOCAL ] IVT: Primary data saved (31214 records). [2025-11-03T19:39:57.540608] [INFO ] [MAIN ] IVT: Full history saved. [2025-11-03T19:39:57.541598] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. IVT took 31.4s. Estimated remaining: 2h 53m 25s. Rate: 7.1 symbols/min [2025-11-03T19:39:57.717288] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:39:57.754585] [DEBUG] [LOCAL ] JBGS: Loaded 41752 existing records from primary storage. [2025-11-03T19:39:57.755005] [INFO ] [MAIN ] JBGS: Loaded 41752 existing records. [2025-11-03T19:39:57.935926] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:39:57.936141] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-11-03T19:39:57.936194] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-11-03T19:39:57.936928] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-11-03T19:39:57.936985] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-11-03T19:39:58.224560] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T19:39:58.323213] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:39:58.339942] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-11-03T19:39:58.352503] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-11-03T19:39:59.134847] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-11-03T19:39:59.316279] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T19:39:59.934847] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-11-03T19:40:00.734819] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-11-03T19:40:00.800463] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T19:40:00.801535] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:40:01.534832] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-11-03T19:40:01.621969] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-11-03T19:40:02.334882] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-11-03T19:40:02.597690] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T19:40:03.134874] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-11-03T19:40:03.943713] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-11-03T19:40:03.976399] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-11-03T19:40:04.201826] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-11-03T19:40:04.734855] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-11-03T19:40:05.122320] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T19:40:05.534902] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-11-03T19:40:05.886549] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T19:40:06.334908] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-11-03T19:40:06.730512] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T19:40:07.134845] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-11-03T19:40:07.548734] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:40:07.934891] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-11. [2025-11-03T19:40:08.008347] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-11-03T19:40:08.734873] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-11-03T19:40:09.534859] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-11-03T19:40:09.589607] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-11 (1.65 seconds). [2025-11-03T19:40:09.591054] [INFO ] [REMOTE ] IVR: Full fetch complete (69053 records). [2025-11-03T19:40:09.591168] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-11-03T19:40:09.991575] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-11-03T19:40:09.991724] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-11-03T19:40:09.992780] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-11-03T19:40:09.992866] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-11-03T19:40:10.024375] [DEBUG] [LOCAL ] IVR: Trimmed 69053 records to 47524 (keeping 200 days of data) [2025-11-03T19:40:10.027029] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T19:40:10.308030] [DEBUG] [LOCAL ] IVR: Primary data saved (47524 records). [2025-11-03T19:40:10.308181] [INFO ] [MAIN ] IVR: Full history saved. [2025-11-03T19:40:10.308272] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. IVR took 45.6s. Estimated remaining: 2h 53m 21s. Rate: 7.1 symbols/min [2025-11-03T19:40:10.339924] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-11-03T19:40:10.494826] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-11-03T19:40:10.498149] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:10.538690] [DEBUG] [LOCAL ] JBI: Loaded 42497 existing records from primary storage. [2025-11-03T19:40:10.538977] [INFO ] [MAIN ] JBI: Loaded 42497 existing records. [2025-11-03T19:40:10.714582] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:10.714803] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-11-03T19:40:10.714851] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-11-03T19:40:10.715523] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-11-03T19:40:10.715581] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-11-03T19:40:11.069660] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:11.134844] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-11-03T19:40:11.640719] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T19:40:11.934899] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-11-03T19:40:12.483303] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-11-03T19:40:12.734831] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-11-03T19:40:12.831281] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T19:40:13.534901] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-11-03T19:40:13.905526] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T19:40:14.334873] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-11-03T19:40:14.569517] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T19:40:15.134865] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-11-03T19:40:15.376542] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:40:15.934909] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-11-03T19:40:16.255126] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T19:40:16.650011] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-11-03T19:40:16.734851] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-11-03T19:40:17.534903] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-11-03T19:40:17.816869] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:40:18.334830] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-11-03T19:40:18.697555] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T19:40:19.134863] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-11-03T19:40:19.542025] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:40:19.934904] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-11-03T19:40:20.163389] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T19:40:20.503930] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T19:40:20.734910] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-11-03T19:40:21.534869] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-11-03T19:40:21.944078] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T19:40:22.334856] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-11-03T19:40:22.389201] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-11-03T19:40:23.134961] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-11. [2025-11-03T19:40:23.566239] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-11-03T19:40:23.924208] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-11 (0.79 seconds). [2025-11-03T19:40:23.925160] [INFO ] [REMOTE ] IX: Full fetch complete (29347 records). [2025-11-03T19:40:23.925230] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-11-03T19:40:23.940081] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-11-03T19:40:24.290466] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-11-03T19:40:24.290539] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-11-03T19:40:24.291123] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-11-03T19:40:24.291183] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-11-03T19:40:24.291861] [DEBUG] [LOCAL ] IX: Trimmed 29347 records to 21306 (keeping 200 days of data) [2025-11-03T19:40:24.414075] [DEBUG] [LOCAL ] IX: Primary data saved (21306 records). [2025-11-03T19:40:24.414199] [INFO ] [MAIN ] IX: Full history saved. [2025-11-03T19:40:24.414272] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IX took 32.9s. Estimated remaining: 2h 53m 19s. Rate: 7.1 symbols/min [2025-11-03T19:40:24.579744] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:24.622399] [DEBUG] [LOCAL ] JBL: Loaded 48765 existing records from primary storage. [2025-11-03T19:40:24.622707] [INFO ] [MAIN ] JBL: Loaded 48765 existing records. [2025-11-03T19:40:24.739992] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-11-03T19:40:24.799332] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:24.799585] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-11-03T19:40:24.799706] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-11-03T19:40:24.800492] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-11-03T19:40:24.800548] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-11-03T19:40:25.168756] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:25.192072] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-11-03T19:40:25.534851] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-11-03T19:40:25.895990] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T19:40:26.334856] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-11-03T19:40:26.846112] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:40:27.134913] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-11-03T19:40:27.423384] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T19:40:27.934910] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-11-03T19:40:28.156706] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-11-03T19:40:28.734902] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-11-03T19:40:29.157066] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T19:40:29.534865] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-11-03T19:40:29.905937] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:40:30.334883] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-11. [2025-11-03T19:40:30.868970] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T19:40:31.134878] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-11-03T19:40:31.242466] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-11 (0.91 seconds). [2025-11-03T19:40:31.244210] [INFO ] [REMOTE ] JBGS: Full fetch complete (59173 records). [2025-11-03T19:40:31.244357] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-11-03T19:40:31.654270] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-11-03T19:40:31.654412] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-11-03T19:40:31.655448] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-11-03T19:40:31.655520] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-11-03T19:40:31.656835] [DEBUG] [LOCAL ] JBGS: Trimmed 59173 records to 41125 (keeping 200 days of data) [2025-11-03T19:40:31.924538] [DEBUG] [LOCAL ] JBGS: Primary data saved (41125 records). [2025-11-03T19:40:31.924688] [INFO ] [MAIN ] JBGS: Full history saved. [2025-11-03T19:40:31.924778] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. JBGS took 34.4s. Estimated remaining: 2h 53m 10s. Rate: 7.1 symbols/min [2025-11-03T19:40:31.945487] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-11-03T19:40:32.094520] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:32.122442] [DEBUG] [LOCAL ] JBND: Loaded 28197 existing records from primary storage. [2025-11-03T19:40:32.122747] [INFO ] [MAIN ] JBND: Loaded 28197 existing records. [2025-11-03T19:40:32.322077] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:32.322337] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-11-03T19:40:32.322386] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-11-03T19:40:32.322981] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-11-03T19:40:32.323041] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-11-03T19:40:32.704011] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:32.733970] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-11-03T19:40:32.743500] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-11-03T19:40:33.279171] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-11-03T19:40:33.534848] [INFO ] [REMOTE ] J: Fetching primary data for 2025-11. [2025-11-03T19:40:33.556411] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T19:40:34.334905] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-11-03T19:40:34.552838] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-11 (1.02 seconds). [2025-11-03T19:40:34.554343] [INFO ] [REMOTE ] J: Full fetch complete (60123 records). [2025-11-03T19:40:34.554445] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-11-03T19:40:35.015541] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-11-03T19:40:35.015690] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-11-03T19:40:35.016733] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-11-03T19:40:35.016818] [DEBUG] [LOCAL ] J: Saving primary data. [2025-11-03T19:40:35.018185] [DEBUG] [LOCAL ] J: Trimmed 60123 records to 40644 (keeping 200 days of data) [2025-11-03T19:40:35.136697] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-11-03T19:40:35.289346] [DEBUG] [LOCAL ] J: Primary data saved (40644 records). [2025-11-03T19:40:35.289465] [INFO ] [MAIN ] J: Full history saved. [2025-11-03T19:40:35.289540] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. J took 39.1s. Estimated remaining: 2h 52m 56s. Rate: 7.1 symbols/min [2025-11-03T19:40:35.480884] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:35.481135] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-11-03T19:40:35.481209] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-11-03T19:40:35.481437] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-11-03T19:40:35.481561] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-11-03T19:40:35.481686] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-11-03T19:40:35.481785] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-11-03T19:40:35.801976] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:40:35.874583] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:35.887460] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T19:40:35.934828] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-11-03T19:40:36.088710] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:40:36.089179] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-11-03T19:40:36.089280] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:40:36.089335] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-11-03T19:40:36.089371] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:40:36.089416] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-11-03T19:40:36.089481] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-11-03T19:40:36.089520] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-11-03T19:40:36.089562] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-11-03T19:40:36.089615] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. JBS took 0.8s. Estimated remaining: 2h 52m 39s. Rate: 7.1 symbols/min [2025-11-03T19:40:36.270947] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:36.307131] [DEBUG] [LOCAL ] JBTM: Loaded 33495 existing records from primary storage. [2025-11-03T19:40:36.307461] [INFO ] [MAIN ] JBTM: Loaded 33495 existing records. [2025-11-03T19:40:36.520052] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:36.520298] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-11-03T19:40:36.520347] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-11-03T19:40:36.520995] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-11-03T19:40:36.521053] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-11-03T19:40:36.740061] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-11-03T19:40:36.892082] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:37.534840] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-11-03T19:40:37.673094] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T19:40:38.334853] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-11-03T19:40:38.525389] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T19:40:39.134827] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-11-03T19:40:39.317923] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-11-03T19:40:39.934857] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-11-03T19:40:40.621477] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T19:40:40.734814] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-11-03T19:40:40.780170] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-11-03T19:40:41.534879] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-11-03T19:40:41.776241] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-11-03T19:40:42.271044] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-11-03T19:40:42.334843] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-11-03T19:40:43.134905] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-11-03T19:40:43.406209] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T19:40:43.934821] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-11-03T19:40:44.066289] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-11-03T19:40:44.643978] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:40:44.734863] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-11. [2025-11-03T19:40:45.534862] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-11-03T19:40:45.711242] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T19:40:45.712599] [INFO ] [REMOTE ] JBI: Full fetch complete (62876 records). [2025-11-03T19:40:45.712724] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-11-03T19:40:46.099330] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-11-03T19:40:46.099406] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-11-03T19:40:46.100282] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-11-03T19:40:46.100355] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-11-03T19:40:46.101531] [DEBUG] [LOCAL ] JBI: Trimmed 62876 records to 41776 (keeping 200 days of data) [2025-11-03T19:40:46.334881] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-11-03T19:40:46.359446] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T19:40:46.359663] [DEBUG] [LOCAL ] JBI: Primary data saved (41776 records). [2025-11-03T19:40:46.365787] [INFO ] [MAIN ] JBI: Full history saved. [2025-11-03T19:40:46.366013] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBI took 36.1s. Estimated remaining: 2h 52m 32s. Rate: 7.1 symbols/min [2025-11-03T19:40:46.538191] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:46.546216] [DEBUG] [LOCAL ] JCE: Loaded 7178 existing records from primary storage. [2025-11-03T19:40:46.546438] [INFO ] [MAIN ] JCE: Loaded 7178 existing records. [2025-11-03T19:40:46.720639] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:46.720892] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-11-03T19:40:46.720939] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-11-03T19:40:46.721214] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-11-03T19:40:46.721272] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-11-03T19:40:47.068856] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:47.134848] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-11-03T19:40:47.701302] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T19:40:47.885351] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-11-03T19:40:47.934820] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-11-03T19:40:48.734843] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-11-03T19:40:48.859555] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-11-03T19:40:49.534848] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-11-03T19:40:49.802839] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-11-03T19:40:50.334851] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-11-03T19:40:50.857928] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T19:40:51.134935] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-11-03T19:40:51.421981] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T19:40:51.934859] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-11-03T19:40:52.440101] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T19:40:52.690419] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T19:40:52.734827] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-11-03T19:40:53.534874] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-11-03T19:40:54.334915] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-11-03T19:40:54.368456] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-11-03T19:40:54.415688] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T19:40:54.728616] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-11-03T19:40:55.134871] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-11. [2025-11-03T19:40:55.917142] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-11 (0.78 seconds). [2025-11-03T19:40:55.918359] [INFO ] [REMOTE ] JBND: Full fetch complete (37203 records). [2025-11-03T19:40:55.918431] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-11-03T19:40:55.939919] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-11. [2025-11-03T19:40:56.369851] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-11-03T19:40:56.369932] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-11-03T19:40:56.370560] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-11-03T19:40:56.370599] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-11-03T19:40:56.371496] [DEBUG] [LOCAL ] JBND: Trimmed 37203 records to 27965 (keeping 200 days of data) [2025-11-03T19:40:56.540879] [DEBUG] [LOCAL ] JBND: Primary data saved (27965 records). [2025-11-03T19:40:56.541027] [INFO ] [MAIN ] JBND: Full history saved. [2025-11-03T19:40:56.541143] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBND took 24.6s. Estimated remaining: 2h 52m 26s. Rate: 7.1 symbols/min [2025-11-03T19:40:56.725116] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:56.734853] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-11-03T19:40:56.774770] [DEBUG] [LOCAL ] JCI: Loaded 54284 existing records from primary storage. [2025-11-03T19:40:56.775074] [INFO ] [MAIN ] JCI: Loaded 54284 existing records. [2025-11-03T19:40:56.959542] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:56.959789] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-11-03T19:40:56.959839] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-11-03T19:40:56.960778] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-11-03T19:40:56.960836] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-11-03T19:40:57.261011] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T19:40:57.297223] [INFO ] [REMOTE ] JBL: Full fetch complete (70466 records). [2025-11-03T19:40:57.317473] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-11-03T19:40:57.373557] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:57.539984] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-11-03T19:40:57.729944] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-11-03T19:40:57.730204] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-11-03T19:40:57.731169] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-11-03T19:40:57.731253] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-11-03T19:40:57.732735] [DEBUG] [LOCAL ] JBL: Trimmed 70466 records to 48067 (keeping 200 days of data) [2025-11-03T19:40:57.862246] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-11-03T19:40:58.049772] [DEBUG] [LOCAL ] JBL: Primary data saved (48067 records). [2025-11-03T19:40:58.049897] [INFO ] [MAIN ] JBL: Full history saved. [2025-11-03T19:40:58.050914] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBL took 33.6s. Estimated remaining: 2h 52m 10s. Rate: 7.1 symbols/min [2025-11-03T19:40:58.218619] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:40:58.267457] [DEBUG] [LOCAL ] JEF: Loaded 50888 existing records from primary storage. [2025-11-03T19:40:58.267829] [INFO ] [MAIN ] JEF: Loaded 50888 existing records. [2025-11-03T19:40:58.340593] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-11-03T19:40:58.453249] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:40:58.453475] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-11-03T19:40:58.453526] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-11-03T19:40:58.454367] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-11-03T19:40:58.454426] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-11-03T19:40:58.816865] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:40:58.821845] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-11-03T19:40:58.858331] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-11-03T19:40:59.134852] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-11-03T19:40:59.934860] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-11-03T19:41:00.377483] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-11-03T19:41:00.734923] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-11-03T19:41:01.223576] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T19:41:01.534841] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-11-03T19:41:01.591111] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:41:02.334864] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-11-03T19:41:03.140049] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-11-03T19:41:03.158266] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-11-03T19:41:03.463856] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:41:03.934892] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-11-03T19:41:04.052122] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-11-03T19:41:04.734863] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-11-03T19:41:05.534939] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-11-03T19:41:05.580499] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-11-03T19:41:05.985319] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T19:41:06.334866] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-11-03T19:41:06.545566] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-11-03T19:41:07.134861] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-11-03T19:41:07.571435] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-11-03T19:41:07.934906] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-11-03T19:41:08.545237] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T19:41:08.734903] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-11-03T19:41:09.233912] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-11-03T19:41:09.534904] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-11-03T19:41:09.764938] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-11-03T19:41:10.334863] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-11-03T19:41:10.867144] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:41:11.134915] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-11-03T19:41:11.504711] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T19:41:11.594479] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T19:41:11.934879] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-11-03T19:41:12.734886] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-11-03T19:41:13.175744] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T19:41:13.534900] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-11-03T19:41:13.969540] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-11-03T19:41:14.121520] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T19:41:14.334842] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-11-03T19:41:15.134898] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-11. [2025-11-03T19:41:15.768747] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T19:41:15.934870] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-11-03T19:41:16.080733] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-11 (0.95 seconds). [2025-11-03T19:41:16.081886] [INFO ] [REMOTE ] JBTM: Full fetch complete (47001 records). [2025-11-03T19:41:16.081967] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-11-03T19:41:16.474040] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-11-03T19:41:16.474116] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-11-03T19:41:16.474846] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-11-03T19:41:16.474907] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-11-03T19:41:16.476199] [DEBUG] [LOCAL ] JBTM: Trimmed 47001 records to 32877 (keeping 200 days of data) [2025-11-03T19:41:16.676568] [DEBUG] [LOCAL ] JBTM: Primary data saved (32877 records). [2025-11-03T19:41:16.676705] [INFO ] [MAIN ] JBTM: Full history saved. [2025-11-03T19:41:16.676794] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBTM took 40.6s. Estimated remaining: 2h 52m 12s. Rate: 7.1 symbols/min [2025-11-03T19:41:16.742318] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-11-03T19:41:16.851853] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:41:16.891281] [DEBUG] [LOCAL ] JELD: Loaded 46026 existing records from primary storage. [2025-11-03T19:41:16.891576] [INFO ] [MAIN ] JELD: Loaded 46026 existing records. [2025-11-03T19:41:17.073126] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:41:17.073364] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-11-03T19:41:17.073426] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-11-03T19:41:17.074098] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-11-03T19:41:17.074155] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-11-03T19:41:17.450731] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:41:17.487675] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-11-03T19:41:17.534819] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-11-03T19:41:18.068812] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-11-03T19:41:18.334865] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-11-03T19:41:18.963158] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T19:41:19.134875] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-11-03T19:41:19.326884] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T19:41:19.934864] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-11-03T19:41:20.512531] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-11-03T19:41:20.734845] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-11-03T19:41:20.875430] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-11-03T19:41:21.534930] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-11-03T19:41:21.995281] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T19:41:22.243042] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T19:41:22.334820] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-11. [2025-11-03T19:41:23.134864] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-11-03T19:41:23.601475] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-11 (1.27 seconds). [2025-11-03T19:41:23.603099] [INFO ] [REMOTE ] JEF: Full fetch complete (73283 records). [2025-11-03T19:41:23.603212] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-11-03T19:41:23.711099] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T19:41:23.939983] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-11-03T19:41:24.016228] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-11-03T19:41:24.016332] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-11-03T19:41:24.017485] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-11-03T19:41:24.017552] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-11-03T19:41:24.019106] [DEBUG] [LOCAL ] JEF: Trimmed 73283 records to 50149 (keeping 200 days of data) [2025-11-03T19:41:24.325682] [DEBUG] [LOCAL ] JEF: Primary data saved (50149 records). [2025-11-03T19:41:24.325848] [INFO ] [MAIN ] JEF: Full history saved. [2025-11-03T19:41:24.326814] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JEF took 26.3s. Estimated remaining: 2h 52m 3s. Rate: 7.1 symbols/min [2025-11-03T19:41:24.497078] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:41:24.526024] [DEBUG] [LOCAL ] JFR: Loaded 31240 existing records from primary storage. [2025-11-03T19:41:24.526282] [INFO ] [MAIN ] JFR: Loaded 31240 existing records. [2025-11-03T19:41:24.713612] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:41:24.713848] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-11-03T19:41:24.713894] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-11-03T19:41:24.714405] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-11-03T19:41:24.714461] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-11-03T19:41:24.744376] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-11-03T19:41:25.075352] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:41:25.110758] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:41:25.534854] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-11-03T19:41:26.334841] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-11-03T19:41:26.496869] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-11-03T19:41:26.720258] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T19:41:27.134852] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-11-03T19:41:27.398556] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T19:41:27.557036] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-11-03T19:41:27.934850] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-11-03T19:41:28.441669] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-11-03T19:41:28.734819] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-11-03T19:41:29.233858] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-11-03T19:41:29.534883] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-11. [2025-11-03T19:41:30.334868] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-11-03T19:41:30.732407] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T19:41:30.734220] [INFO ] [REMOTE ] JCI: Full fetch complete (77654 records). [2025-11-03T19:41:30.734355] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-11-03T19:41:31.145148] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-11. [2025-11-03T19:41:31.170071] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-11-03T19:41:31.170150] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-11-03T19:41:31.171252] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-11-03T19:41:31.171324] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-11-03T19:41:31.173028] [DEBUG] [LOCAL ] JCI: Trimmed 77654 records to 53505 (keeping 200 days of data) [2025-11-03T19:41:31.526338] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:41:31.552984] [DEBUG] [LOCAL ] JCI: Primary data saved (53505 records). [2025-11-03T19:41:31.553086] [INFO ] [MAIN ] JCI: Full history saved. [2025-11-03T19:41:31.553154] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCI took 35.0s. Estimated remaining: 2h 51m 53s. Rate: 7.1 symbols/min [2025-11-03T19:41:31.729415] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-11 (0.58 seconds). [2025-11-03T19:41:31.751068] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:41:31.749432] [INFO ] [REMOTE ] JCE: Full fetch complete (9631 records). [2025-11-03T19:41:31.751217] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-11-03T19:41:31.912174] [DEBUG] [LOCAL ] JGH: Loaded 12433 existing records from primary storage. [2025-11-03T19:41:31.926214] [INFO ] [MAIN ] JGH: Loaded 12433 existing records. [2025-11-03T19:41:31.939915] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-11-03T19:41:32.346290] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:41:32.352797] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-11-03T19:41:32.352719] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-11-03T19:41:32.352908] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-11-03T19:41:32.353250] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-11-03T19:41:32.353322] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-11-03T19:41:32.353436] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-11-03T19:41:32.353840] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-11-03T19:41:32.354102] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-11-03T19:41:32.388999] [DEBUG] [LOCAL ] JCE: Trimmed 9631 records to 7143 (keeping 200 days of data) [2025-11-03T19:41:32.524035] [DEBUG] [LOCAL ] JCE: Primary data saved (7143 records). [2025-11-03T19:41:32.542442] [INFO ] [MAIN ] JCE: Full history saved. [2025-11-03T19:41:32.561226] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JCE took 46.2s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-11-03T19:41:32.742393] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-11-03T19:41:32.926004] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:41:32.941359] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:41:32.981160] [DEBUG] [LOCAL ] JHG: Loaded 48170 existing records from primary storage. [2025-11-03T19:41:32.981454] [INFO ] [MAIN ] JHG: Loaded 48170 existing records. [2025-11-03T19:41:33.185515] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:41:33.185819] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-11-03T19:41:33.186041] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-11-03T19:41:33.192963] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-11-03T19:41:33.204352] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-11-03T19:41:33.259837] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-11-03T19:41:33.542866] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-11-03T19:41:33.582321] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:41:33.923894] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T19:41:34.334848] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-11-03T19:41:34.531448] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-11-03T19:41:35.134901] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-11-03T19:41:35.508710] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:41:35.934832] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-11-03T19:41:36.122726] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-11-03T19:41:36.734832] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-11-03T19:41:36.895153] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-11-03T19:41:37.534853] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-11-03T19:41:37.931242] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-11-03T19:41:38.036474] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T19:41:38.334863] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-11-03T19:41:38.815222] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-11-03T19:41:39.134923] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-11-03T19:41:39.691610] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-11-03T19:41:39.934902] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-11-03T19:41:40.470501] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T19:41:40.734849] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-11-03T19:41:41.279698] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-11-03T19:41:41.534847] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-11-03T19:41:42.077095] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-11-03T19:41:42.334867] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-11-03T19:41:42.837575] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-11-03T19:41:43.134881] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-11-03T19:41:43.677902] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-11-03T19:41:43.934854] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-11-03T19:41:44.708182] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-11-03T19:41:44.734875] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-11-03T19:41:45.534906] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-11-03T19:41:45.906463] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-11-03T19:41:46.334835] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-11-03T19:41:46.357438] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T19:41:47.134856] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-11-03T19:41:47.533843] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T19:41:47.755183] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-11-03T19:41:47.934858] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-11. [2025-11-03T19:41:48.620571] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-11 (0.69 seconds). [2025-11-03T19:41:48.621414] [INFO ] [REMOTE ] JGH: Full fetch complete (16602 records). [2025-11-03T19:41:48.621500] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-11-03T19:41:48.740040] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-11-03T19:41:49.015328] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-11-03T19:41:49.015406] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-11-03T19:41:49.015829] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-11-03T19:41:49.015890] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-11-03T19:41:49.016385] [DEBUG] [LOCAL ] JGH: Trimmed 16602 records to 12320 (keeping 200 days of data) [2025-11-03T19:41:49.093893] [DEBUG] [LOCAL ] JGH: Primary data saved (12320 records). [2025-11-03T19:41:49.094025] [INFO ] [MAIN ] JGH: Full history saved. [2025-11-03T19:41:49.094111] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JGH took 17.5s. Estimated remaining: 2h 51m 37s. Rate: 7.1 symbols/min [2025-11-03T19:41:49.284892] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:41:49.290325] [DEBUG] [LOCAL ] JHI: Loaded 4111 existing records from primary storage. [2025-11-03T19:41:49.290512] [INFO ] [MAIN ] JHI: Loaded 4111 existing records. [2025-11-03T19:41:49.486824] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:41:49.487121] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-11-03T19:41:49.487177] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-11-03T19:41:49.487461] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-11-03T19:41:49.487518] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-11-03T19:41:49.545287] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-11-03T19:41:49.879616] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:41:49.962899] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T19:41:50.334853] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-11-03T19:41:51.134884] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-11-03T19:41:51.492612] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-11-03T19:41:51.930775] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-11-03T19:41:51.940278] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-11-03T19:41:52.034223] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-11-03T19:41:52.734861] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-11-03T19:41:53.102468] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-11-03T19:41:53.534841] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-11-03T19:41:53.887679] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-11-03T19:41:53.957522] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T19:41:54.334858] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-11-03T19:41:55.134818] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-11-03T19:41:55.506421] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T19:41:55.532895] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:41:55.934832] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-11-03T19:41:56.350506] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T19:41:56.734896] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-11-03T19:41:57.080292] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-11-03T19:41:57.534853] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-11-03T19:41:57.867443] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-11-03T19:41:58.334877] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-11-03T19:41:59.134878] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-11-03T19:41:59.243092] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-11-03T19:41:59.501084] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-11-03T19:41:59.934921] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-11-03T19:42:00.734906] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-11-03T19:42:01.278616] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-11-03T19:42:01.534929] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-11-03T19:42:01.978424] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-11-03T19:42:02.114768] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-11-03T19:42:02.334882] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-11-03T19:42:02.758141] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-11-03T19:42:03.134850] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-11-03T19:42:03.563857] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T19:42:03.934883] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-11-03T19:42:04.734821] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-11-03T19:42:04.949917] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-11-03T19:42:05.221668] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-11-03T19:42:05.534878] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-11. [2025-11-03T19:42:06.024532] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-11 (0.49 seconds). [2025-11-03T19:42:06.025232] [INFO ] [REMOTE ] JHI: Full fetch complete (5865 records). [2025-11-03T19:42:06.025299] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-11-03T19:42:06.339933] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-11-03T19:42:06.397925] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-11-03T19:42:06.398004] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-11-03T19:42:06.398168] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-11-03T19:42:06.398206] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-11-03T19:42:06.398602] [DEBUG] [LOCAL ] JHI: Trimmed 5865 records to 4031 (keeping 200 days of data) [2025-11-03T19:42:06.421838] [DEBUG] [LOCAL ] JHI: Primary data saved (4031 records). [2025-11-03T19:42:06.421907] [INFO ] [MAIN ] JHI: Full history saved. [2025-11-03T19:42:06.421974] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JHI took 17.3s. Estimated remaining: 2h 51m 38s. Rate: 7.1 symbols/min [2025-11-03T19:42:06.588304] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:06.592415] [DEBUG] [LOCAL ] JHS: Loaded 2996 existing records from primary storage. [2025-11-03T19:42:06.592564] [INFO ] [MAIN ] JHS: Loaded 2996 existing records. [2025-11-03T19:42:06.765130] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:42:06.765368] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-11-03T19:42:06.765415] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-11-03T19:42:06.765612] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-11-03T19:42:06.765710] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-11-03T19:42:07.113229] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:07.134814] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-11. [2025-11-03T19:42:07.498188] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-11-03T19:42:07.934817] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-11. [2025-11-03T19:42:07.953550] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T19:42:07.954715] [INFO ] [REMOTE ] JFR: Full fetch complete (48283 records). [2025-11-03T19:42:07.954793] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-11-03T19:42:08.336312] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-11-03T19:42:08.336400] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-11-03T19:42:08.337172] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-11-03T19:42:08.337237] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-11-03T19:42:08.338328] [DEBUG] [LOCAL ] JFR: Trimmed 48283 records to 30839 (keeping 200 days of data) [2025-11-03T19:42:08.514322] [DEBUG] [LOCAL ] JFR: Primary data saved (30839 records). [2025-11-03T19:42:08.514442] [INFO ] [MAIN ] JFR: Full history saved. [2025-11-03T19:42:08.514527] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JFR took 44.2s. Estimated remaining: 2h 51m 23s. Rate: 7.1 symbols/min [2025-11-03T19:42:08.721604] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:08.721798] [DEBUG] [LOCAL ] JHX: No existing data file found in primary storage. [2025-11-03T19:42:08.721842] [WARN ] [MAIN ] JHX: No existing data found, performing full refresh instead. [2025-11-03T19:42:08.721971] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-11-03T19:42:08.722029] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-11-03T19:42:08.722075] [DEBUG] [LOCAL ] JHX: No primary data file found to delete. [2025-11-03T19:42:08.722110] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-11-03T19:42:08.745344] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-11-03T19:42:09.030013] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-11 (1.10 seconds). [2025-11-03T19:42:09.062587] [INFO ] [REMOTE ] JELD: Full fetch complete (64557 records). [2025-11-03T19:42:09.078079] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-11-03T19:42:09.216143] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:09.466914] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-11-03T19:42:09.541790] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-11-03T19:42:09.542621] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-11-03T19:42:09.543447] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-11-03T19:42:09.544363] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-11-03T19:42:09.544496] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-11-03T19:42:09.545848] [DEBUG] [LOCAL ] JELD: Trimmed 64557 records to 45310 (keeping 200 days of data) [2025-11-03T19:42:09.787035] [DEBUG] [LOCAL ] JELD: Primary data saved (45310 records). [2025-11-03T19:42:09.787157] [INFO ] [MAIN ] JELD: Full history saved. [2025-11-03T19:42:09.787235] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JELD took 53.1s. Estimated remaining: 2h 51m 7s. Rate: 7.1 symbols/min [2025-11-03T19:42:09.952776] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:09.967616] [DEBUG] [LOCAL ] JILL: Loaded 15090 existing records from primary storage. [2025-11-03T19:42:09.967866] [INFO ] [MAIN ] JILL: Loaded 15090 existing records. [2025-11-03T19:42:10.141668] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:42:10.141843] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-11-03T19:42:10.141889] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-11-03T19:42:10.142240] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-11-03T19:42:10.142296] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-11-03T19:42:10.339977] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-11-03T19:42:10.496950] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:10.676461] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T19:42:11.134840] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-11-03T19:42:11.337074] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-11-03T19:42:11.934857] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-11-03T19:42:12.556947] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-11-03T19:42:12.706056] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:42:12.734811] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-11-03T19:42:13.293019] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T19:42:13.534859] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-11. [2025-11-03T19:42:14.334865] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-11-03T19:42:14.657452] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T19:42:14.658917] [INFO ] [REMOTE ] JHG: Full fetch complete (68932 records). [2025-11-03T19:42:14.659007] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-11-03T19:42:15.024547] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T19:42:15.066999] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-11-03T19:42:15.067080] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-11-03T19:42:15.068105] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-11-03T19:42:15.068170] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-11-03T19:42:15.069500] [DEBUG] [LOCAL ] JHG: Trimmed 68932 records to 47455 (keeping 200 days of data) [2025-11-03T19:42:15.156043] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-11-03T19:42:15.347089] [DEBUG] [LOCAL ] JHG: Primary data saved (47455 records). [2025-11-03T19:42:15.347215] [INFO ] [MAIN ] JHG: Full history saved. [2025-11-03T19:42:15.347289] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JHG took 42.8s. Estimated remaining: 2h 50m 55s. Rate: 7.1 symbols/min [2025-11-03T19:42:15.518180] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:15.553239] [DEBUG] [LOCAL ] JKS: Loaded 39317 existing records from primary storage. [2025-11-03T19:42:15.553516] [INFO ] [MAIN ] JKS: Loaded 39317 existing records. [2025-11-03T19:42:15.733685] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:42:15.733909] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-11-03T19:42:15.733974] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-11-03T19:42:15.734736] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-11-03T19:42:15.734799] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-11-03T19:42:15.940216] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-11-03T19:42:16.115825] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-11-03T19:42:16.120201] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:16.734901] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-11-03T19:42:17.010703] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-11-03T19:42:17.455017] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T19:42:17.534878] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-11-03T19:42:18.323915] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-11-03T19:42:18.334814] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-11-03T19:42:19.044852] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:42:19.134895] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-11-03T19:42:19.820281] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-11-03T19:42:19.934859] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-11-03T19:42:20.493889] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-11-03T19:42:20.734912] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-11-03T19:42:21.534896] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-11-03T19:42:22.129947] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-11-03T19:42:22.293272] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-11-03T19:42:22.334824] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-11-03T19:42:22.872584] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-11-03T19:42:23.134906] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-11-03T19:42:23.510673] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-11-03T19:42:23.934900] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-11-03T19:42:24.734887] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-11-03T19:42:25.224709] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T19:42:25.534866] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-11-03T19:42:25.983229] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:42:26.334881] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-11-03T19:42:26.675961] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-11-03T19:42:26.698347] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:42:27.134861] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-11-03T19:42:27.934856] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-11. [2025-11-03T19:42:28.356284] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T19:42:28.498357] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-11 (0.56 seconds). [2025-11-03T19:42:28.499183] [INFO ] [REMOTE ] JILL: Full fetch complete (22090 records). [2025-11-03T19:42:28.499251] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-11-03T19:42:28.741725] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-11-03T19:42:28.864207] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-11-03T19:42:28.864286] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-11-03T19:42:28.864791] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-11-03T19:42:28.864851] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-11-03T19:42:28.865397] [DEBUG] [LOCAL ] JILL: Trimmed 22090 records to 14808 (keeping 200 days of data) [2025-11-03T19:42:28.952006] [DEBUG] [LOCAL ] JILL: Primary data saved (14808 records). [2025-11-03T19:42:28.952141] [INFO ] [MAIN ] JILL: Full history saved. [2025-11-03T19:42:28.952219] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JILL took 19.2s. Estimated remaining: 2h 50m 52s. Rate: 7.1 symbols/min [2025-11-03T19:42:29.122805] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-11-03T19:42:29.126306] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:29.157208] [DEBUG] [LOCAL ] JLL: Loaded 31184 existing records from primary storage. [2025-11-03T19:42:29.157525] [INFO ] [MAIN ] JLL: Loaded 31184 existing records. [2025-11-03T19:42:29.330954] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:42:29.331177] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-11-03T19:42:29.331225] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-11-03T19:42:29.331799] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-11-03T19:42:29.331855] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-11-03T19:42:29.540062] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-11-03T19:42:29.695067] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:30.334855] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-11-03T19:42:31.061836] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-11-03T19:42:31.134906] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-11-03T19:42:31.438774] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-11-03T19:42:31.934907] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-11-03T19:42:32.287686] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-11-03T19:42:32.475014] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-11-03T19:42:32.734907] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-11-03T19:42:33.090798] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T19:42:33.534859] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-11-03T19:42:33.937251] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T19:42:34.334857] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-11-03T19:42:34.720315] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T19:42:35.134859] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-11-03T19:42:35.934837] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-11-03T19:42:35.994180] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-11-03T19:42:36.734877] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-11-03T19:42:37.328486] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-11-03T19:42:37.534869] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-11-03T19:42:37.689814] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-11-03T19:42:38.334852] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-11-03T19:42:38.712336] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-11-03T19:42:38.834893] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T19:42:39.134894] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-11-03T19:42:39.934873] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-11-03T19:42:40.101790] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-11-03T19:42:40.734851] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-11-03T19:42:40.799152] [DEBUG] [REMOTE ] JLL: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-11-03T19:42:40.799408] [WARN ] [REMOTE ] JLL: No data returned for month 2025-04 [2025-11-03T19:42:40.799494] [FATAL] [REMOTE ] JLL: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:42:40.799567] [FATAL] [MAIN ] JLL: Failed to fetch primary data. [2025-11-03T19:42:40.799631] [WARN ] [MAIN ] JLL: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:42:40.799752] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-11-03T19:42:40.799829] [DEBUG] [LOCAL ] JLL: No primary data file found to delete. [2025-11-03T19:42:40.799867] [INFO ] [LOCAL ] JLL: Starting deletion of derivative data. [2025-11-03T19:42:40.800058] [DEBUG] [LOCAL ] JLL: Deleted derivative data file. [2025-11-03T19:42:40.800143] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JLL took 11.8s. Estimated remaining: 2h 50m 47s. Rate: 7.1 symbols/min [2025-11-03T19:42:40.974364] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:40.979991] [DEBUG] [LOCAL ] JLS: Loaded 3911 existing records from primary storage. [2025-11-03T19:42:40.980184] [INFO ] [MAIN ] JLS: Loaded 3911 existing records. [2025-11-03T19:42:41.165928] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:42:41.166267] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-11-03T19:42:41.166369] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-11-03T19:42:41.166586] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-11-03T19:42:41.166678] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-11-03T19:42:41.511552] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-11-03T19:42:41.538562] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-11-03T19:42:41.657473] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:42.334906] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-11. [2025-11-03T19:42:42.739813] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-11-03T19:42:43.134887] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-11-03T19:42:43.348892] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-11 (1.01 seconds). [2025-11-03T19:42:43.350535] [INFO ] [REMOTE ] JHX: Full fetch complete (64674 records). [2025-11-03T19:42:43.350625] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-11-03T19:42:43.738192] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-11-03T19:42:43.782107] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-11-03T19:42:43.782197] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-11-03T19:42:43.783169] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-11-03T19:42:43.783242] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-11-03T19:42:43.784743] [DEBUG] [LOCAL ] JHX: Trimmed 64674 records to 53217 (keeping 200 days of data) [2025-11-03T19:42:43.949345] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-11-03T19:42:44.092960] [DEBUG] [LOCAL ] JHX: Primary data saved (53217 records). [2025-11-03T19:42:44.093086] [INFO ] [MAIN ] JHX: Full history saved. [2025-11-03T19:42:44.093155] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JHX took 35.6s. Estimated remaining: 2h 50m 34s. Rate: 7.1 symbols/min [2025-11-03T19:42:44.263054] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:44.311162] [DEBUG] [LOCAL ] JMIA: Loaded 51936 existing records from primary storage. [2025-11-03T19:42:44.311490] [INFO ] [MAIN ] JMIA: Loaded 51936 existing records. [2025-11-03T19:42:44.489435] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:42:44.489634] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-11-03T19:42:44.489716] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-11-03T19:42:44.490428] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-11-03T19:42:44.490487] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-11-03T19:42:44.739986] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-11-03T19:42:44.859982] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:45.164481] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-11-03T19:42:45.166056] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-11-03T19:42:45.534870] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-11-03T19:42:45.945566] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-11-03T19:42:46.334871] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-11-03T19:42:47.134861] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-11-03T19:42:47.335312] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-11-03T19:42:47.934896] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-11-03T19:42:48.285903] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:42:48.734901] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-11. [2025-11-03T19:42:48.966506] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:42:49.160805] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-11 (0.43 seconds). [2025-11-03T19:42:49.161478] [INFO ] [REMOTE ] JHS: Full fetch complete (4588 records). [2025-11-03T19:42:49.161546] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-11-03T19:42:49.517604] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-11-03T19:42:49.517702] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-11-03T19:42:49.517847] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-11-03T19:42:49.517887] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-11-03T19:42:49.518222] [DEBUG] [LOCAL ] JHS: Trimmed 4588 records to 2956 (keeping 200 days of data) [2025-11-03T19:42:49.534862] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-11-03T19:42:49.535631] [DEBUG] [LOCAL ] JHS: Primary data saved (2956 records). [2025-11-03T19:42:49.536890] [INFO ] [MAIN ] JHS: Full history saved. [2025-11-03T19:42:49.536981] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JHS took 43.1s. Estimated remaining: 2h 50m 22s. Rate: 7.1 symbols/min [2025-11-03T19:42:49.703455] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:42:49.703575] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-11-03T19:42:49.703612] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-11-03T19:42:49.703736] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-11-03T19:42:49.703777] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-11-03T19:42:49.703817] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-11-03T19:42:49.703847] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-11-03T19:42:49.975731] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-11-03T19:42:50.050730] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:42:50.334866] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-11-03T19:42:50.810561] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-11-03T19:42:51.134867] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-11-03T19:42:51.934850] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-11-03T19:42:52.323259] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-11-03T19:42:52.410512] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-11-03T19:42:52.734795] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-11-03T19:42:53.534884] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-11-03T19:42:53.933153] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T19:42:54.021905] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-11-03T19:42:54.334867] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-11-03T19:42:54.694268] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T19:42:55.134875] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-11-03T19:42:55.451116] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-11-03T19:42:55.934929] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-11. [2025-11-03T19:42:56.734912] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-11-03T19:42:56.824955] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-11 (0.89 seconds). [2025-11-03T19:42:56.826280] [INFO ] [REMOTE ] JKS: Full fetch complete (58524 records). [2025-11-03T19:42:56.826362] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-11-03T19:42:57.135624] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-11-03T19:42:57.231437] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-11-03T19:42:57.231526] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-11-03T19:42:57.232471] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-11-03T19:42:57.232538] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-11-03T19:42:57.233968] [DEBUG] [LOCAL ] JKS: Trimmed 58524 records to 38585 (keeping 200 days of data) [2025-11-03T19:42:57.461185] [DEBUG] [LOCAL ] JKS: Primary data saved (38585 records). [2025-11-03T19:42:57.461323] [INFO ] [MAIN ] JKS: Full history saved. [2025-11-03T19:42:57.461401] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JKS took 42.1s. Estimated remaining: 2h 50m 13s. Rate: 7.1 symbols/min [2025-11-03T19:42:57.534897] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-11-03T19:42:58.334933] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-11-03T19:42:58.613044] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-11-03T19:42:58.861622] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T19:42:59.134859] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-11-03T19:42:59.934922] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-11-03T19:43:00.165297] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-11-03T19:43:00.464776] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T19:43:00.734887] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-11-03T19:43:01.534913] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-11-03T19:43:01.835174] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-11-03T19:43:01.987977] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:43:02.334901] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-11-03T19:43:03.134917] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-11-03T19:43:03.534074] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T19:43:03.906373] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-11-03T19:43:03.934821] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-11-03T19:43:04.734890] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-10. [2025-11-03T19:43:05.097219] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-11-03T19:43:05.172510] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T19:43:05.534827] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-11-03T19:43:06.334860] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-11. [2025-11-03T19:43:06.695987] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-11 (0.36 seconds). [2025-11-03T19:43:06.696677] [INFO ] [REMOTE ] JLS: Full fetch complete (5731 records). [2025-11-03T19:43:06.696745] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-11-03T19:43:07.057047] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-11-03T19:43:07.057146] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-11-03T19:43:07.057372] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-11-03T19:43:07.057506] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-11-03T19:43:07.058149] [DEBUG] [LOCAL ] JLS: Trimmed 5731 records to 3816 (keeping 200 days of data) [2025-11-03T19:43:07.081756] [DEBUG] [LOCAL ] JLS: Primary data saved (3816 records). [2025-11-03T19:43:07.081861] [INFO ] [MAIN ] JLS: Full history saved. [2025-11-03T19:43:07.082009] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JLS took 26.3s. Estimated remaining: 2h 50m 6s. Rate: 7.1 symbols/min [2025-11-03T19:43:07.113700] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-11-03T19:43:07.134809] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-11-03T19:43:07.934905] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-11-03T19:43:08.325926] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-11-03T19:43:08.739958] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-11-03T19:43:08.757332] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-11-03T19:43:09.102366] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T19:43:09.534856] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-11-03T19:43:09.906974] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-11-03T19:43:10.334848] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-11-03T19:43:11.134909] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-11-03T19:43:11.437212] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-11-03T19:43:11.895900] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-11-03T19:43:11.934815] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-11-03T19:43:12.734906] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-11-03T19:43:13.077159] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-11-03T19:43:13.534880] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-11-03T19:43:13.705851] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-11-03T19:43:13.826091] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T19:43:14.334931] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-11. [2025-11-03T19:43:15.134857] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-11. [2025-11-03T19:43:15.497792] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-11 (0.36 seconds). [2025-11-03T19:43:15.498409] [INFO ] [REMOTE ] JMM: Full fetch complete (2331 records). [2025-11-03T19:43:15.498473] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-11-03T19:43:15.682031] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-11-03T19:43:15.682238] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:43:15.682306] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:43:15.682381] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-11-03T19:43:15.682447] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-11-03T19:43:15.682482] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-11-03T19:43:15.682524] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-11-03T19:43:15.682580] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JMM took 26.1s. Estimated remaining: 2h 49m 57s. Rate: 7.1 symbols/min [2025-11-03T19:43:15.795243] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T19:43:15.796716] [INFO ] [REMOTE ] JMIA: Full fetch complete (73517 records). [2025-11-03T19:43:15.796824] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-11-03T19:43:16.257476] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-11-03T19:43:16.257582] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-11-03T19:43:16.258563] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-11-03T19:43:16.258626] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-11-03T19:43:16.260036] [DEBUG] [LOCAL ] JMIA: Trimmed 73517 records to 51256 (keeping 200 days of data) [2025-11-03T19:43:16.548952] [DEBUG] [LOCAL ] JMIA: Primary data saved (51256 records). [2025-11-03T19:43:16.549081] [INFO ] [MAIN ] JMIA: Full history saved. [2025-11-03T19:43:16.550082] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JMIA took 32.5s. Estimated remaining: 2h 49m 41s. Rate: 7.1 symbols/min [2025-11-03T19:43:17.122693] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:17.238257] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:17.228042] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:17.255684] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:17.265567] [DEBUG] [LOCAL ] JOF: Loaded 7024 existing records from primary storage. [2025-11-03T19:43:17.266180] [INFO ] [MAIN ] JOF: Loaded 7024 existing records. [2025-11-03T19:43:17.447846] [DEBUG] [LOCAL ] JOE: Loaded 23537 existing records from primary storage. [2025-11-03T19:43:17.499603] [INFO ] [MAIN ] JOE: Loaded 23537 existing records. [2025-11-03T19:43:17.499282] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:17.571754] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-11-03T19:43:17.592191] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-11-03T19:43:17.592108] [DEBUG] [LOCAL ] JNJ: Loaded 54533 existing records from primary storage. [2025-11-03T19:43:17.619542] [INFO ] [MAIN ] JNJ: Loaded 54533 existing records. [2025-11-03T19:43:17.619440] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-11-03T19:43:17.623128] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-11-03T19:43:17.695084] [DEBUG] [LOCAL ] JOBY: Loaded 54590 existing records from primary storage. [2025-11-03T19:43:17.775020] [INFO ] [MAIN ] JOBY: Loaded 54590 existing records. [2025-11-03T19:43:17.875147] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:17.912613] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-11-03T19:43:17.991464] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-11-03T19:43:18.018322] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-11-03T19:43:18.023626] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-11-03T19:43:18.297327] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:18.313329] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-11-03T19:43:18.351127] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-11-03T19:43:18.422075] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:18.432699] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-11-03T19:43:18.432616] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-11-03T19:43:18.483168] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-11-03T19:43:18.508292] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-11-03T19:43:18.648197] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-11-03T19:43:18.709837] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-11-03T19:43:19.217611] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:19.264235] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-11-03T19:43:19.377907] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:19.418531] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-11-03T19:43:19.738537] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:19.749132] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-11-03T19:43:19.831685] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:19.832003] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-11-03T19:43:19.984146] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-11-03T19:43:19.985734] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-11-03T19:43:20.391881] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-11-03T19:43:20.391726] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-11-03T19:43:20.400869] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-11-03T19:43:20.734890] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-11-03T19:43:21.132525] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T19:43:21.180730] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-11-03T19:43:21.534828] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-11-03T19:43:21.745440] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-11-03T19:43:21.747702] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-11-03T19:43:22.064598] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-11-03T19:43:22.334846] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-11-03T19:43:23.134870] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-11-03T19:43:23.266016] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-11-03T19:43:23.934856] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-11-03T19:43:24.734839] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-11-03T19:43:24.959875] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-11-03T19:43:24.987004] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-11-03T19:43:25.130247] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-11-03T19:43:25.534917] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-11-03T19:43:26.334932] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-11-03T19:43:27.134878] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-11-03T19:43:27.192926] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-11-03T19:43:27.281093] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-11-03T19:43:27.574759] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-11-03T19:43:27.934862] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-11-03T19:43:28.362927] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-11-03T19:43:28.734892] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-11-03T19:43:29.534850] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-11-03T19:43:29.621057] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-11-03T19:43:30.334861] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-11-03T19:43:31.134874] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-11-03T19:43:31.453177] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-11-03T19:43:31.620382] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-11-03T19:43:31.934864] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-11-03T19:43:32.462457] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-11-03T19:43:32.597609] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-11-03T19:43:32.734833] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-11-03T19:43:33.534828] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-11-03T19:43:33.553096] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T19:43:34.046179] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-11-03T19:43:34.334884] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-11-03T19:43:35.134933] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-11. [2025-11-03T19:43:35.641017] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T19:43:35.642018] [INFO ] [REMOTE ] JOF: Full fetch complete (9695 records). [2025-11-03T19:43:35.642104] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-11-03T19:43:35.940068] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-11-03T19:43:36.035611] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-11-03T19:43:36.035751] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-11-03T19:43:36.035995] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-11-03T19:43:36.036119] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-11-03T19:43:36.036748] [DEBUG] [LOCAL ] JOF: Trimmed 9695 records to 6820 (keeping 200 days of data) [2025-11-03T19:43:36.077301] [DEBUG] [LOCAL ] JOF: Primary data saved (6820 records). [2025-11-03T19:43:36.077538] [INFO ] [MAIN ] JOF: Full history saved. [2025-11-03T19:43:36.077742] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JOF took 19.5s. Estimated remaining: 2h 49m 44s. Rate: 7.1 symbols/min [2025-11-03T19:43:36.253210] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:36.284540] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-11-03T19:43:36.324135] [DEBUG] [LOCAL ] JPC: Loaded 37151 existing records from primary storage. [2025-11-03T19:43:36.324405] [INFO ] [MAIN ] JPC: Loaded 37151 existing records. [2025-11-03T19:43:36.500898] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:36.501085] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-11-03T19:43:36.501133] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-11-03T19:43:36.501751] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-11-03T19:43:36.501825] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-11-03T19:43:36.740107] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-11-03T19:43:36.855555] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:37.539954] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-11-03T19:43:37.550187] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-11-03T19:43:37.832066] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-11-03T19:43:38.334848] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-11-03T19:43:39.134832] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-11-03T19:43:39.217242] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-11-03T19:43:39.934874] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-11-03T19:43:40.018511] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-11-03T19:43:40.240374] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-11-03T19:43:40.735075] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-11-03T19:43:41.534901] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-11-03T19:43:41.769291] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-11-03T19:43:42.334832] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-11-03T19:43:42.409571] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-11-03T19:43:42.562893] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-11-03T19:43:43.134867] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-11. [2025-11-03T19:43:43.781757] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-11 (0.65 seconds). [2025-11-03T19:43:43.782764] [INFO ] [REMOTE ] JOE: Full fetch complete (35021 records). [2025-11-03T19:43:43.782838] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-11-03T19:43:43.939566] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-11-03T19:43:44.204907] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-11-03T19:43:44.205088] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-11-03T19:43:44.205802] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-11-03T19:43:44.205879] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-11-03T19:43:44.206842] [DEBUG] [LOCAL ] JOE: Trimmed 35021 records to 23209 (keeping 200 days of data) [2025-11-03T19:43:44.327705] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-11-03T19:43:44.390132] [DEBUG] [LOCAL ] JOE: Primary data saved (23209 records). [2025-11-03T19:43:44.390252] [INFO ] [MAIN ] JOE: Full history saved. [2025-11-03T19:43:44.390336] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JOE took 27.8s. Estimated remaining: 2h 49m 36s. Rate: 7.1 symbols/min [2025-11-03T19:43:44.558124] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:44.605415] [DEBUG] [LOCAL ] JPM: Loaded 54574 existing records from primary storage. [2025-11-03T19:43:44.605768] [INFO ] [MAIN ] JPM: Loaded 54574 existing records. [2025-11-03T19:43:44.744708] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-11-03T19:43:44.800001] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:44.800206] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-11-03T19:43:44.800265] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-11-03T19:43:44.801202] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-11-03T19:43:44.801261] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-11-03T19:43:45.231307] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:45.534857] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-11-03T19:43:46.098694] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-11-03T19:43:46.253876] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T19:43:46.334847] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-11-03T19:43:47.134853] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-11-03T19:43:47.404484] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-11-03T19:43:47.934855] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-11-03T19:43:48.678095] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-11-03T19:43:48.734810] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-11-03T19:43:49.059170] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-11-03T19:43:49.534817] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-11-03T19:43:49.569709] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-11-03T19:43:50.334832] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-11-03T19:43:50.539487] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T19:43:50.739615] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-11-03T19:43:51.134905] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-11-03T19:43:51.934875] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-11-03T19:43:52.213194] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-11-03T19:43:52.439949] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-11-03T19:43:52.734911] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-11. [2025-11-03T19:43:53.534858] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-11-03T19:43:54.246481] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-11 (1.51 seconds). [2025-11-03T19:43:54.248071] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-11-03T19:43:54.248194] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-11-03T19:43:54.349746] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-11-03T19:43:54.669087] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-11-03T19:43:54.669250] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-11-03T19:43:54.670519] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-11-03T19:43:54.670760] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-11-03T19:43:54.695146] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-11-03T19:43:54.696677] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T19:43:54.855265] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-11-03T19:43:55.091979] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-11-03T19:43:55.092124] [INFO ] [MAIN ] JNJ: Full history saved. [2025-11-03T19:43:55.092202] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JNJ took 38.5s. Estimated remaining: 2h 49m 29s. Rate: 7.1 symbols/min [2025-11-03T19:43:55.140123] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-11-03T19:43:55.265745] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:55.301605] [DEBUG] [LOCAL ] JQC: Loaded 33804 existing records from primary storage. [2025-11-03T19:43:55.302013] [INFO ] [MAIN ] JQC: Loaded 33804 existing records. [2025-11-03T19:43:55.485577] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:43:55.485833] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-11-03T19:43:55.485883] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-11-03T19:43:55.486524] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-11-03T19:43:55.486580] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-11-03T19:43:55.828964] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:43:55.934877] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-11-03T19:43:56.191971] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-11-03T19:43:56.334059] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:43:56.734851] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-11. [2025-11-03T19:43:57.147898] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-11-03T19:43:57.534846] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-11-03T19:43:58.334834] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-11-03T19:43:58.452271] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T19:43:58.892410] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-11 (2.16 seconds). [2025-11-03T19:43:58.894006] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-11-03T19:43:58.894112] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-11-03T19:43:59.142377] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-11-03T19:43:59.367218] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-11-03T19:43:59.367316] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-11-03T19:43:59.368714] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-11-03T19:43:59.368782] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-11-03T19:43:59.370481] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53811 (keeping 200 days of data) [2025-11-03T19:43:59.687990] [DEBUG] [LOCAL ] JOBY: Primary data saved (53811 records). [2025-11-03T19:43:59.688151] [INFO ] [MAIN ] JOBY: Full history saved. [2025-11-03T19:43:59.688249] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JOBY took 43.1s. Estimated remaining: 2h 49m 17s. Rate: 7.1 symbols/min [2025-11-03T19:43:59.880190] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:43:59.895342] [DEBUG] [LOCAL ] JRI: Loaded 15232 existing records from primary storage. [2025-11-03T19:43:59.895528] [INFO ] [MAIN ] JRI: Loaded 15232 existing records. [2025-11-03T19:43:59.958102] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-11-03T19:44:00.074479] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:00.074713] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-11-03T19:44:00.074768] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-11-03T19:44:00.075091] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-11-03T19:44:00.075147] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-11-03T19:44:00.404031] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T19:44:00.468022] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:00.499786] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-11-03T19:44:00.734906] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-11-03T19:44:01.136117] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-11-03T19:44:01.534920] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-11-03T19:44:01.790052] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-11-03T19:44:02.334900] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-11-03T19:44:02.910606] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-11-03T19:44:03.134909] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-11-03T19:44:03.467814] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-11-03T19:44:03.798827] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-11-03T19:44:03.934875] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-11-03T19:44:04.734842] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-11-03T19:44:04.767253] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-11-03T19:44:05.534891] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-11-03T19:44:05.799241] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T19:44:06.238562] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-11-03T19:44:06.334889] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-11-03T19:44:06.921335] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T19:44:07.134853] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-11-03T19:44:07.934887] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-11-03T19:44:08.193101] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-11-03T19:44:08.734833] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-11-03T19:44:08.753569] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T19:44:09.534904] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-11-03T19:44:09.769175] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:44:10.106267] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T19:44:10.334848] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-11-03T19:44:11.032157] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T19:44:11.134844] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-11-03T19:44:11.822330] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T19:44:11.934858] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-11-03T19:44:12.734850] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-11-03T19:44:12.943348] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T19:44:13.534848] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-11. [2025-11-03T19:44:13.696407] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T19:44:14.077517] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-11 (0.54 seconds). [2025-11-03T19:44:14.078719] [INFO ] [REMOTE ] JRI: Full fetch complete (22510 records). [2025-11-03T19:44:14.078805] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-11-03T19:44:14.340011] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-11-03T19:44:14.491094] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-11-03T19:44:14.491174] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-11-03T19:44:14.491690] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-11-03T19:44:14.491751] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-11-03T19:44:14.492307] [DEBUG] [LOCAL ] JRI: Trimmed 22510 records to 15009 (keeping 200 days of data) [2025-11-03T19:44:14.583604] [DEBUG] [LOCAL ] JRI: Primary data saved (15009 records). [2025-11-03T19:44:14.583857] [INFO ] [MAIN ] JRI: Full history saved. [2025-11-03T19:44:14.583976] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JRI took 14.9s. Estimated remaining: 2h 49m 15s. Rate: 7.1 symbols/min [2025-11-03T19:44:14.751171] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:44:14.762376] [DEBUG] [LOCAL ] JRS: Loaded 11587 existing records from primary storage. [2025-11-03T19:44:14.762630] [INFO ] [MAIN ] JRS: Loaded 11587 existing records. [2025-11-03T19:44:14.941382] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:14.941552] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-11-03T19:44:14.941608] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-11-03T19:44:14.941906] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-11-03T19:44:14.941964] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-11-03T19:44:15.146389] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-11-03T19:44:15.291472] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:15.830122] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T19:44:15.934821] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-11. [2025-11-03T19:44:16.051012] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-11-03T19:44:16.734861] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-11-03T19:44:16.920740] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:44:16.922022] [INFO ] [REMOTE ] JPC: Full fetch complete (54770 records). [2025-11-03T19:44:16.922118] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-11-03T19:44:17.309819] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-11-03T19:44:17.309923] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-11-03T19:44:17.310723] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-11-03T19:44:17.310783] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-11-03T19:44:17.311841] [DEBUG] [LOCAL ] JPC: Trimmed 54770 records to 36512 (keeping 200 days of data) [2025-11-03T19:44:17.534129] [DEBUG] [LOCAL ] JPC: Primary data saved (36512 records). [2025-11-03T19:44:17.534259] [INFO ] [MAIN ] JPC: Full history saved. [2025-11-03T19:44:17.535080] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JPC took 41.5s. Estimated remaining: 2h 49m 1s. Rate: 7.1 symbols/min [2025-11-03T19:44:17.535196] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-11-03T19:44:17.706081] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:44:17.745527] [DEBUG] [LOCAL ] JXN: Loaded 44191 existing records from primary storage. [2025-11-03T19:44:17.745896] [INFO ] [MAIN ] JXN: Loaded 44191 existing records. [2025-11-03T19:44:17.926792] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:17.927042] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-11-03T19:44:17.927119] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-11-03T19:44:17.928024] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-11-03T19:44:17.928088] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-11-03T19:44:18.061701] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T19:44:18.260462] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T19:44:18.339056] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-11-03T19:44:18.338958] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:19.134884] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-11-03T19:44:19.322969] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-11-03T19:44:19.701125] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-11-03T19:44:19.934853] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-11-03T19:44:20.734836] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-11-03T19:44:20.840802] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T19:44:21.159237] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-11-03T19:44:21.534900] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-11-03T19:44:22.334900] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-11-03T19:44:23.134885] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-11-03T19:44:23.334048] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-11-03T19:44:23.483999] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-11-03T19:44:23.599619] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-11-03T19:44:23.934843] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-11-03T19:44:24.477084] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-11-03T19:44:24.734880] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-11-03T19:44:25.347158] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-11-03T19:44:25.534904] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-11-03T19:44:26.334876] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-11-03T19:44:26.723356] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T19:44:27.134844] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-11. [2025-11-03T19:44:27.934911] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-11-03T19:44:28.037501] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-11-03T19:44:28.058090] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-11 (0.92 seconds). [2025-11-03T19:44:28.060701] [INFO ] [REMOTE ] JQC: Full fetch complete (49577 records). [2025-11-03T19:44:28.060901] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-11-03T19:44:28.623220] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-11-03T19:44:28.623354] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-11-03T19:44:28.624850] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-11-03T19:44:28.624931] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-11-03T19:44:28.626217] [DEBUG] [LOCAL ] JQC: Trimmed 49577 records to 33199 (keeping 200 days of data) [2025-11-03T19:44:28.734974] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-11-03T19:44:28.850334] [DEBUG] [LOCAL ] JQC: Primary data saved (33199 records). [2025-11-03T19:44:28.850630] [INFO ] [MAIN ] JQC: Full history saved. [2025-11-03T19:44:28.850783] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JQC took 33.8s. Estimated remaining: 2h 48m 56s. Rate: 7.1 symbols/min [2025-11-03T19:44:29.037439] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:44:29.066894] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:44:29.114673] [DEBUG] [LOCAL ] K: Loaded 50992 existing records from primary storage. [2025-11-03T19:44:29.114990] [INFO ] [MAIN ] K: Loaded 50992 existing records. [2025-11-03T19:44:29.293906] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:29.294167] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-11-03T19:44:29.294229] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-11-03T19:44:29.295110] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-11-03T19:44:29.295170] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-11-03T19:44:29.547761] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-11-03T19:44:29.664980] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:30.260985] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T19:44:30.334877] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-11-03T19:44:30.793296] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-11-03T19:44:31.134862] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-11-03T19:44:31.580482] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T19:44:31.641601] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-11-03T19:44:31.934851] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-11-03T19:44:32.734855] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-11-03T19:44:33.534838] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-11-03T19:44:33.611345] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-11-03T19:44:33.845360] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-11-03T19:44:34.334880] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-11-03T19:44:34.787085] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:44:35.134875] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-11-03T19:44:35.338039] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-11-03T19:44:35.934852] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-11-03T19:44:36.193769] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T19:44:36.734851] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-11-03T19:44:37.064811] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T19:44:37.365377] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T19:44:37.534883] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-11-03T19:44:38.146616] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-11-03T19:44:38.334858] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-11. [2025-11-03T19:44:38.792179] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-11 (0.46 seconds). [2025-11-03T19:44:38.793192] [INFO ] [REMOTE ] JRS: Full fetch complete (16100 records). [2025-11-03T19:44:38.793268] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-11-03T19:44:39.139957] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-11-03T19:44:39.186348] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-11-03T19:44:39.186449] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-11-03T19:44:39.186925] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-11-03T19:44:39.186987] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-11-03T19:44:39.187959] [DEBUG] [LOCAL ] JRS: Trimmed 16100 records to 11456 (keeping 200 days of data) [2025-11-03T19:44:39.256023] [DEBUG] [LOCAL ] JRS: Primary data saved (11456 records). [2025-11-03T19:44:39.256193] [INFO ] [MAIN ] JRS: Full history saved. [2025-11-03T19:44:39.256337] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JRS took 24.7s. Estimated remaining: 2h 48m 49s. Rate: 7.1 symbols/min [2025-11-03T19:44:39.421028] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:44:39.434565] [DEBUG] [LOCAL ] KAI: Loaded 13540 existing records from primary storage. [2025-11-03T19:44:39.434815] [INFO ] [MAIN ] KAI: Loaded 13540 existing records. [2025-11-03T19:44:39.607145] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:39.607340] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-11-03T19:44:39.607401] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-11-03T19:44:39.607803] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-11-03T19:44:39.607858] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-11-03T19:44:39.937749] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-11-03T19:44:39.958007] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:40.473863] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:44:40.734862] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-11-03T19:44:41.218934] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T19:44:41.534910] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-11-03T19:44:42.042222] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-11-03T19:44:42.073428] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:44:42.334865] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-11-03T19:44:43.134866] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-11-03T19:44:43.807777] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-11-03T19:44:43.934858] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-11-03T19:44:44.394269] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-11-03T19:44:44.734879] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-11-03T19:44:45.205478] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:44:45.534878] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-11-03T19:44:46.004734] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:44:46.144869] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-11-03T19:44:46.334852] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-11-03T19:44:47.134850] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-11-03T19:44:47.795210] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-11-03T19:44:47.934844] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-11-03T19:44:48.247556] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T19:44:48.679017] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-11-03T19:44:48.734825] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-11-03T19:44:49.455575] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-11-03T19:44:49.534873] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-11-03T19:44:50.334916] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-11-03T19:44:50.608122] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T19:44:51.134879] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-11-03T19:44:51.762701] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-11-03T19:44:51.934848] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-11-03T19:44:52.734894] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-11-03T19:44:53.040100] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-11-03T19:44:53.404306] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-11-03T19:44:53.416888] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-11-03T19:44:53.534860] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-11. [2025-11-03T19:44:54.334866] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-11. [2025-11-03T19:44:55.134875] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-11-03T19:44:55.207538] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:44:55.208876] [INFO ] [REMOTE ] JXN: Full fetch complete (64927 records). [2025-11-03T19:44:55.208983] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-11-03T19:44:55.561416] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-11 (2.03 seconds). [2025-11-03T19:44:55.584106] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-11-03T19:44:55.601281] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-11-03T19:44:55.698398] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-11-03T19:44:55.714433] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-11-03T19:44:55.731872] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-11-03T19:44:55.731961] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-11-03T19:44:55.796827] [DEBUG] [LOCAL ] JXN: Trimmed 64927 records to 43379 (keeping 200 days of data) [2025-11-03T19:44:55.977505] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-11-03T19:44:56.296604] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-11-03T19:44:56.299506] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-11-03T19:44:56.300725] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-11-03T19:44:56.300816] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-11-03T19:44:56.307595] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-11-03T19:44:56.703809] [DEBUG] [LOCAL ] JXN: Primary data saved (43379 records). [2025-11-03T19:44:56.771311] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-11-03T19:44:56.734918] [INFO ] [MAIN ] JXN: Full history saved. [2025-11-03T19:44:56.822890] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JXN took 39.3s. Estimated remaining: 2h 48m 50s. Rate: 7.1 symbols/min [2025-11-03T19:44:56.826331] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-11-03T19:44:56.860488] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-11-03T19:44:56.931379] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-11-03T19:44:56.957834] [INFO ] [MAIN ] JPM: Full history saved. [2025-11-03T19:44:56.969858] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JPM took 1m 13s. Estimated remaining: 2h 48m 33s. Rate: 7.1 symbols/min [2025-11-03T19:44:57.198602] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:44:57.216480] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:44:57.238897] [DEBUG] [LOCAL ] KB: Loaded 22759 existing records from primary storage. [2025-11-03T19:44:57.248113] [INFO ] [MAIN ] KB: Loaded 22759 existing records. [2025-11-03T19:44:57.425697] [DEBUG] [LOCAL ] KAR: Loaded 40108 existing records from primary storage. [2025-11-03T19:44:57.445611] [INFO ] [MAIN ] KAR: Loaded 40108 existing records. [2025-11-03T19:44:57.445324] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:57.535477] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-11-03T19:44:57.542832] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-11-03T19:44:57.553742] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T19:44:57.552892] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-11-03T19:44:57.584159] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-11-03T19:44:57.608151] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-11-03T19:44:57.712991] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:44:57.724352] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-11-03T19:44:57.724426] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-11-03T19:44:57.744087] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-11-03T19:44:57.746851] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-11-03T19:44:58.336422] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:58.336503] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-11-03T19:44:58.428946] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:44:58.855452] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-11-03T19:44:59.033333] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-11-03T19:44:59.134837] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-11-03T19:44:59.827446] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-11-03T19:44:59.934862] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-11. [2025-11-03T19:45:00.567225] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-11 (0.63 seconds). [2025-11-03T19:45:00.568363] [INFO ] [REMOTE ] KAI: Full fetch complete (19793 records). [2025-11-03T19:45:00.568435] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-11-03T19:45:00.742300] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-11-03T19:45:00.993395] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-11-03T19:45:00.993505] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-11-03T19:45:00.993997] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-11-03T19:45:00.994058] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-11-03T19:45:00.994603] [DEBUG] [LOCAL ] KAI: Trimmed 19793 records to 13458 (keeping 200 days of data) [2025-11-03T19:45:01.084693] [DEBUG] [LOCAL ] KAI: Primary data saved (13458 records). [2025-11-03T19:45:01.084834] [INFO ] [MAIN ] KAI: Full history saved. [2025-11-03T19:45:01.084913] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. KAI took 21.8s. Estimated remaining: 2h 48m 20s. Rate: 7.1 symbols/min [2025-11-03T19:45:01.283673] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:45:01.306712] [DEBUG] [LOCAL ] KBDC: Loaded 23147 existing records from primary storage. [2025-11-03T19:45:01.306993] [INFO ] [MAIN ] KBDC: Loaded 23147 existing records. [2025-11-03T19:45:01.522443] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:45:01.522941] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-11-03T19:45:01.523018] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-11-03T19:45:01.523555] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-11-03T19:45:01.523633] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-11-03T19:45:01.548748] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-11-03T19:45:01.919982] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T19:45:02.009430] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:45:02.334869] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-11-03T19:45:02.888420] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:45:03.116803] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-11-03T19:45:03.134847] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-11-03T19:45:03.825921] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T19:45:03.934862] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-11-03T19:45:04.698774] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T19:45:04.734820] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-11-03T19:45:05.534828] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-11-03T19:45:05.679469] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-11-03T19:45:06.334827] [INFO ] [REMOTE ] K: Fetching primary data for 2025-11. [2025-11-03T19:45:06.579330] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-11-03T19:45:07.134918] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-11-03T19:45:07.398827] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:45:07.400751] [INFO ] [REMOTE ] K: Full fetch complete (72310 records). [2025-11-03T19:45:07.400864] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-11-03T19:45:07.792874] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-11-03T19:45:07.793184] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-11-03T19:45:07.794324] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-11-03T19:45:07.794389] [DEBUG] [LOCAL ] K: Saving primary data. [2025-11-03T19:45:07.795840] [DEBUG] [LOCAL ] K: Trimmed 72310 records to 50314 (keeping 200 days of data) [2025-11-03T19:45:07.940807] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-11-03T19:45:07.956486] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-11-03T19:45:08.154192] [DEBUG] [LOCAL ] K: Primary data saved (50314 records). [2025-11-03T19:45:08.154333] [INFO ] [MAIN ] K: Full history saved. [2025-11-03T19:45:08.154447] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. K took 39.3s. Estimated remaining: 2h 48m 10s. Rate: 7.1 symbols/min [2025-11-03T19:45:08.376152] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:45:08.419374] [DEBUG] [LOCAL ] KBH: Loaded 49171 existing records from primary storage. [2025-11-03T19:45:08.419700] [INFO ] [MAIN ] KBH: Loaded 49171 existing records. [2025-11-03T19:45:08.600829] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:45:08.601130] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-11-03T19:45:08.601192] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-11-03T19:45:08.602223] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-11-03T19:45:08.602325] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-11-03T19:45:08.738898] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-11-03T19:45:08.792721] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-11-03T19:45:09.010471] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:45:09.534861] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-11-03T19:45:09.990635] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-11-03T19:45:10.334856] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-11-03T19:45:10.937297] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-11-03T19:45:11.134890] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-11-03T19:45:11.586448] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:45:11.934852] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-11-03T19:45:12.058119] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T19:45:12.696673] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T19:45:12.734862] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-11-03T19:45:13.502151] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-11-03T19:45:13.534817] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-11-03T19:45:14.207030] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-11-03T19:45:14.334849] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-11-03T19:45:15.134842] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-11-03T19:45:15.189611] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T19:45:15.934863] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-11-03T19:45:16.390103] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-11-03T19:45:16.734849] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-11-03T19:45:16.916208] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T19:45:17.534863] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-11-03T19:45:18.202765] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T19:45:18.334859] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-11-03T19:45:18.439939] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-11-03T19:45:19.134881] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-11-03T19:45:19.591813] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:45:19.934822] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-11-03T19:45:20.076725] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-11-03T19:45:20.734869] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-11-03T19:45:20.814418] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-11-03T19:45:21.534862] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-11-03T19:45:21.910901] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T19:45:22.276130] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-11-03T19:45:22.334818] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-11-03T19:45:23.134907] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-11-03T19:45:23.333833] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-11-03T19:45:23.934863] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-11-03T19:45:24.213109] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-11-03T19:45:24.734848] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-11-03T19:45:25.028274] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-11-03T19:45:25.540152] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-11-03T19:45:25.551496] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-11-03T19:45:26.334855] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-11-03T19:45:26.723112] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T19:45:26.909571] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-11-03T19:45:27.134922] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-11-03T19:45:27.841633] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-11-03T19:45:27.934876] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-11. [2025-11-03T19:45:28.620253] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-11 (0.69 seconds). [2025-11-03T19:45:28.621309] [INFO ] [REMOTE ] KBDC: Full fetch complete (31836 records). [2025-11-03T19:45:28.621384] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-11-03T19:45:28.740055] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-11-03T19:45:28.990685] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-11-03T19:45:28.990768] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-11-03T19:45:28.991328] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-11-03T19:45:28.991367] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-11-03T19:45:28.992065] [DEBUG] [LOCAL ] KBDC: Trimmed 31836 records to 22797 (keeping 200 days of data) [2025-11-03T19:45:29.123127] [DEBUG] [LOCAL ] KBDC: Primary data saved (22797 records). [2025-11-03T19:45:29.123242] [INFO ] [MAIN ] KBDC: Full history saved. [2025-11-03T19:45:29.123314] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KBDC took 28.0s. Estimated remaining: 2h 48m 15s. Rate: 7.1 symbols/min [2025-11-03T19:45:29.293074] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:45:29.333483] [DEBUG] [LOCAL ] KBR: Loaded 48706 existing records from primary storage. [2025-11-03T19:45:29.333790] [INFO ] [MAIN ] KBR: Loaded 48706 existing records. [2025-11-03T19:45:29.507440] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:45:29.507693] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-11-03T19:45:29.507766] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-11-03T19:45:29.508791] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-11-03T19:45:29.508850] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-11-03T19:45:29.540031] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-11. [2025-11-03T19:45:29.862546] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:45:29.939392] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-11-03T19:45:30.244369] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-11 (0.70 seconds). [2025-11-03T19:45:30.245540] [INFO ] [REMOTE ] KB: Full fetch complete (33035 records). [2025-11-03T19:45:30.245634] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-11-03T19:45:30.339999] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-11-03T19:45:30.633902] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-11-03T19:45:30.633979] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-11-03T19:45:30.634578] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-11-03T19:45:30.634617] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-11-03T19:45:30.635451] [DEBUG] [LOCAL ] KB: Trimmed 33035 records to 22203 (keeping 200 days of data) [2025-11-03T19:45:30.766871] [DEBUG] [LOCAL ] KB: Primary data saved (22203 records). [2025-11-03T19:45:30.766992] [INFO ] [MAIN ] KB: Full history saved. [2025-11-03T19:45:30.767068] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. KB took 33.8s. Estimated remaining: 2h 47m 59s. Rate: 7.1 symbols/min [2025-11-03T19:45:30.938210] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:45:30.983340] [DEBUG] [LOCAL ] KD: Loaded 53040 existing records from primary storage. [2025-11-03T19:45:30.983670] [INFO ] [MAIN ] KD: Loaded 53040 existing records. [2025-11-03T19:45:31.140919] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-11-03T19:45:31.171173] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:45:31.171443] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-11-03T19:45:31.171494] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-11-03T19:45:31.172281] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-11-03T19:45:31.172336] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-11-03T19:45:31.530871] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:45:31.685078] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T19:45:31.934947] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-11-03T19:45:32.318786] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T19:45:32.734871] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-11-03T19:45:33.328237] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-11-03T19:45:33.534832] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-11-03T19:45:34.197180] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-11-03T19:45:34.334885] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-11-03T19:45:34.974412] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T19:45:35.134861] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-11-03T19:45:35.423218] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-11-03T19:45:35.934907] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-11-03T19:45:36.372047] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-11-03T19:45:36.734963] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-11. [2025-11-03T19:45:37.130060] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-11-03T19:45:37.534873] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-11. [2025-11-03T19:45:37.790146] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:45:37.791629] [INFO ] [REMOTE ] KBH: Full fetch complete (70779 records). [2025-11-03T19:45:37.791775] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-11-03T19:45:38.189312] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-11-03T19:45:38.189412] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-11-03T19:45:38.190355] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-11-03T19:45:38.190417] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-11-03T19:45:38.191758] [DEBUG] [LOCAL ] KBH: Trimmed 70779 records to 48395 (keeping 200 days of data) [2025-11-03T19:45:38.359996] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-11-03T19:45:38.480778] [DEBUG] [LOCAL ] KBH: Primary data saved (48395 records). [2025-11-03T19:45:38.480920] [INFO ] [MAIN ] KBH: Full history saved. [2025-11-03T19:45:38.480997] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. KBH took 30.3s. Estimated remaining: 2h 47m 50s. Rate: 7.1 symbols/min [2025-11-03T19:45:38.562421] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T19:45:38.592716] [INFO ] [REMOTE ] KAR: Full fetch complete (57227 records). [2025-11-03T19:45:38.593128] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-11-03T19:45:38.782504] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:45:38.858025] [DEBUG] [LOCAL ] KEN: Loaded 4181 existing records from primary storage. [2025-11-03T19:45:38.859692] [INFO ] [MAIN ] KEN: Loaded 4181 existing records. [2025-11-03T19:45:39.145111] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-11-03T19:45:39.237053] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:45:39.248103] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-11-03T19:45:39.258829] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-11-03T19:45:39.285689] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-11-03T19:45:39.295316] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-11-03T19:45:39.438998] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-11-03T19:45:39.455064] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-11-03T19:45:39.456622] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-11-03T19:45:39.464176] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-11-03T19:45:39.545254] [DEBUG] [LOCAL ] KAR: Trimmed 57227 records to 39582 (keeping 200 days of data) [2025-11-03T19:45:39.932300] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:45:39.943334] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-11-03T19:45:40.015730] [DEBUG] [LOCAL ] KAR: Primary data saved (39582 records). [2025-11-03T19:45:40.016199] [INFO ] [MAIN ] KAR: Full history saved. [2025-11-03T19:45:40.016375] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KAR took 43.2s. Estimated remaining: 2h 47m 35s. Rate: 7.1 symbols/min [2025-11-03T19:45:40.152486] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-11-03T19:45:40.254746] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:45:40.287833] [DEBUG] [LOCAL ] KEP: Loaded 33186 existing records from primary storage. [2025-11-03T19:45:40.288103] [INFO ] [MAIN ] KEP: Loaded 33186 existing records. [2025-11-03T19:45:40.469313] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T19:45:40.474622] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:45:40.475275] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-11-03T19:45:40.477446] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-11-03T19:45:40.478141] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-11-03T19:45:40.478290] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-11-03T19:45:40.737435] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-11-03T19:45:40.791135] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-11-03T19:45:40.876521] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:45:41.534856] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-11-03T19:45:42.127207] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T19:45:42.334854] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-11-03T19:45:42.362155] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-11-03T19:45:43.134903] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-11-03T19:45:43.768856] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T19:45:43.934858] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-11-03T19:45:44.399567] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T19:45:44.640113] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T19:45:44.734846] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-11-03T19:45:45.514317] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-11-03T19:45:45.534840] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-11-03T19:45:46.280436] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T19:45:46.334804] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-11-03T19:45:47.134861] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-11-03T19:45:47.610203] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T19:45:47.934858] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-11-03T19:45:48.570950] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T19:45:48.734893] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-11-03T19:45:49.182539] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:45:49.534890] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-11-03T19:45:49.711243] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T19:45:50.334881] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-11-03T19:45:50.865047] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:45:51.134863] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-11-03T19:45:51.366434] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-11-03T19:45:51.451940] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-11-03T19:45:51.934856] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-11-03T19:45:52.734892] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-11-03T19:45:53.243517] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T19:45:53.245951] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-11-03T19:45:53.534860] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-11-03T19:45:54.049265] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T19:45:54.334864] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-11-03T19:45:54.756875] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-11-03T19:45:55.134864] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-11-03T19:45:55.528427] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-11-03T19:45:55.934861] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-11-03T19:45:56.734873] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-11-03T19:45:57.207468] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:45:57.233948] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-11-03T19:45:57.534890] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-11-03T19:45:58.334877] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-11-03T19:45:58.789788] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T19:45:59.134919] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-11-03T19:45:59.400471] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-11-03T19:45:59.934880] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-11-03T19:46:00.313018] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-11-03T19:46:00.734825] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-11-03T19:46:00.971423] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-11-03T19:46:01.144753] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-11-03T19:46:01.534856] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-11-03T19:46:02.334875] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-11-03T19:46:02.628241] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-11-03T19:46:02.683251] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-11-03T19:46:03.134874] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-11. [2025-11-03T19:46:03.934866] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-11-03T19:46:04.330547] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T19:46:04.332059] [INFO ] [REMOTE ] KD: Full fetch complete (76051 records). [2025-11-03T19:46:04.332165] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-11-03T19:46:04.745010] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-11-03T19:46:04.749861] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-11-03T19:46:04.749974] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-11-03T19:46:04.751019] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-11-03T19:46:04.751181] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-11-03T19:46:04.752724] [DEBUG] [LOCAL ] KD: Trimmed 76051 records to 52286 (keeping 200 days of data) [2025-11-03T19:46:05.051503] [DEBUG] [LOCAL ] KD: Primary data saved (52286 records). [2025-11-03T19:46:05.051661] [INFO ] [MAIN ] KD: Full history saved. [2025-11-03T19:46:05.051761] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KD took 34.3s. Estimated remaining: 2h 47m 43s. Rate: 7.1 symbols/min [2025-11-03T19:46:05.223791] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:05.268517] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:46:05.291039] [DEBUG] [LOCAL ] KEX: Loaded 39459 existing records from primary storage. [2025-11-03T19:46:05.291368] [INFO ] [MAIN ] KEX: Loaded 39459 existing records. [2025-11-03T19:46:05.469514] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:46:05.469792] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-11-03T19:46:05.469848] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-11-03T19:46:05.470495] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-11-03T19:46:05.470553] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-11-03T19:46:05.535303] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-11. [2025-11-03T19:46:05.837388] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:05.855552] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T19:46:05.982420] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-11 (0.45 seconds). [2025-11-03T19:46:05.983119] [INFO ] [REMOTE ] KEN: Full fetch complete (5800 records). [2025-11-03T19:46:05.983187] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-11-03T19:46:06.337721] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-11-03T19:46:06.337925] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-11-03T19:46:06.338198] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-11-03T19:46:06.337472] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-11-03T19:46:06.339248] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-11-03T19:46:06.339690] [DEBUG] [LOCAL ] KEN: Trimmed 5800 records to 3972 (keeping 200 days of data) [2025-11-03T19:46:06.363444] [DEBUG] [LOCAL ] KEN: Primary data saved (3972 records). [2025-11-03T19:46:06.363561] [INFO ] [MAIN ] KEN: Full history saved. [2025-11-03T19:46:06.363639] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KEN took 27.9s. Estimated remaining: 2h 47m 27s. Rate: 7.1 symbols/min [2025-11-03T19:46:06.532850] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:06.533067] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-11-03T19:46:06.533123] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-11-03T19:46:06.533236] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-11-03T19:46:06.533277] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-11-03T19:46:06.533319] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-11-03T19:46:06.533352] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-11-03T19:46:06.878218] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:07.134892] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-11-03T19:46:07.351979] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T19:46:07.934886] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-11-03T19:46:08.413466] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T19:46:08.734844] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-11. [2025-11-03T19:46:09.138584] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-11-03T19:46:09.534853] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-11-03T19:46:09.717580] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-11 (0.98 seconds). [2025-11-03T19:46:09.718820] [INFO ] [REMOTE ] KEP: Full fetch complete (42948 records). [2025-11-03T19:46:09.718896] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-11-03T19:46:10.082082] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-11-03T19:46:10.082155] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-11-03T19:46:10.082856] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-11-03T19:46:10.082939] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-11-03T19:46:10.083813] [DEBUG] [LOCAL ] KEP: Trimmed 42948 records to 32968 (keeping 200 days of data) [2025-11-03T19:46:10.269960] [DEBUG] [LOCAL ] KEP: Primary data saved (32968 records). [2025-11-03T19:46:10.270081] [INFO ] [MAIN ] KEP: Full history saved. [2025-11-03T19:46:10.270157] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEP took 30.3s. Estimated remaining: 2h 47m 14s. Rate: 7.1 symbols/min [2025-11-03T19:46:10.344275] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-11-03T19:46:10.439206] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:10.477837] [DEBUG] [LOCAL ] KEYS: Loaded 43604 existing records from primary storage. [2025-11-03T19:46:10.478136] [INFO ] [MAIN ] KEYS: Loaded 43604 existing records. [2025-11-03T19:46:10.651814] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:46:10.652003] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-11-03T19:46:10.652049] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-11-03T19:46:10.652795] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-11-03T19:46:10.652851] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-11-03T19:46:11.010914] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:11.041730] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-11-03T19:46:11.134817] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-11-03T19:46:11.444533] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-11-03T19:46:11.934874] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-11-03T19:46:12.408786] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T19:46:12.734838] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-11-03T19:46:13.283561] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T19:46:13.534926] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-11-03T19:46:14.334855] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-11-03T19:46:14.976108] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T19:46:15.015000] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-11-03T19:46:15.134875] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-11-03T19:46:15.934914] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-11-03T19:46:16.036723] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-11-03T19:46:16.668490] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T19:46:16.734870] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-11-03T19:46:17.342013] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-11-03T19:46:17.534894] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-11-03T19:46:18.170402] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-11-03T19:46:18.334818] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-11-03T19:46:18.626626] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T19:46:19.134890] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-11-03T19:46:19.645476] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-11-03T19:46:19.934925] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-11-03T19:46:20.351241] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-11-03T19:46:20.734857] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-11-03T19:46:21.264779] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-11-03T19:46:21.534861] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-11-03T19:46:21.850513] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T19:46:22.334848] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-11-03T19:46:22.969074] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-11-03T19:46:23.134820] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-11-03T19:46:23.755681] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-11-03T19:46:23.934931] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-11-03T19:46:24.288065] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T19:46:24.734889] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-11-03T19:46:25.067198] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T19:46:25.534910] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-11-03T19:46:25.898559] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-11-03T19:46:26.334912] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-11-03T19:46:27.134919] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-11-03T19:46:27.240258] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T19:46:27.379890] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-11-03T19:46:27.934842] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-11-03T19:46:28.627234] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-11-03T19:46:28.734884] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-11. [2025-11-03T19:46:29.029967] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-11-03T19:46:29.534907] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-11. [2025-11-03T19:46:29.720498] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:46:29.721958] [INFO ] [REMOTE ] KBR: Full fetch complete (70276 records). [2025-11-03T19:46:29.722095] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-11-03T19:46:30.108853] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-11-03T19:46:30.108943] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-11-03T19:46:30.109862] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-11-03T19:46:30.109925] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-11-03T19:46:30.111277] [DEBUG] [LOCAL ] KBR: Trimmed 70276 records to 48067 (keeping 200 days of data) [2025-11-03T19:46:30.336731] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-11-03T19:46:30.390142] [DEBUG] [LOCAL ] KBR: Primary data saved (48067 records). [2025-11-03T19:46:30.390242] [INFO ] [MAIN ] KBR: Full history saved. [2025-11-03T19:46:30.390314] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KBR took 1m 1s. Estimated remaining: 2h 47m 17s. Rate: 7.1 symbols/min [2025-11-03T19:46:30.554692] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:30.558315] [DEBUG] [LOCAL ] KF: Loaded 2349 existing records from primary storage. [2025-11-03T19:46:30.558451] [INFO ] [MAIN ] KF: Loaded 2349 existing records. [2025-11-03T19:46:30.755424] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:46:30.755665] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-11-03T19:46:30.755726] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-11-03T19:46:30.755896] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-11-03T19:46:30.755954] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-11-03T19:46:30.858429] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T19:46:30.868696] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-11-03T19:46:30.879026] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-11-03T19:46:31.143217] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-11-03T19:46:31.293398] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-11-03T19:46:31.334453] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:31.335787] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:46:31.335954] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:46:31.336096] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-11-03T19:46:31.336229] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-11-03T19:46:31.336302] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-11-03T19:46:31.336491] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-11-03T19:46:31.336584] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KEY took 25.0s. Estimated remaining: 2h 47m 1s. Rate: 7.1 symbols/min [2025-11-03T19:46:31.505796] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:31.528474] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T19:46:31.550690] [DEBUG] [LOCAL ] KFRC: Loaded 21473 existing records from primary storage. [2025-11-03T19:46:31.550926] [INFO ] [MAIN ] KFRC: Loaded 21473 existing records. [2025-11-03T19:46:31.726553] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:46:31.726810] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-11-03T19:46:31.726858] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-11-03T19:46:31.727268] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-11-03T19:46:31.727326] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-11-03T19:46:31.941956] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-11-03T19:46:32.075123] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:32.409440] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:46:32.734869] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-11-03T19:46:33.174573] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T19:46:33.534847] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-11-03T19:46:33.666335] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T19:46:34.174840] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-11-03T19:46:34.334862] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-11-03T19:46:34.962864] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-11-03T19:46:35.134845] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-11-03T19:46:35.934877] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-11-03T19:46:36.353067] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T19:46:36.653033] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T19:46:36.734899] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-11-03T19:46:37.534894] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-11-03T19:46:37.986463] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-11-03T19:46:38.300535] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-11-03T19:46:38.334857] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-11-03T19:46:39.134911] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-11-03T19:46:39.729704] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T19:46:39.891512] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T19:46:39.934853] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-11-03T19:46:40.566813] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:46:40.734849] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-11-03T19:46:41.534921] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-11-03T19:46:41.929873] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T19:46:42.249235] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-11-03T19:46:42.334842] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-11-03T19:46:43.134831] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-11. [2025-11-03T19:46:43.177377] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-11-03T19:46:43.934852] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-11-03T19:46:44.192465] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:46:44.193872] [INFO ] [REMOTE ] KEYS: Full fetch complete (63436 records). [2025-11-03T19:46:44.193950] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-11-03T19:46:44.573707] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-11-03T19:46:44.575458] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-11-03T19:46:44.575605] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-11-03T19:46:44.576488] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-11-03T19:46:44.577931] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-11-03T19:46:44.579186] [DEBUG] [LOCAL ] KEYS: Trimmed 63436 records to 42970 (keeping 200 days of data) [2025-11-03T19:46:44.746884] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-11. [2025-11-03T19:46:44.831760] [DEBUG] [LOCAL ] KEYS: Primary data saved (42970 records). [2025-11-03T19:46:44.831888] [INFO ] [MAIN ] KEYS: Full history saved. [2025-11-03T19:46:44.832790] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KEYS took 34.6s. Estimated remaining: 2h 46m 58s. Rate: 7.1 symbols/min [2025-11-03T19:46:45.000090] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:45.010178] [DEBUG] [LOCAL ] KFS: Loaded 8805 existing records from primary storage. [2025-11-03T19:46:45.010419] [INFO ] [MAIN ] KFS: Loaded 8805 existing records. [2025-11-03T19:46:45.184843] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:46:45.185062] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-11-03T19:46:45.185110] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-11-03T19:46:45.185365] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-11-03T19:46:45.185421] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-11-03T19:46:45.538945] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-11-03T19:46:45.542531] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:45.876385] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T19:46:45.877729] [INFO ] [REMOTE ] KEX: Full fetch complete (56437 records). [2025-11-03T19:46:45.877808] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-11-03T19:46:46.286548] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-11-03T19:46:46.286818] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-11-03T19:46:46.287735] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-11-03T19:46:46.287866] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-11-03T19:46:46.289040] [DEBUG] [LOCAL ] KEX: Trimmed 56437 records to 39011 (keeping 200 days of data) [2025-11-03T19:46:46.337917] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-11-03T19:46:46.418383] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-11-03T19:46:46.544534] [DEBUG] [LOCAL ] KEX: Primary data saved (39011 records). [2025-11-03T19:46:46.544705] [INFO ] [MAIN ] KEX: Full history saved. [2025-11-03T19:46:46.544798] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KEX took 41.5s. Estimated remaining: 2h 46m 43s. Rate: 7.1 symbols/min [2025-11-03T19:46:46.725761] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:46:46.754499] [DEBUG] [LOCAL ] KFY: Loaded 29577 existing records from primary storage. [2025-11-03T19:46:46.754812] [INFO ] [MAIN ] KFY: Loaded 29577 existing records. [2025-11-03T19:46:46.869219] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-11-03T19:46:46.948999] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:46:46.949240] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-11-03T19:46:46.949287] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-11-03T19:46:46.949794] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-11-03T19:46:46.949851] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-11-03T19:46:47.143569] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-11-03T19:46:47.328743] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:46:47.786148] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T19:46:47.934862] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-11-03T19:46:48.238988] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-11-03T19:46:48.734845] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-11-03T19:46:49.173174] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-11-03T19:46:49.534867] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-11-03T19:46:49.869758] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-11-03T19:46:50.334864] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-11-03T19:46:50.723252] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-11-03T19:46:51.134890] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-11-03T19:46:51.641417] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T19:46:51.934872] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-11-03T19:46:52.306916] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T19:46:52.734855] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-11-03T19:46:53.219145] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T19:46:53.534908] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-11-03T19:46:54.343366] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-11-03T19:46:54.345227] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-11-03T19:46:55.134818] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-11-03T19:46:55.319357] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-11-03T19:46:55.501733] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-11-03T19:46:55.934846] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-11-03T19:46:56.734913] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-11-03T19:46:56.765969] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-11-03T19:46:57.329548] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-11-03T19:46:57.534862] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-11-03T19:46:57.827142] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-11-03T19:46:58.334848] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-11-03T19:46:58.562132] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-11-03T19:46:59.134921] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-11-03T19:46:59.934881] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-11-03T19:47:00.242785] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-11-03T19:47:00.254337] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-11-03T19:47:00.734859] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-11-03T19:47:01.534886] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-11-03T19:47:01.703904] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T19:47:02.115822] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T19:47:02.334872] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-11-03T19:47:02.862242] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T19:47:03.134850] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-11-03T19:47:03.934820] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-11-03T19:47:04.078507] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-11-03T19:47:04.429688] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T19:47:04.734860] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-11. [2025-11-03T19:47:05.534830] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-11-03T19:47:05.554012] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T19:47:05.555046] [INFO ] [REMOTE ] KFRC: Full fetch complete (27973 records). [2025-11-03T19:47:05.555113] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-11-03T19:47:05.928520] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-11-03T19:47:05.928600] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-11-03T19:47:05.929172] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-11-03T19:47:05.929235] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-11-03T19:47:05.930056] [DEBUG] [LOCAL ] KFRC: Trimmed 27973 records to 21345 (keeping 200 days of data) [2025-11-03T19:47:06.054700] [DEBUG] [LOCAL ] KFRC: Primary data saved (21345 records). [2025-11-03T19:47:06.054817] [INFO ] [MAIN ] KFRC: Full history saved. [2025-11-03T19:47:06.054898] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KFRC took 34.7s. Estimated remaining: 2h 46m 45s. Rate: 7.1 symbols/min [2025-11-03T19:47:06.162030] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T19:47:06.236027] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:06.284995] [DEBUG] [LOCAL ] KGC: Loaded 54479 existing records from primary storage. [2025-11-03T19:47:06.285290] [INFO ] [MAIN ] KGC: Loaded 54479 existing records. [2025-11-03T19:47:06.340008] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-11-03T19:47:06.471699] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:06.471992] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-11-03T19:47:06.472053] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-11-03T19:47:06.473085] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-11-03T19:47:06.473144] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-11-03T19:47:06.827062] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:07.134853] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-11-03T19:47:07.474598] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-11-03T19:47:07.485497] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-11-03T19:47:07.934892] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-11. [2025-11-03T19:47:08.439394] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-11 (0.50 seconds). [2025-11-03T19:47:08.440181] [INFO ] [REMOTE ] KFS: Full fetch complete (11430 records). [2025-11-03T19:47:08.440250] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-11-03T19:47:08.739972] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-11-03T19:47:08.829404] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-11-03T19:47:08.829483] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-11-03T19:47:08.829804] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-11-03T19:47:08.829864] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-11-03T19:47:08.830320] [DEBUG] [LOCAL ] KFS: Trimmed 11430 records to 8711 (keeping 200 days of data) [2025-11-03T19:47:08.886441] [DEBUG] [LOCAL ] KFS: Primary data saved (8711 records). [2025-11-03T19:47:08.886578] [INFO ] [MAIN ] KFS: Full history saved. [2025-11-03T19:47:08.886681] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KFS took 24.1s. Estimated remaining: 2h 46m 31s. Rate: 7.1 symbols/min [2025-11-03T19:47:09.097505] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:09.144392] [DEBUG] [LOCAL ] KGS: Loaded 46559 existing records from primary storage. [2025-11-03T19:47:09.144876] [INFO ] [MAIN ] KGS: Loaded 46559 existing records. [2025-11-03T19:47:09.327135] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:09.327346] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-11-03T19:47:09.327416] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-11-03T19:47:09.328177] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-11-03T19:47:09.328233] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-11-03T19:47:09.541117] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-11-03T19:47:09.717228] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:09.765323] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:47:10.334885] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-11-03T19:47:11.076748] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-11-03T19:47:11.134875] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-11-03T19:47:11.264843] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-11-03T19:47:11.934820] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-11. [2025-11-03T19:47:12.076769] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-11-03T19:47:12.290220] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-11 (0.36 seconds). [2025-11-03T19:47:12.290942] [INFO ] [REMOTE ] KF: Full fetch complete (3423 records). [2025-11-03T19:47:12.291012] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-11-03T19:47:12.673353] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-11-03T19:47:12.673448] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-11-03T19:47:12.673594] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-11-03T19:47:12.673664] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-11-03T19:47:12.674063] [DEBUG] [LOCAL ] KF: Trimmed 3423 records to 2226 (keeping 200 days of data) [2025-11-03T19:47:12.687906] [DEBUG] [LOCAL ] KF: Primary data saved (2226 records). [2025-11-03T19:47:12.688001] [INFO ] [MAIN ] KF: Full history saved. [2025-11-03T19:47:12.688074] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KF took 42.3s. Estimated remaining: 2h 46m 18s. Rate: 7.1 symbols/min [2025-11-03T19:47:12.744430] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-11-03T19:47:12.866757] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:12.914133] [DEBUG] [LOCAL ] KIM: Loaded 53768 existing records from primary storage. [2025-11-03T19:47:12.914501] [INFO ] [MAIN ] KIM: Loaded 53768 existing records. [2025-11-03T19:47:13.089675] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:13.089977] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-11-03T19:47:13.090065] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-11-03T19:47:13.091179] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-11-03T19:47:13.091243] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-11-03T19:47:13.463787] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:13.534854] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-11-03T19:47:14.279476] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-11-03T19:47:14.334807] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-11-03T19:47:14.866274] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-11-03T19:47:15.134880] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-11-03T19:47:15.937349] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-11-03T19:47:15.941393] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-11-03T19:47:16.566477] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-11-03T19:47:16.734916] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-11-03T19:47:16.978464] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-11-03T19:47:17.534892] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-11-03T19:47:18.047285] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:47:18.334884] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-11. [2025-11-03T19:47:18.697542] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T19:47:19.134874] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-11-03T19:47:19.173206] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T19:47:19.174430] [INFO ] [REMOTE ] KFY: Full fetch complete (43478 records). [2025-11-03T19:47:19.174510] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-11-03T19:47:19.573370] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-11-03T19:47:19.573452] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-11-03T19:47:19.574198] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-11-03T19:47:19.574261] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-11-03T19:47:19.575213] [DEBUG] [LOCAL ] KFY: Trimmed 43478 records to 29178 (keeping 200 days of data) [2025-11-03T19:47:19.755982] [DEBUG] [LOCAL ] KFY: Primary data saved (29178 records). [2025-11-03T19:47:19.756149] [INFO ] [MAIN ] KFY: Full history saved. [2025-11-03T19:47:19.756265] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KFY took 33.2s. Estimated remaining: 2h 46m 8s. Rate: 7.1 symbols/min [2025-11-03T19:47:19.935355] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-11-03T19:47:19.935234] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:19.956930] [DEBUG] [LOCAL ] KIO: Loaded 21988 existing records from primary storage. [2025-11-03T19:47:19.957201] [INFO ] [MAIN ] KIO: Loaded 21988 existing records. [2025-11-03T19:47:20.153785] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:20.154036] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-11-03T19:47:20.154085] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-11-03T19:47:20.154521] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-11-03T19:47:20.154579] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-11-03T19:47:20.527139] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:20.734916] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-11-03T19:47:21.210448] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-11-03T19:47:21.535728] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-11-03T19:47:21.535619] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-11-03T19:47:21.657147] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T19:47:22.334840] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-11-03T19:47:23.134874] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-11-03T19:47:23.367586] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-11-03T19:47:23.640357] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-11-03T19:47:23.862147] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-11-03T19:47:23.934883] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-11-03T19:47:24.734868] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-11-03T19:47:25.276726] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T19:47:25.536945] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-11-03T19:47:25.541397] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T19:47:26.334858] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-11-03T19:47:27.134904] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-11-03T19:47:27.402503] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-11-03T19:47:27.803265] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-11-03T19:47:27.930700] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-11-03T19:47:27.940380] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-11-03T19:47:28.702179] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T19:47:28.734838] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-11-03T19:47:29.383964] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-11-03T19:47:29.534922] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-11-03T19:47:30.334958] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-11-03T19:47:31.020726] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-11-03T19:47:31.134834] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-11-03T19:47:31.176716] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-11-03T19:47:31.934897] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-11-03T19:47:32.409219] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:47:32.734947] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-11-03T19:47:33.519262] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-11-03T19:47:33.534818] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-11-03T19:47:33.858981] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-11-03T19:47:34.334855] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-11-03T19:47:35.134841] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-11-03T19:47:35.166134] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-11-03T19:47:35.203018] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-11-03T19:47:35.934898] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-11-03T19:47:36.419871] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-11-03T19:47:36.739937] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-11-03T19:47:36.749169] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-11-03T19:47:37.534875] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-11-03T19:47:37.813029] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-11-03T19:47:38.334842] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-11-03T19:47:38.894933] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-11-03T19:47:39.134901] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-11. [2025-11-03T19:47:39.589504] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:47:39.934864] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-11-03T19:47:40.416039] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T19:47:40.417586] [INFO ] [REMOTE ] KIM: Full fetch complete (76979 records). [2025-11-03T19:47:40.417737] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-11-03T19:47:40.740064] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-11-03T19:47:40.814724] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-11-03T19:47:40.814814] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-11-03T19:47:40.815791] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-11-03T19:47:40.815852] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-11-03T19:47:40.817308] [DEBUG] [LOCAL ] KIM: Trimmed 76979 records to 52990 (keeping 200 days of data) [2025-11-03T19:47:41.139177] [DEBUG] [LOCAL ] KIM: Primary data saved (52990 records). [2025-11-03T19:47:41.139342] [INFO ] [MAIN ] KIM: Full history saved. [2025-11-03T19:47:41.139433] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KIM took 28.5s. Estimated remaining: 2h 46m 13s. Rate: 7.1 symbols/min [2025-11-03T19:47:41.336356] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:41.341395] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T19:47:41.399233] [DEBUG] [LOCAL ] KKR: Loaded 54272 existing records from primary storage. [2025-11-03T19:47:41.399578] [INFO ] [MAIN ] KKR: Loaded 54272 existing records. [2025-11-03T19:47:41.540102] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-11-03T19:47:41.578610] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:41.578809] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-11-03T19:47:41.578861] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-11-03T19:47:41.579725] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-11-03T19:47:41.579781] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-11-03T19:47:41.937730] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:42.334916] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-11-03T19:47:42.682882] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-11-03T19:47:42.713591] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-11-03T19:47:43.134903] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-11. [2025-11-03T19:47:43.799543] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T19:47:43.800628] [INFO ] [REMOTE ] KIO: Full fetch complete (32706 records). [2025-11-03T19:47:43.800722] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-11-03T19:47:43.935402] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-11. [2025-11-03T19:47:44.187112] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-11-03T19:47:44.187275] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-11-03T19:47:44.188095] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-11-03T19:47:44.188229] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-11-03T19:47:44.189579] [DEBUG] [LOCAL ] KIO: Trimmed 32706 records to 21770 (keeping 200 days of data) [2025-11-03T19:47:44.305631] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-11-03T19:47:44.364320] [DEBUG] [LOCAL ] KIO: Primary data saved (21770 records). [2025-11-03T19:47:44.364448] [INFO ] [MAIN ] KIO: Full history saved. [2025-11-03T19:47:44.364530] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KIO took 24.6s. Estimated remaining: 2h 45m 59s. Rate: 7.1 symbols/min [2025-11-03T19:47:44.530594] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:44.537129] [DEBUG] [LOCAL ] KKRS: Loaded 5495 existing records from primary storage. [2025-11-03T19:47:44.537318] [INFO ] [MAIN ] KKRS: Loaded 5495 existing records. [2025-11-03T19:47:44.732028] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:44.732237] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-11-03T19:47:44.732286] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-11-03T19:47:44.732522] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-11-03T19:47:44.732591] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-11-03T19:47:44.743801] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-11-03T19:47:45.084958] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:45.534866] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-11-03T19:47:45.633780] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-11 (1.70 seconds). [2025-11-03T19:47:45.635385] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-11-03T19:47:45.635511] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-11-03T19:47:46.056012] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-11-03T19:47:46.056096] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-11-03T19:47:46.057201] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-11-03T19:47:46.057265] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-11-03T19:47:46.058697] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 53699 (keeping 200 days of data) [2025-11-03T19:47:46.342106] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-11-03T19:47:46.396764] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-11-03T19:47:46.397715] [INFO ] [MAIN ] KGC: Full history saved. [2025-11-03T19:47:46.397820] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KGC took 40.3s. Estimated remaining: 2h 45m 44s. Rate: 7.1 symbols/min [2025-11-03T19:47:46.572144] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:46.573087] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-11-03T19:47:46.573220] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-11-03T19:47:46.573373] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-11-03T19:47:46.573606] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-11-03T19:47:46.573731] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-11-03T19:47:46.573926] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-11-03T19:47:46.715876] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-11-03T19:47:46.895000] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T19:47:47.004780] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:47.029488] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-11-03T19:47:47.134852] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-11-03T19:47:47.934876] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-11-03T19:47:48.087820] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:47:48.088143] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-11-03T19:47:48.088237] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:47:48.088312] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-11-03T19:47:48.088378] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:47:48.088451] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-11-03T19:47:48.088516] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-11-03T19:47:48.088552] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-11-03T19:47:48.088592] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-11-03T19:47:48.088666] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KKRT took 1.7s. Estimated remaining: 2h 45m 29s. Rate: 7.1 symbols/min [2025-11-03T19:47:48.275444] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:48.275607] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-11-03T19:47:48.275678] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-11-03T19:47:48.275792] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-11-03T19:47:48.275851] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-11-03T19:47:48.275908] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-11-03T19:47:48.275942] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-11-03T19:47:48.643031] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:48.672163] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-11-03T19:47:48.734895] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-11-03T19:47:48.894479] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:47:48.894841] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-11-03T19:47:48.894929] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:47:48.895006] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-11-03T19:47:48.895070] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:47:48.895140] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-11-03T19:47:48.895202] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-11-03T19:47:48.895237] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-11-03T19:47:48.895276] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-11-03T19:47:48.895321] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 45m 13s. Rate: 7.1 symbols/min [2025-11-03T19:47:49.070461] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:47:49.100959] [DEBUG] [LOCAL ] KLC: Loaded 36340 existing records from primary storage. [2025-11-03T19:47:49.101227] [INFO ] [MAIN ] KLC: Loaded 36340 existing records. [2025-11-03T19:47:49.287892] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:47:49.288118] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-11-03T19:47:49.288169] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-11-03T19:47:49.288756] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-11-03T19:47:49.288814] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-11-03T19:47:49.539920] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-11-03T19:47:49.658469] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:47:50.334840] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-11-03T19:47:51.086451] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-11-03T19:47:51.134819] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-11-03T19:47:51.527117] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-11-03T19:47:51.934871] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-11-03T19:47:52.302311] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-11-03T19:47:52.734844] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-11-03T19:47:52.775237] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-11-03T19:47:53.534870] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-11-03T19:47:53.934625] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T19:47:53.975944] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-11-03T19:47:54.334858] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-11-03T19:47:55.134859] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-11-03T19:47:55.934870] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-11-03T19:47:56.031906] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-11-03T19:47:56.063198] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-11-03T19:47:56.734898] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-11-03T19:47:57.193701] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T19:47:57.534920] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-11-03T19:47:58.272976] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-11-03T19:47:58.299999] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-11-03T19:47:58.334823] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-11-03T19:47:59.134891] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-11-03T19:47:59.721235] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-11-03T19:47:59.934823] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-11. [2025-11-03T19:48:00.137837] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-11-03T19:48:00.734922] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-11-03T19:48:00.952707] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-11 (1.02 seconds). [2025-11-03T19:48:00.954681] [INFO ] [REMOTE ] KGS: Full fetch complete (66606 records). [2025-11-03T19:48:00.954846] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-11-03T19:48:01.368014] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-11-03T19:48:01.368104] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-11-03T19:48:01.368995] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-11-03T19:48:01.369058] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-11-03T19:48:01.370411] [DEBUG] [LOCAL ] KGS: Trimmed 66606 records to 45854 (keeping 200 days of data) [2025-11-03T19:48:01.544010] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-11-03T19:48:01.651776] [DEBUG] [LOCAL ] KGS: Primary data saved (45854 records). [2025-11-03T19:48:01.651912] [INFO ] [MAIN ] KGS: Full history saved. [2025-11-03T19:48:01.652775] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KGS took 52.8s. Estimated remaining: 2h 45m 9s. Rate: 7.1 symbols/min [2025-11-03T19:48:01.842094] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:01.867676] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-11-03T19:48:01.929462] [DEBUG] [LOCAL ] KMI: Loaded 54473 existing records from primary storage. [2025-11-03T19:48:01.929792] [INFO ] [MAIN ] KMI: Loaded 54473 existing records. [2025-11-03T19:48:02.082121] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-11-03T19:48:02.126441] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:02.126711] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-11-03T19:48:02.126795] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-11-03T19:48:02.127960] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-11-03T19:48:02.128030] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-11-03T19:48:02.339978] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-11-03T19:48:02.509601] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:03.134905] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-11-03T19:48:03.931429] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-11-03T19:48:03.944594] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-11-03T19:48:04.425386] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-11-03T19:48:04.729979] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-11-03T19:48:04.740054] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-11-03T19:48:05.300085] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-11-03T19:48:05.534885] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-11-03T19:48:06.334902] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-11-03T19:48:07.047712] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T19:48:07.134875] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-11-03T19:48:07.356471] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-11-03T19:48:07.533330] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-11-03T19:48:07.934863] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-11-03T19:48:08.324742] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-11-03T19:48:08.734852] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-11-03T19:48:09.534892] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-11-03T19:48:09.901514] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-11-03T19:48:10.324489] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-11-03T19:48:10.334724] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-11-03T19:48:11.134855] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-11-03T19:48:11.807297] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T19:48:11.934826] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-11-03T19:48:12.060458] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-11-03T19:48:12.734872] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-11-03T19:48:13.461168] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-11-03T19:48:13.534849] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-11-03T19:48:13.789916] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T19:48:13.828300] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.29 seconds). [2025-11-03T19:48:14.334887] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-11-03T19:48:15.134873] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-11-03T19:48:15.934860] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-11. [2025-11-03T19:48:16.055743] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-11-03T19:48:16.095550] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T19:48:16.395692] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-11 (0.46 seconds). [2025-11-03T19:48:16.396630] [INFO ] [REMOTE ] KKRS: Full fetch complete (7673 records). [2025-11-03T19:48:16.396742] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-11-03T19:48:16.736425] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-11. [2025-11-03T19:48:16.771400] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-11-03T19:48:16.771470] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-11-03T19:48:16.771689] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-11-03T19:48:16.771749] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-11-03T19:48:16.772159] [DEBUG] [LOCAL ] KKRS: Trimmed 7673 records to 5491 (keeping 200 days of data) [2025-11-03T19:48:16.806430] [DEBUG] [LOCAL ] KKRS: Primary data saved (5491 records). [2025-11-03T19:48:16.806569] [INFO ] [MAIN ] KKRS: Full history saved. [2025-11-03T19:48:16.806678] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KKRS took 32.4s. Estimated remaining: 2h 45m 7s. Rate: 7.1 symbols/min [2025-11-03T19:48:16.971489] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:16.976202] [DEBUG] [LOCAL ] KMPB: Loaded 3429 existing records from primary storage. [2025-11-03T19:48:16.976358] [INFO ] [MAIN ] KMPB: Loaded 3429 existing records. [2025-11-03T19:48:17.148293] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:17.148532] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-11-03T19:48:17.148581] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-11-03T19:48:17.148916] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-11-03T19:48:17.148974] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-11-03T19:48:17.496587] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:17.534827] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-11-03T19:48:17.834619] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-11-03T19:48:18.014949] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T19:48:18.016454] [INFO ] [REMOTE ] KKR: Full fetch complete (77656 records). [2025-11-03T19:48:18.016542] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-11-03T19:48:18.348550] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-11-03T19:48:18.405856] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-11-03T19:48:18.405948] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-11-03T19:48:18.406950] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-11-03T19:48:18.407016] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-11-03T19:48:18.408511] [DEBUG] [LOCAL ] KKR: Trimmed 77656 records to 53492 (keeping 200 days of data) [2025-11-03T19:48:18.730747] [DEBUG] [LOCAL ] KKR: Primary data saved (53492 records). [2025-11-03T19:48:18.730878] [INFO ] [MAIN ] KKR: Full history saved. [2025-11-03T19:48:18.730954] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KKR took 37.6s. Estimated remaining: 2h 44m 52s. Rate: 7.1 symbols/min [2025-11-03T19:48:18.896363] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:18.931158] [DEBUG] [LOCAL ] KMPR: Loaded 41175 existing records from primary storage. [2025-11-03T19:48:18.931425] [INFO ] [MAIN ] KMPR: Loaded 41175 existing records. [2025-11-03T19:48:19.104228] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:19.104407] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-11-03T19:48:19.104453] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-11-03T19:48:19.105164] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-11-03T19:48:19.105223] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-11-03T19:48:19.139928] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-11-03T19:48:19.460988] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:19.480972] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T19:48:19.934901] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-11-03T19:48:20.661304] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-11-03T19:48:20.734815] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-11-03T19:48:20.818721] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-11-03T19:48:21.534871] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-11-03T19:48:21.767189] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T19:48:22.334884] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-11. [2025-11-03T19:48:23.133045] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-11-03T19:48:23.142909] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-11-03T19:48:23.207546] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-11 (0.87 seconds). [2025-11-03T19:48:23.208970] [INFO ] [REMOTE ] KLC: Full fetch complete (51001 records). [2025-11-03T19:48:23.209050] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-11-03T19:48:23.476351] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-11-03T19:48:23.591311] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-11-03T19:48:23.591400] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-11-03T19:48:23.592199] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-11-03T19:48:23.592267] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-11-03T19:48:23.593468] [DEBUG] [LOCAL ] KLC: Trimmed 51001 records to 35768 (keeping 200 days of data) [2025-11-03T19:48:23.791551] [DEBUG] [LOCAL ] KLC: Primary data saved (35768 records). [2025-11-03T19:48:23.791720] [INFO ] [MAIN ] KLC: Full history saved. [2025-11-03T19:48:23.791810] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KLC took 34.9s. Estimated remaining: 2h 44m 40s. Rate: 7.1 symbols/min [2025-11-03T19:48:23.937062] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-11-03T19:48:23.960552] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:23.997550] [DEBUG] [LOCAL ] KMT: Loaded 42929 existing records from primary storage. [2025-11-03T19:48:23.997857] [INFO ] [MAIN ] KMT: Loaded 42929 existing records. [2025-11-03T19:48:24.171704] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:24.171906] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-11-03T19:48:24.171952] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-11-03T19:48:24.172621] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-11-03T19:48:24.172713] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-11-03T19:48:24.533013] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:24.734834] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-11-03T19:48:24.900969] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-11-03T19:48:25.534886] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-11-03T19:48:26.334873] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-11-03T19:48:26.443883] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-11-03T19:48:26.623376] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-11-03T19:48:26.736897] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-11-03T19:48:27.134863] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-11-03T19:48:27.509136] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-11-03T19:48:27.934907] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-11-03T19:48:28.734877] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-11-03T19:48:29.045497] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-11-03T19:48:29.069622] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-11-03T19:48:29.534867] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-11-03T19:48:30.334913] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-11-03T19:48:30.592810] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-11-03T19:48:31.134905] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-11-03T19:48:31.465108] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-11-03T19:48:31.589950] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T19:48:31.934856] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-11-03T19:48:32.288511] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-11-03T19:48:32.734863] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-11-03T19:48:33.534849] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-11-03T19:48:33.887902] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-11-03T19:48:34.051563] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-11-03T19:48:34.334845] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-11-03T19:48:35.134855] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-11-03T19:48:35.350273] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T19:48:35.934892] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-11-03T19:48:36.445114] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-11-03T19:48:36.734853] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-11-03T19:48:36.975816] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T19:48:37.534851] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-11-03T19:48:38.177872] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-11-03T19:48:38.334813] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-11-03T19:48:38.542117] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-11-03T19:48:39.134862] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-11-03T19:48:39.513487] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-11-03T19:48:39.556105] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-11-03T19:48:39.934874] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-11-03T19:48:40.734847] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-11-03T19:48:41.035741] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-11-03T19:48:41.534867] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-11-03T19:48:41.842122] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-11-03T19:48:42.284149] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-11-03T19:48:42.334812] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-11. [2025-11-03T19:48:43.134874] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-11-03T19:48:43.517808] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-11 (1.18 seconds). [2025-11-03T19:48:43.519352] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-11-03T19:48:43.519444] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-11-03T19:48:43.927825] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-11-03T19:48:43.927910] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-11-03T19:48:43.928916] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-11-03T19:48:43.928980] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-11-03T19:48:43.930376] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-11-03T19:48:43.984046] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-11-03T19:48:44.279367] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-11-03T19:48:44.305830] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-11-03T19:48:44.305946] [INFO ] [MAIN ] KMI: Full history saved. [2025-11-03T19:48:44.306806] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KMI took 42.7s. Estimated remaining: 2h 44m 44s. Rate: 7.1 symbols/min [2025-11-03T19:48:44.734906] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-11. [2025-11-03T19:48:45.102106] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-11 (0.37 seconds). [2025-11-03T19:48:45.102778] [INFO ] [REMOTE ] KMPB: Full fetch complete (4906 records). [2025-11-03T19:48:45.102846] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-11-03T19:48:45.474628] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-11-03T19:48:45.474861] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-11-03T19:48:45.475095] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-11-03T19:48:45.475213] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-11-03T19:48:45.475909] [DEBUG] [LOCAL ] KMPB: Trimmed 4906 records to 3376 (keeping 200 days of data) [2025-11-03T19:48:45.517102] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T19:48:45.534921] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-11-03T19:48:45.539796] [DEBUG] [LOCAL ] KMPB: Primary data saved (3376 records). [2025-11-03T19:48:45.540357] [INFO ] [MAIN ] KMPB: Full history saved. [2025-11-03T19:48:45.540578] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KMPB took 28.7s. Estimated remaining: 2h 44m 28s. Rate: 7.1 symbols/min [2025-11-03T19:48:46.334893] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-11-03T19:48:46.691333] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-11-03T19:48:47.134908] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-11-03T19:48:47.529357] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:48:47.934865] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-11-03T19:48:48.399423] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-11-03T19:48:48.734879] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-11-03T19:48:49.082036] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T19:48:49.534928] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-11. [2025-11-03T19:48:49.798103] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T19:48:50.334873] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-11-03T19:48:50.581317] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T19:48:50.582618] [INFO ] [REMOTE ] KMPR: Full fetch complete (54485 records). [2025-11-03T19:48:50.582729] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-11-03T19:48:50.956021] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-11-03T19:48:50.956101] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-11-03T19:48:50.956978] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-11-03T19:48:50.957041] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-11-03T19:48:50.958243] [DEBUG] [LOCAL ] KMPR: Trimmed 54485 records to 40646 (keeping 200 days of data) [2025-11-03T19:48:51.193291] [DEBUG] [LOCAL ] KMPR: Primary data saved (40646 records). [2025-11-03T19:48:51.193411] [INFO ] [MAIN ] KMPR: Full history saved. [2025-11-03T19:48:51.193482] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KMPR took 32.5s. Estimated remaining: 2h 44m 17s. Rate: 7.1 symbols/min [2025-11-03T19:48:51.436339] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-11-03T19:48:51.446170] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-11. [2025-11-03T19:48:52.302728] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-11 (0.86 seconds). [2025-11-03T19:48:52.304030] [INFO ] [REMOTE ] KMT: Full fetch complete (61778 records). [2025-11-03T19:48:52.304111] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-11-03T19:48:52.675838] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-11-03T19:48:52.675920] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-11-03T19:48:52.676784] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-11-03T19:48:52.676846] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-11-03T19:48:52.678084] [DEBUG] [LOCAL ] KMT: Trimmed 61778 records to 42219 (keeping 200 days of data) [2025-11-03T19:48:52.936735] [DEBUG] [LOCAL ] KMT: Primary data saved (42219 records). [2025-11-03T19:48:52.936847] [INFO ] [MAIN ] KMT: Full history saved. [2025-11-03T19:48:52.936940] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMT took 29.1s. Estimated remaining: 2h 44m 2s. Rate: 7.1 symbols/min [2025-11-03T19:48:53.646508] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:53.617711] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:53.643077] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:53.666768] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:48:53.667188] [DEBUG] [LOCAL ] KMX: No existing data file found in primary storage. [2025-11-03T19:48:53.667463] [WARN ] [MAIN ] KMX: No existing data found, performing full refresh instead. [2025-11-03T19:48:53.669893] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-11-03T19:48:53.670092] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-11-03T19:48:53.670289] [DEBUG] [LOCAL ] KMX: No primary data file found to delete. [2025-11-03T19:48:53.670350] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-11-03T19:48:53.783329] [DEBUG] [LOCAL ] KNOP: Loaded 9845 existing records from primary storage. [2025-11-03T19:48:53.793549] [INFO ] [MAIN ] KNOP: Loaded 9845 existing records. [2025-11-03T19:48:53.999098] [DEBUG] [LOCAL ] KNF: Loaded 37240 existing records from primary storage. [2025-11-03T19:48:54.045241] [INFO ] [MAIN ] KNF: Loaded 37240 existing records. [2025-11-03T19:48:54.094357] [DEBUG] [LOCAL ] KN: Loaded 38691 existing records from primary storage. [2025-11-03T19:48:54.209689] [INFO ] [MAIN ] KN: Loaded 38691 existing records. [2025-11-03T19:48:54.443996] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:54.528528] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:54.548101] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-11-03T19:48:54.548406] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-11-03T19:48:54.552442] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-11-03T19:48:54.604565] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-11-03T19:48:54.625356] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-11-03T19:48:54.768614] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:54.763927] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:48:54.795155] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-11-03T19:48:54.807297] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-11-03T19:48:54.826022] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-11-03T19:48:54.818406] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-11-03T19:48:54.830369] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-11-03T19:48:54.846364] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-11-03T19:48:54.830837] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-11-03T19:48:54.879797] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-11-03T19:48:55.687461] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:55.742577] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-11-03T19:48:55.895190] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:55.903271] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-11-03T19:48:55.909724] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:48:55.910772] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-11-03T19:48:56.021328] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-11-03T19:48:56.031522] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-11-03T19:48:56.359132] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-11-03T19:48:56.361543] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-11-03T19:48:56.823855] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-11-03T19:48:56.826334] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-11-03T19:48:56.862626] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-11-03T19:48:56.919147] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T19:48:57.082035] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T19:48:57.352428] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-11-03T19:48:57.534940] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-11-03T19:48:58.334842] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-11-03T19:48:58.863222] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T19:48:59.085003] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-11-03T19:48:59.134867] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-11-03T19:48:59.934911] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-11-03T19:49:00.119922] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-11-03T19:49:00.734866] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-11-03T19:49:01.414102] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-11-03T19:49:01.534900] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-11-03T19:49:01.728269] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T19:49:02.254612] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-11-03T19:49:02.334914] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-11-03T19:49:02.869559] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T19:49:03.134911] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-11-03T19:49:03.934913] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-11-03T19:49:04.357748] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T19:49:04.734931] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-11-03T19:49:05.273554] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-11-03T19:49:05.534825] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-11-03T19:49:05.721268] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T19:49:05.995739] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-11-03T19:49:06.334876] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-11-03T19:49:07.134918] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-11-03T19:49:07.633242] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T19:49:07.934898] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-11-03T19:49:08.183536] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T19:49:08.734892] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-11-03T19:49:09.034442] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:49:09.314367] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-11-03T19:49:09.534893] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-11-03T19:49:10.334830] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-11-03T19:49:10.445030] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-11-03T19:49:11.134861] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-11-03T19:49:11.256912] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T19:49:11.934934] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-11-03T19:49:12.193998] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-11-03T19:49:12.734964] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-11-03T19:49:12.974708] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:49:13.534887] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-11-03T19:49:13.964395] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T19:49:14.334868] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-11-03T19:49:14.636587] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-11-03T19:49:15.134850] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-11-03T19:49:15.290850] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-11-03T19:49:15.934872] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-11-03T19:49:16.223001] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-11-03T19:49:16.734951] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-11-03T19:49:17.214840] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-11-03T19:49:17.534924] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-11-03T19:49:17.805972] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T19:49:18.334859] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-11-03T19:49:18.782826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-11-03T19:49:18.857444] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T19:49:19.134903] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-11-03T19:49:19.725770] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-11-03T19:49:19.934911] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-11-03T19:49:20.734935] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-11. [2025-11-03T19:49:21.465621] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T19:49:21.534836] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-11-03T19:49:21.876867] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-11 (1.14 seconds). [2025-11-03T19:49:21.878526] [INFO ] [REMOTE ] KNF: Full fetch complete (51852 records). [2025-11-03T19:49:21.878612] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-11-03T19:49:22.270880] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-11-03T19:49:22.270958] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-11-03T19:49:22.271767] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-11-03T19:49:22.271830] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-11-03T19:49:22.272893] [DEBUG] [LOCAL ] KNF: Trimmed 51852 records to 36837 (keeping 200 days of data) [2025-11-03T19:49:22.355468] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-11-03T19:49:22.501462] [DEBUG] [LOCAL ] KNF: Primary data saved (36837 records). [2025-11-03T19:49:22.501863] [INFO ] [MAIN ] KNF: Full history saved. [2025-11-03T19:49:22.501977] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KNF took 29.6s. Estimated remaining: 2h 44m 14s. Rate: 7.1 symbols/min [2025-11-03T19:49:22.665560] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:49:22.683399] [DEBUG] [LOCAL ] KNSL: Loaded 19031 existing records from primary storage. [2025-11-03T19:49:22.683633] [INFO ] [MAIN ] KNSL: Loaded 19031 existing records. [2025-11-03T19:49:22.860673] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:49:22.860970] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-11-03T19:49:22.861020] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-11-03T19:49:22.861841] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-11-03T19:49:22.861899] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-11-03T19:49:23.136773] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-11-03T19:49:23.234219] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-11-03T19:49:23.240179] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:49:23.274894] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-11-03T19:49:23.934850] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-11-03T19:49:24.248516] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-11-03T19:49:24.734901] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-11-03T19:49:25.472616] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-11-03T19:49:25.534816] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-11. [2025-11-03T19:49:25.552263] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-11-03T19:49:26.334877] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-11. [2025-11-03T19:49:26.770578] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-11 (1.24 seconds). [2025-11-03T19:49:26.772153] [INFO ] [REMOTE ] KMX: Full fetch complete (76503 records). [2025-11-03T19:49:26.772287] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-11-03T19:49:27.137586] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-11-03T19:49:27.156241] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-11-03T19:49:27.157073] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-11-03T19:49:27.158117] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-11-03T19:49:27.158266] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-11-03T19:49:27.159768] [DEBUG] [LOCAL ] KMX: Trimmed 76503 records to 53286 (keeping 200 days of data) [2025-11-03T19:49:27.262345] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-11 (0.93 seconds). [2025-11-03T19:49:27.265693] [INFO ] [REMOTE ] KN: Full fetch complete (56974 records). [2025-11-03T19:49:27.266450] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-11-03T19:49:27.768965] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-11-03T19:49:27.769072] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-11-03T19:49:27.780723] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-11-03T19:49:27.782389] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-11-03T19:49:27.797527] [DEBUG] [LOCAL ] KN: Trimmed 56974 records to 38038 (keeping 200 days of data) [2025-11-03T19:49:27.954374] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-11. [2025-11-03T19:49:27.980362] [DEBUG] [LOCAL ] KMX: Primary data saved (53286 records). [2025-11-03T19:49:28.002212] [INFO ] [MAIN ] KMX: Full history saved. [2025-11-03T19:49:28.004272] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KMX took 35.1s. Estimated remaining: 2h 44m 3s. Rate: 7.1 symbols/min [2025-11-03T19:49:28.004151] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:49:28.278164] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:49:28.292695] [DEBUG] [LOCAL ] KN: Primary data saved (38038 records). [2025-11-03T19:49:28.292985] [INFO ] [MAIN ] KN: Full history saved. [2025-11-03T19:49:28.293107] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KN took 35.3s. Estimated remaining: 2h 43m 47s. Rate: 7.1 symbols/min [2025-11-03T19:49:28.466986] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:49:28.498012] [DEBUG] [LOCAL ] KNTK: Loaded 47829 existing records from primary storage. [2025-11-03T19:49:28.498336] [INFO ] [MAIN ] KNTK: Loaded 47829 existing records. [2025-11-03T19:49:28.586906] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-11 (0.63 seconds). [2025-11-03T19:49:28.605371] [INFO ] [REMOTE ] KNOP: Full fetch complete (14845 records). [2025-11-03T19:49:28.629612] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-11-03T19:49:28.738581] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:49:28.738682] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-11-03T19:49:28.757862] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-11-03T19:49:28.767868] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-11-03T19:49:28.774926] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-11-03T19:49:28.813974] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-11-03T19:49:28.839822] [DEBUG] [LOCAL ] KNX: Loaded 53418 existing records from primary storage. [2025-11-03T19:49:28.877678] [INFO ] [MAIN ] KNX: Loaded 53418 existing records. [2025-11-03T19:49:29.505127] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:49:29.569099] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-11-03T19:49:29.574635] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-11-03T19:49:29.592200] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-11-03T19:49:29.609267] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-11-03T19:49:29.609551] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-11-03T19:49:29.646596] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-11-03T19:49:29.646233] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-11-03T19:49:29.647181] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-11-03T19:49:29.785101] [DEBUG] [LOCAL ] KNOP: Trimmed 14845 records to 9943 (keeping 200 days of data) [2025-11-03T19:49:29.836257] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:49:29.854866] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-11-03T19:49:29.934615] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T19:49:30.221527] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:49:30.224935] [DEBUG] [LOCAL ] KNOP: Primary data saved (9943 records). [2025-11-03T19:49:30.225378] [INFO ] [MAIN ] KNOP: Full history saved. [2025-11-03T19:49:30.225489] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KNOP took 37.3s. Estimated remaining: 2h 43m 32s. Rate: 7.1 symbols/min [2025-11-03T19:49:30.337214] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-11-03T19:49:30.411283] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:49:30.411538] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-11-03T19:49:30.411592] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-11-03T19:49:30.411743] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-11-03T19:49:30.411790] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-11-03T19:49:30.411833] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-11-03T19:49:30.411866] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-11-03T19:49:30.775044] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:49:31.044433] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-11-03T19:49:31.118702] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-11-03T19:49:31.134874] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-11-03T19:49:31.934849] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-11-03T19:49:32.597932] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-11-03T19:49:32.734826] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-11-03T19:49:33.077904] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-11-03T19:49:33.534861] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-11-03T19:49:34.029030] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-11-03T19:49:34.334852] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-11-03T19:49:34.564112] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-11-03T19:49:35.134855] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-11-03T19:49:35.934862] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-11-03T19:49:36.247726] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-11-03T19:49:36.461622] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-11-03T19:49:36.734856] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-11-03T19:49:37.054569] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T19:49:37.534887] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-11-03T19:49:38.334844] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-11-03T19:49:38.457468] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-11-03T19:49:38.626453] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-11-03T19:49:39.054556] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T19:49:39.134873] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-11-03T19:49:39.934863] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-11-03T19:49:39.953964] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-11-03T19:49:40.734915] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-11-03T19:49:41.188376] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:49:41.534930] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-11-03T19:49:42.210715] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-11-03T19:49:42.247287] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-11-03T19:49:42.334846] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-11-03T19:49:43.134870] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-11-03T19:49:43.743754] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-11-03T19:49:43.934851] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-11-03T19:49:44.411606] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-11-03T19:49:44.734867] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-11-03T19:49:45.202487] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-11-03T19:49:45.534955] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-11-03T19:49:46.334975] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-11-03T19:49:46.780756] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-11-03T19:49:46.989900] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-11-03T19:49:47.121825] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T19:49:47.134824] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-11-03T19:49:47.934856] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-11-03T19:49:48.083500] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-11-03T19:49:48.734916] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-11-03T19:49:49.082571] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-11-03T19:49:49.534902] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-11-03T19:49:50.334878] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-11-03T19:49:50.707372] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-11-03T19:49:50.804191] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:49:51.134906] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-11-03T19:49:51.479303] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-11-03T19:49:51.934889] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-11-03T19:49:52.491084] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T19:49:52.734861] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-11. [2025-11-03T19:49:53.330977] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T19:49:53.480032] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-11 (0.75 seconds). [2025-11-03T19:49:53.481213] [INFO ] [REMOTE ] KNSL: Full fetch complete (27607 records). [2025-11-03T19:49:53.481282] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-11-03T19:49:53.541248] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-11. [2025-11-03T19:49:53.846777] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-11-03T19:49:53.846910] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-11-03T19:49:53.847677] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-11-03T19:49:53.847740] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-11-03T19:49:53.848378] [DEBUG] [LOCAL ] KNSL: Trimmed 27607 records to 19035 (keeping 200 days of data) [2025-11-03T19:49:53.962872] [DEBUG] [LOCAL ] KNSL: Primary data saved (19035 records). [2025-11-03T19:49:53.963004] [INFO ] [MAIN ] KNSL: Full history saved. [2025-11-03T19:49:53.963080] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNSL took 31.5s. Estimated remaining: 2h 43m 38s. Rate: 7.1 symbols/min [2025-11-03T19:49:54.128689] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:49:54.165162] [DEBUG] [LOCAL ] KODK: Loaded 43881 existing records from primary storage. [2025-11-03T19:49:54.165446] [INFO ] [MAIN ] KODK: Loaded 43881 existing records. [2025-11-03T19:49:54.335885] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-11-03T19:49:54.339475] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:49:54.340830] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-11-03T19:49:54.340887] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-11-03T19:49:54.341709] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-11-03T19:49:54.341769] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-11-03T19:49:54.693445] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:49:54.888170] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-11 (1.35 seconds). [2025-11-03T19:49:54.889698] [INFO ] [REMOTE ] KNTK: Full fetch complete (66287 records). [2025-11-03T19:49:54.889810] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-11-03T19:49:55.142224] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-11-03T19:49:55.290473] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-11-03T19:49:55.290584] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-11-03T19:49:55.291570] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-11-03T19:49:55.291635] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-11-03T19:49:55.293098] [DEBUG] [LOCAL ] KNTK: Trimmed 66287 records to 47182 (keeping 200 days of data) [2025-11-03T19:49:55.575904] [DEBUG] [LOCAL ] KNTK: Primary data saved (47182 records). [2025-11-03T19:49:55.576016] [INFO ] [MAIN ] KNTK: Full history saved. [2025-11-03T19:49:55.576950] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNTK took 27.6s. Estimated remaining: 2h 43m 23s. Rate: 7.1 symbols/min [2025-11-03T19:49:55.746580] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:49:55.771773] [DEBUG] [LOCAL ] KOF: Loaded 26323 existing records from primary storage. [2025-11-03T19:49:55.772017] [INFO ] [MAIN ] KOF: Loaded 26323 existing records. [2025-11-03T19:49:55.946609] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-11-03T19:49:55.955566] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:49:55.957171] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-11-03T19:49:55.957285] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-11-03T19:49:55.958469] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-11-03T19:49:55.958716] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-11-03T19:49:56.323890] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:49:56.383473] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T19:49:56.399769] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-11-03T19:49:56.734973] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-11-03T19:49:57.220352] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-11-03T19:49:57.534893] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-11-03T19:49:57.650172] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-11-03T19:49:58.334920] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-11-03T19:49:58.793039] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:49:59.134943] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-11-03T19:49:59.210565] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-11-03T19:49:59.934909] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-11-03T19:50:00.734884] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-11-03T19:50:01.206239] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T19:50:01.534874] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-11-03T19:50:01.678179] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T19:50:01.676619] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-11-03T19:50:02.334913] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-11-03T19:50:02.796105] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T19:50:03.134894] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-11-03T19:50:03.923208] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-11-03T19:50:03.935373] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-11-03T19:50:04.125954] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T19:50:04.734910] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-11-03T19:50:05.534878] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-11. [2025-11-03T19:50:05.891143] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T19:50:05.933093] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-11-03T19:50:06.334860] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-11-03T19:50:06.668811] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-11 (1.13 seconds). [2025-11-03T19:50:06.670307] [INFO ] [REMOTE ] KNX: Full fetch complete (76378 records). [2025-11-03T19:50:06.670437] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-11-03T19:50:07.075290] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-11-03T19:50:07.075390] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-11-03T19:50:07.076383] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-11-03T19:50:07.076500] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-11-03T19:50:07.078296] [DEBUG] [LOCAL ] KNX: Trimmed 76378 records to 52646 (keeping 200 days of data) [2025-11-03T19:50:07.142821] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-11-03T19:50:07.203268] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-11-03T19:50:07.441442] [DEBUG] [LOCAL ] KNX: Primary data saved (52646 records). [2025-11-03T19:50:07.441568] [INFO ] [MAIN ] KNX: Full history saved. [2025-11-03T19:50:07.441734] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNX took 39.1s. Estimated remaining: 2h 43m 18s. Rate: 7.1 symbols/min [2025-11-03T19:50:07.619990] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:07.635679] [DEBUG] [LOCAL ] KOP: Loaded 17407 existing records from primary storage. [2025-11-03T19:50:07.635907] [INFO ] [MAIN ] KOP: Loaded 17407 existing records. [2025-11-03T19:50:07.820146] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:07.820379] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-11-03T19:50:07.820454] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-11-03T19:50:07.820852] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-11-03T19:50:07.820912] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-11-03T19:50:07.940084] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-11-03T19:50:08.197706] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:08.423539] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-11-03T19:50:08.734929] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-11-03T19:50:09.371885] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-11-03T19:50:09.534887] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-11-03T19:50:09.791127] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-11-03T19:50:10.150780] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-11-03T19:50:10.334923] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-11-03T19:50:11.134875] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-11-03T19:50:11.256146] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T19:50:11.934873] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-11-03T19:50:12.108020] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-11-03T19:50:12.734867] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-11-03T19:50:13.303721] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-11-03T19:50:13.534852] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-11-03T19:50:14.334849] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-11-03T19:50:14.468979] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-11-03T19:50:14.940150] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-11-03T19:50:14.966176] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-11-03T19:50:15.134870] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-11. [2025-11-03T19:50:15.934888] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-11-03T19:50:16.698624] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T19:50:16.734858] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-11-03T19:50:17.088380] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-11 (1.95 seconds). [2025-11-03T19:50:17.089887] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-11-03T19:50:17.089992] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-11-03T19:50:17.290769] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-11-03T19:50:17.291716] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:50:17.291928] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:50:17.292075] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-11-03T19:50:17.292174] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-11-03T19:50:17.292225] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-11-03T19:50:17.292272] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-11-03T19:50:17.292336] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KO took 47.1s. Estimated remaining: 2h 43m 11s. Rate: 7.1 symbols/min [2025-11-03T19:50:17.482437] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-11-03T19:50:17.485703] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:17.493444] [DEBUG] [LOCAL ] KORE: Loaded 2354 existing records from primary storage. [2025-11-03T19:50:17.493587] [INFO ] [MAIN ] KORE: Loaded 2354 existing records. [2025-11-03T19:50:17.539956] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-11-03T19:50:17.699152] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:17.699382] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-11-03T19:50:17.699434] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-11-03T19:50:17.699619] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-11-03T19:50:17.699716] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-11-03T19:50:18.058108] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:18.295499] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-11-03T19:50:18.334846] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-11-03T19:50:18.875997] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-11-03T19:50:19.134853] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-11-03T19:50:19.511576] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-11-03T19:50:19.934868] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-11-03T19:50:20.214745] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-11-03T19:50:20.734856] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-11-03T19:50:21.036570] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-11-03T19:50:21.534851] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-11-03T19:50:21.842317] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-11-03T19:50:22.334852] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-11-03T19:50:22.638465] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-11-03T19:50:23.134853] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-11-03T19:50:23.524113] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-11-03T19:50:23.934863] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-11-03T19:50:24.574692] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T19:50:24.734901] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-11-03T19:50:25.069871] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-11-03T19:50:25.534888] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-11-03T19:50:25.820308] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-11-03T19:50:26.334850] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-11-03T19:50:26.733204] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T19:50:27.134856] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-11. [2025-11-03T19:50:27.540979] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-11 (0.41 seconds). [2025-11-03T19:50:27.541631] [INFO ] [REMOTE ] KORE: Full fetch complete (3641 records). [2025-11-03T19:50:27.541722] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-11-03T19:50:27.894068] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-11-03T19:50:27.894142] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-11-03T19:50:27.894252] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-11-03T19:50:27.894289] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-11-03T19:50:27.894616] [DEBUG] [LOCAL ] KORE: Trimmed 3641 records to 2342 (keeping 200 days of data) [2025-11-03T19:50:27.907642] [DEBUG] [LOCAL ] KORE: Primary data saved (2342 records). [2025-11-03T19:50:27.907750] [INFO ] [MAIN ] KORE: Full history saved. [2025-11-03T19:50:27.907820] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KORE took 10.6s. Estimated remaining: 2h 43m 4s. Rate: 7.1 symbols/min [2025-11-03T19:50:27.939922] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-11-03T19:50:28.080517] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:28.127306] [DEBUG] [LOCAL ] KOS: Loaded 53855 existing records from primary storage. [2025-11-03T19:50:28.127688] [INFO ] [MAIN ] KOS: Loaded 53855 existing records. [2025-11-03T19:50:28.308615] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:28.308846] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-11-03T19:50:28.308893] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-11-03T19:50:28.309670] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-11-03T19:50:28.309731] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-11-03T19:50:28.660249] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:28.734827] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-11-03T19:50:29.341099] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T19:50:29.534850] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-11-03T19:50:30.047366] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:50:30.336452] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-11-03T19:50:30.338054] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-11-03T19:50:31.134847] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-11-03T19:50:31.653604] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-11-03T19:50:31.868103] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-11-03T19:50:31.934858] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-11-03T19:50:32.594578] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-11-03T19:50:32.734843] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-11-03T19:50:33.500687] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-11-03T19:50:33.534833] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-11-03T19:50:34.334826] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-11-03T19:50:34.440711] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-11-03T19:50:35.134844] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-11-03T19:50:35.854067] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T19:50:35.934858] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-11-03T19:50:36.140249] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T19:50:36.734923] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-11. [2025-11-03T19:50:37.045846] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T19:50:37.268312] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-11 (0.53 seconds). [2025-11-03T19:50:37.269302] [INFO ] [REMOTE ] KOP: Full fetch complete (25504 records). [2025-11-03T19:50:37.269375] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-11-03T19:50:37.540011] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-11. [2025-11-03T19:50:37.638112] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-11-03T19:50:37.638205] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-11-03T19:50:37.638852] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-11-03T19:50:37.638917] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-11-03T19:50:37.639778] [DEBUG] [LOCAL ] KOP: Trimmed 25504 records to 17218 (keeping 200 days of data) [2025-11-03T19:50:37.741599] [DEBUG] [LOCAL ] KOP: Primary data saved (17218 records). [2025-11-03T19:50:37.741763] [INFO ] [MAIN ] KOP: Full history saved. [2025-11-03T19:50:37.741851] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KOP took 30.3s. Estimated remaining: 2h 42m 57s. Rate: 7.1 symbols/min [2025-11-03T19:50:37.914448] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:37.962188] [DEBUG] [LOCAL ] KR: Loaded 54461 existing records from primary storage. [2025-11-03T19:50:37.962540] [INFO ] [MAIN ] KR: Loaded 54461 existing records. [2025-11-03T19:50:38.144314] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:38.144604] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-11-03T19:50:38.144694] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-11-03T19:50:38.145613] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-11-03T19:50:38.145706] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-11-03T19:50:38.346578] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-11-03T19:50:38.363182] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-11 (0.82 seconds). [2025-11-03T19:50:38.411067] [INFO ] [REMOTE ] KOF: Full fetch complete (37856 records). [2025-11-03T19:50:38.422126] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-11-03T19:50:38.629678] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:38.941610] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-11-03T19:50:38.941713] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-11-03T19:50:38.942390] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-11-03T19:50:38.942435] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-11-03T19:50:38.943301] [DEBUG] [LOCAL ] KOF: Trimmed 37856 records to 25971 (keeping 200 days of data) [2025-11-03T19:50:39.097701] [DEBUG] [LOCAL ] KOF: Primary data saved (25971 records). [2025-11-03T19:50:39.097831] [INFO ] [MAIN ] KOF: Full history saved. [2025-11-03T19:50:39.097910] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KOF took 43.5s. Estimated remaining: 2h 42m 42s. Rate: 7.1 symbols/min [2025-11-03T19:50:39.140854] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-11-03T19:50:39.270390] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:39.311175] [DEBUG] [LOCAL ] KRC: Loaded 48599 existing records from primary storage. [2025-11-03T19:50:39.311464] [INFO ] [MAIN ] KRC: Loaded 48599 existing records. [2025-11-03T19:50:39.485836] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:39.486033] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-11-03T19:50:39.486081] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-11-03T19:50:39.486951] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-11-03T19:50:39.487009] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-11-03T19:50:39.847068] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:39.872969] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-11-03T19:50:39.934831] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-11. [2025-11-03T19:50:40.513234] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-11-03T19:50:40.734881] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-11-03T19:50:41.019702] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-11 (1.08 seconds). [2025-11-03T19:50:41.021007] [INFO ] [REMOTE ] KODK: Full fetch complete (63021 records). [2025-11-03T19:50:41.021203] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-11-03T19:50:41.411088] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-11-03T19:50:41.411177] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-11-03T19:50:41.412093] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-11-03T19:50:41.412160] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-11-03T19:50:41.413482] [DEBUG] [LOCAL ] KODK: Trimmed 63021 records to 43194 (keeping 200 days of data) [2025-11-03T19:50:41.571769] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-11-03T19:50:41.663905] [DEBUG] [LOCAL ] KODK: Primary data saved (43194 records). [2025-11-03T19:50:41.664031] [INFO ] [MAIN ] KODK: Full history saved. [2025-11-03T19:50:41.664109] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KODK took 47.7s. Estimated remaining: 2h 42m 28s. Rate: 7.1 symbols/min [2025-11-03T19:50:41.843457] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:41.876319] [DEBUG] [LOCAL ] KREF: Loaded 38409 existing records from primary storage. [2025-11-03T19:50:41.876836] [INFO ] [MAIN ] KREF: Loaded 38409 existing records. [2025-11-03T19:50:42.063891] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:42.064297] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-11-03T19:50:42.064414] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-11-03T19:50:42.065312] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-11-03T19:50:42.065391] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-11-03T19:50:42.199864] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T19:50:42.341929] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-11-03T19:50:42.468194] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:42.712780] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-11-03T19:50:43.134965] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-11-03T19:50:43.727947] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-11-03T19:50:43.934892] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-11-03T19:50:44.294743] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:50:44.734856] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-11-03T19:50:44.793112] [DEBUG] [REMOTE ] KRC: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-11-03T19:50:44.793424] [WARN ] [REMOTE ] KRC: No data returned for month 2025-03 [2025-11-03T19:50:44.793515] [FATAL] [REMOTE ] KRC: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:50:44.793590] [FATAL] [MAIN ] KRC: Failed to fetch primary data. [2025-11-03T19:50:44.793674] [WARN ] [MAIN ] KRC: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:50:44.793743] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-11-03T19:50:44.793804] [DEBUG] [LOCAL ] KRC: No primary data file found to delete. [2025-11-03T19:50:44.793839] [INFO ] [LOCAL ] KRC: Starting deletion of derivative data. [2025-11-03T19:50:44.793993] [DEBUG] [LOCAL ] KRC: Deleted derivative data file. [2025-11-03T19:50:44.794610] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KRC took 5.7s. Estimated remaining: 2h 42m 14s. Rate: 7.1 symbols/min [2025-11-03T19:50:44.958963] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:45.002958] [DEBUG] [LOCAL ] KRG: Loaded 49947 existing records from primary storage. [2025-11-03T19:50:45.003261] [INFO ] [MAIN ] KRG: Loaded 49947 existing records. [2025-11-03T19:50:45.181777] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:45.181974] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-11-03T19:50:45.182020] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-11-03T19:50:45.182882] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-11-03T19:50:45.182938] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-11-03T19:50:45.565469] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:45.559743] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-11-03T19:50:45.595638] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-11-03T19:50:46.334826] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-11-03T19:50:46.523876] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:50:47.134896] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-11-03T19:50:47.485315] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-11-03T19:50:47.934865] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-11-03T19:50:48.707151] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-11-03T19:50:48.734814] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-11-03T19:50:49.028951] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-11-03T19:50:49.534919] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-11-03T19:50:50.268687] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T19:50:50.334845] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-11-03T19:50:50.759588] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T19:50:51.134854] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-11-03T19:50:51.609806] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T19:50:51.934894] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-11-03T19:50:52.432538] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T19:50:52.734912] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-11-03T19:50:53.534984] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-11-03T19:50:53.622076] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-11-03T19:50:54.207888] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T19:50:54.334876] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-11. [2025-11-03T19:50:54.408510] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-11-03T19:50:55.134890] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-11-03T19:50:55.452493] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T19:50:55.454380] [INFO ] [REMOTE ] KOS: Full fetch complete (77050 records). [2025-11-03T19:50:55.454543] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-11-03T19:50:55.899601] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-11-03T19:50:55.899725] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-11-03T19:50:55.900722] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-11-03T19:50:55.900784] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-11-03T19:50:55.902132] [DEBUG] [LOCAL ] KOS: Trimmed 77050 records to 53079 (keeping 200 days of data) [2025-11-03T19:50:55.946399] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-11-03T19:50:56.199764] [DEBUG] [LOCAL ] KOS: Primary data saved (53079 records). [2025-11-03T19:50:56.199895] [INFO ] [MAIN ] KOS: Full history saved. [2025-11-03T19:50:56.199969] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KOS took 28.3s. Estimated remaining: 2h 42m 9s. Rate: 7.1 symbols/min [2025-11-03T19:50:56.392986] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:56.393154] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-11-03T19:50:56.394596] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-11-03T19:50:56.393745] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-11-03T19:50:56.402146] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-11-03T19:50:56.402214] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-11-03T19:50:56.402567] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-11-03T19:50:56.402611] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-11-03T19:50:56.740006] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-11-03T19:50:56.780380] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:57.471088] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T19:50:57.534819] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-11-03T19:50:57.845610] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-11-03T19:50:58.334897] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-11-03T19:50:58.504916] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-11-03T19:50:58.505224] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-11-03T19:50:58.505311] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-11-03T19:50:58.505357] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-11-03T19:50:58.505414] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-11-03T19:50:58.505485] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-11-03T19:50:58.505547] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-11-03T19:50:58.505583] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-11-03T19:50:58.505621] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-11-03T19:50:58.505695] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KRMN took 2.3s. Estimated remaining: 2h 41m 55s. Rate: 7.1 symbols/min [2025-11-03T19:50:58.673801] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:50:58.697231] [DEBUG] [LOCAL ] KRO: Loaded 26860 existing records from primary storage. [2025-11-03T19:50:58.697507] [INFO ] [MAIN ] KRO: Loaded 26860 existing records. [2025-11-03T19:50:58.897771] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:50:58.897982] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-11-03T19:50:58.898029] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-11-03T19:50:58.898559] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-11-03T19:50:58.898615] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-11-03T19:50:59.139759] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-11-03T19:50:59.275734] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:50:59.320422] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-11-03T19:50:59.934837] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-11-03T19:51:00.573686] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-11-03T19:51:00.734808] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-11-03T19:51:00.782125] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T19:51:01.534868] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-11-03T19:51:01.920367] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-11-03T19:51:02.334859] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-11-03T19:51:02.509480] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-11-03T19:51:03.028546] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T19:51:03.134871] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-11-03T19:51:03.934865] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-11-03T19:51:04.337144] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:51:04.734886] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-11-03T19:51:05.494141] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-11-03T19:51:05.540384] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-11-03T19:51:05.555033] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-11-03T19:51:06.334863] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-11-03T19:51:06.517956] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-11-03T19:51:07.134882] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-11-03T19:51:07.381437] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-11-03T19:51:07.934875] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-11-03T19:51:08.349678] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-11-03T19:51:08.734892] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-11-03T19:51:08.970784] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-11-03T19:51:09.534852] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-11-03T19:51:10.139846] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-11-03T19:51:10.334825] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-11-03T19:51:10.534011] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T19:51:11.134848] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-11-03T19:51:11.412461] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-11-03T19:51:11.934833] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-11-03T19:51:12.245108] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T19:51:12.734866] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-11-03T19:51:13.114835] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-11-03T19:51:13.534853] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-11-03T19:51:13.566108] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-11-03T19:51:14.334872] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-11-03T19:51:14.716132] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T19:51:15.134862] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-11-03T19:51:15.770871] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-11-03T19:51:15.934854] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-11-03T19:51:16.199758] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-11-03T19:51:16.734880] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-11-03T19:51:17.415698] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-11-03T19:51:17.534844] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-11-03T19:51:17.964571] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T19:51:18.334839] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-11. [2025-11-03T19:51:19.144242] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-11. [2025-11-03T19:51:19.165991] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-11-03T19:51:19.652005] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-11 (1.32 seconds). [2025-11-03T19:51:19.654048] [INFO ] [REMOTE ] KRG: Full fetch complete (71494 records). [2025-11-03T19:51:19.654203] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-11-03T19:51:19.940106] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-11-03T19:51:20.059039] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-11-03T19:51:20.059127] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-11-03T19:51:20.060069] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-11-03T19:51:20.060133] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-11-03T19:51:20.061743] [DEBUG] [LOCAL ] KRG: Trimmed 71494 records to 49194 (keeping 200 days of data) [2025-11-03T19:51:20.344180] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-11 (1.20 seconds). [2025-11-03T19:51:20.346886] [INFO ] [REMOTE ] KREF: Full fetch complete (53375 records). [2025-11-03T19:51:20.349281] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-11-03T19:51:20.468498] [DEBUG] [LOCAL ] KRG: Primary data saved (49194 records). [2025-11-03T19:51:20.468741] [INFO ] [MAIN ] KRG: Full history saved. [2025-11-03T19:51:20.475490] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KRG took 35.7s. Estimated remaining: 2h 41m 59s. Rate: 7.1 symbols/min [2025-11-03T19:51:20.760744] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-11. [2025-11-03T19:51:20.853434] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:51:20.951115] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-11-03T19:51:20.951280] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-11-03T19:51:20.952427] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-11-03T19:51:20.952582] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-11-03T19:51:20.968699] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:51:20.975190] [DEBUG] [LOCAL ] KREF: Trimmed 53375 records to 37831 (keeping 200 days of data) [2025-11-03T19:51:21.115502] [DEBUG] [LOCAL ] KRP: Loaded 35905 existing records from primary storage. [2025-11-03T19:51:21.157460] [INFO ] [MAIN ] KRP: Loaded 35905 existing records. [2025-11-03T19:51:21.328877] [DEBUG] [LOCAL ] KREF: Primary data saved (37831 records). [2025-11-03T19:51:21.329082] [INFO ] [MAIN ] KREF: Full history saved. [2025-11-03T19:51:21.329194] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KREF took 39.7s. Estimated remaining: 2h 41m 43s. Rate: 7.1 symbols/min [2025-11-03T19:51:21.535130] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-11-03T19:51:21.546467] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:51:21.598954] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-11-03T19:51:21.598305] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:51:21.599244] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-11-03T19:51:21.600079] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-11-03T19:51:21.600403] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-11-03T19:51:21.945055] [DEBUG] [LOCAL ] KSS: Loaded 54344 existing records from primary storage. [2025-11-03T19:51:21.976971] [INFO ] [MAIN ] KSS: Loaded 54344 existing records. [2025-11-03T19:51:22.081246] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:51:22.184193] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:51:22.184410] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-11-03T19:51:22.184461] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-11-03T19:51:22.185331] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-11-03T19:51:22.185389] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-11-03T19:51:22.339973] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-11-03T19:51:22.412969] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-11 (1.65 seconds). [2025-11-03T19:51:22.449823] [INFO ] [REMOTE ] KR: Full fetch complete (77844 records). [2025-11-03T19:51:22.467009] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-11-03T19:51:22.658212] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:51:22.769961] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-11-03T19:51:23.036442] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-11-03T19:51:23.036563] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-11-03T19:51:23.038254] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-11-03T19:51:23.038332] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-11-03T19:51:23.040599] [DEBUG] [LOCAL ] KR: Trimmed 77844 records to 53681 (keeping 200 days of data) [2025-11-03T19:51:23.137058] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-11-03T19:51:23.398265] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-11-03T19:51:23.398455] [INFO ] [MAIN ] KR: Full history saved. [2025-11-03T19:51:23.398559] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KR took 45.7s. Estimated remaining: 2h 41m 29s. Rate: 7.1 symbols/min [2025-11-03T19:51:23.635852] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:51:23.638361] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:51:23.685234] [DEBUG] [LOCAL ] KT: Loaded 45648 existing records from primary storage. [2025-11-03T19:51:23.685527] [INFO ] [MAIN ] KT: Loaded 45648 existing records. [2025-11-03T19:51:23.877295] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:51:23.877632] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-11-03T19:51:23.877728] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-11-03T19:51:23.878978] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-11-03T19:51:23.879036] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-11-03T19:51:23.940236] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-11-03T19:51:24.217994] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-11-03T19:51:24.301930] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:51:24.734912] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-11-03T19:51:25.466603] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-11-03T19:51:25.534844] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-11-03T19:51:25.694817] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:51:26.334886] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-11-03T19:51:26.883158] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-11-03T19:51:27.134825] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-11-03T19:51:27.320131] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T19:51:27.934849] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-11-03T19:51:28.350987] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-11-03T19:51:28.734876] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-11-03T19:51:29.218106] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T19:51:29.534859] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-11-03T19:51:30.334837] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-11-03T19:51:30.391893] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-11-03T19:51:30.489236] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-11-03T19:51:31.134906] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-11-03T19:51:31.611094] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T19:51:31.934901] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-11-03T19:51:32.734836] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-11. [2025-11-03T19:51:32.925731] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-11-03T19:51:33.284233] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T19:51:33.534881] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-11-03T19:51:33.573065] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T19:51:33.574362] [INFO ] [REMOTE ] KRO: Full fetch complete (35745 records). [2025-11-03T19:51:33.574463] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-11-03T19:51:34.036171] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-11-03T19:51:34.036257] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-11-03T19:51:34.036962] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-11-03T19:51:34.037026] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-11-03T19:51:34.037991] [DEBUG] [LOCAL ] KRO: Trimmed 35745 records to 26393 (keeping 200 days of data) [2025-11-03T19:51:34.187708] [DEBUG] [LOCAL ] KRO: Primary data saved (26393 records). [2025-11-03T19:51:34.187859] [INFO ] [MAIN ] KRO: Full history saved. [2025-11-03T19:51:34.187942] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRO took 35.7s. Estimated remaining: 2h 41m 23s. Rate: 7.1 symbols/min [2025-11-03T19:51:34.340033] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-11-03T19:51:34.366072] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:51:34.401051] [DEBUG] [LOCAL ] KTB: Loaded 40203 existing records from primary storage. [2025-11-03T19:51:34.401383] [INFO ] [MAIN ] KTB: Loaded 40203 existing records. [2025-11-03T19:51:34.583120] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:51:34.583340] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-11-03T19:51:34.583390] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-11-03T19:51:34.584339] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-11-03T19:51:34.584443] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-11-03T19:51:34.954942] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:51:34.978032] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-11-03T19:51:35.134857] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-11-03T19:51:35.934823] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-11-03T19:51:35.970919] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-11-03T19:51:36.146152] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T19:51:36.734928] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-11-03T19:51:36.948800] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-11-03T19:51:37.534928] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-11-03T19:51:38.204226] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-11-03T19:51:38.334818] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-11-03T19:51:38.542168] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-11-03T19:51:39.134842] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-11-03T19:51:39.934844] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-11-03T19:51:40.088486] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-11-03T19:51:40.366290] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-11-03T19:51:40.734925] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-11-03T19:51:40.857274] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T19:51:41.534860] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-11-03T19:51:42.268547] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T19:51:42.334812] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-11-03T19:51:42.527247] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-11-03T19:51:43.134874] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-11-03T19:51:43.864458] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-11-03T19:51:43.934893] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-11-03T19:51:44.029340] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T19:51:44.734877] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-11-03T19:51:45.431216] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-11-03T19:51:45.534891] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-11-03T19:51:45.721951] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T19:51:46.334864] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-11. [2025-11-03T19:51:46.584470] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T19:51:47.134857] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-11. [2025-11-03T19:51:47.617390] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-11 (1.28 seconds). [2025-11-03T19:51:47.619359] [INFO ] [REMOTE ] KSS: Full fetch complete (77724 records). [2025-11-03T19:51:47.619530] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-11-03T19:51:47.935897] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-11-03T19:51:47.930993] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-11 (0.80 seconds). [2025-11-03T19:51:47.939242] [INFO ] [REMOTE ] KRP: Full fetch complete (54442 records). [2025-11-03T19:51:47.950118] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-11-03T19:51:48.149001] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-11-03T19:51:48.151578] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-11-03T19:51:48.152697] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-11-03T19:51:48.158593] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-11-03T19:51:48.243449] [DEBUG] [LOCAL ] KSS: Trimmed 77724 records to 53560 (keeping 200 days of data) [2025-11-03T19:51:48.609745] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-11-03T19:51:48.609862] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-11-03T19:51:48.610878] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-11-03T19:51:48.610966] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-11-03T19:51:48.711784] [DEBUG] [LOCAL ] KRP: Trimmed 54442 records to 35387 (keeping 200 days of data) [2025-11-03T19:51:48.737444] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-11-03T19:51:48.923207] [DEBUG] [LOCAL ] KSS: Primary data saved (53560 records). [2025-11-03T19:51:48.930534] [INFO ] [MAIN ] KSS: Full history saved. [2025-11-03T19:51:48.930926] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KSS took 27.6s. Estimated remaining: 2h 41m 20s. Rate: 7.1 symbols/min [2025-11-03T19:51:49.210237] [DEBUG] [LOCAL ] KRP: Primary data saved (35387 records). [2025-11-03T19:51:49.244534] [INFO ] [MAIN ] KRP: Full history saved. [2025-11-03T19:51:49.244421] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:51:49.244856] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KRP took 28.8s. Estimated remaining: 2h 41m 4s. Rate: 7.1 symbols/min [2025-11-03T19:51:49.382232] [DEBUG] [LOCAL ] KTF: Loaded 11904 existing records from primary storage. [2025-11-03T19:51:49.382909] [INFO ] [MAIN ] KTF: Loaded 11904 existing records. [2025-11-03T19:51:49.465063] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:51:49.646719] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:51:49.651841] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-11-03T19:51:49.661464] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-11-03T19:51:49.662619] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-11-03T19:51:49.663745] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-11-03T19:51:49.663817] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-11-03T19:51:49.685311] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-11-03T19:51:49.908021] [DEBUG] [LOCAL ] KVUE: Loaded 54447 existing records from primary storage. [2025-11-03T19:51:49.977983] [INFO ] [MAIN ] KVUE: Loaded 54447 existing records. [2025-11-03T19:51:50.193622] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:51:50.272846] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:51:50.273224] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-11-03T19:51:50.273288] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-11-03T19:51:50.294588] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-11-03T19:51:50.297227] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-11-03T19:51:50.343814] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-11-03T19:51:50.342025] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-11-03T19:51:50.670037] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:51:50.793440] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-11-03T19:51:51.134832] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-11-03T19:51:51.196468] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T19:51:51.934862] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-11-03T19:51:52.214770] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T19:51:52.423362] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T19:51:52.734889] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-11-03T19:51:53.534896] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-11-03T19:51:54.116575] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-11-03T19:51:54.251830] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-11-03T19:51:54.334863] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-11-03T19:51:55.134854] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-11-03T19:51:55.696275] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-11-03T19:51:55.731969] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-11-03T19:51:55.934889] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-11-03T19:51:56.515025] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T19:51:56.734885] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-11-03T19:51:57.416146] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-11-03T19:51:57.534846] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-11-03T19:51:58.120339] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-11-03T19:51:58.334885] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-11-03T19:51:58.919433] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-11-03T19:51:59.134960] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-11-03T19:51:59.934915] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-11-03T19:52:00.374317] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T19:52:00.734846] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-11-03T19:52:01.366815] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T19:52:01.534887] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-11-03T19:52:02.027180] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T19:52:02.334859] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-11-03T19:52:02.854247] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-11-03T19:52:02.896625] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-11-03T19:52:03.134878] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-11-03T19:52:03.773501] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-11-03T19:52:03.934875] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-11-03T19:52:04.734866] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-11. [2025-11-03T19:52:05.325056] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-11 (0.59 seconds). [2025-11-03T19:52:05.325923] [INFO ] [REMOTE ] KTF: Full fetch complete (17789 records). [2025-11-03T19:52:05.325994] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-11-03T19:52:05.540068] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-11-03T19:52:05.705706] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-11-03T19:52:05.705801] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-11-03T19:52:05.706359] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-11-03T19:52:05.706474] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-11-03T19:52:05.707172] [DEBUG] [LOCAL ] KTF: Trimmed 17789 records to 11425 (keeping 200 days of data) [2025-11-03T19:52:05.803627] [DEBUG] [LOCAL ] KTF: Primary data saved (11425 records). [2025-11-03T19:52:05.804475] [INFO ] [MAIN ] KTF: Full history saved. [2025-11-03T19:52:05.805761] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KTF took 16.9s. Estimated remaining: 2h 41m 3s. Rate: 7.1 symbols/min [2025-11-03T19:52:05.805636] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-11-03T19:52:05.995877] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:06.041279] [DEBUG] [LOCAL ] KVYO: Loaded 51661 existing records from primary storage. [2025-11-03T19:52:06.041595] [INFO ] [MAIN ] KVYO: Loaded 51661 existing records. [2025-11-03T19:52:06.218823] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:06.219072] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-11-03T19:52:06.219119] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-11-03T19:52:06.219873] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-11-03T19:52:06.219940] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-11-03T19:52:06.339943] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-11-03T19:52:06.587696] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:06.724685] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T19:52:07.134938] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-11-03T19:52:07.845867] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-11-03T19:52:07.934860] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-11-03T19:52:08.318522] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-11-03T19:52:08.734856] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-11-03T19:52:09.498592] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-11-03T19:52:09.534821] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-11-03T19:52:09.843864] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:52:10.334864] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-11-03T19:52:11.134921] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-11-03T19:52:11.225372] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-11-03T19:52:11.505393] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:52:11.934899] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-11-03T19:52:12.186090] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-11-03T19:52:12.734877] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-11-03T19:52:12.993583] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-11-03T19:52:13.534845] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-11-03T19:52:14.039392] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T19:52:14.334839] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-11-03T19:52:14.792850] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-11-03T19:52:15.134910] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-11-03T19:52:15.591239] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:52:15.934858] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-11-03T19:52:16.301315] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-11-03T19:52:16.734849] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-11-03T19:52:17.129103] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T19:52:17.534860] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-11-03T19:52:18.334826] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-11-03T19:52:18.374057] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-11-03T19:52:18.569357] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T19:52:19.134945] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-11-03T19:52:19.377448] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T19:52:19.934907] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-11-03T19:52:20.734873] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-11. [2025-11-03T19:52:21.223079] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-11-03T19:52:21.266242] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-11-03T19:52:21.534844] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-11. [2025-11-03T19:52:21.575876] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-11 (0.84 seconds). [2025-11-03T19:52:21.577805] [INFO ] [REMOTE ] KT: Full fetch complete (66343 records). [2025-11-03T19:52:21.577915] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-11-03T19:52:21.957091] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-11-03T19:52:21.957175] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-11-03T19:52:21.958140] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-11-03T19:52:21.958232] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-11-03T19:52:21.959504] [DEBUG] [LOCAL ] KT: Trimmed 66343 records to 44932 (keeping 200 days of data) [2025-11-03T19:52:22.218513] [DEBUG] [LOCAL ] KT: Primary data saved (44932 records). [2025-11-03T19:52:22.218635] [INFO ] [MAIN ] KT: Full history saved. [2025-11-03T19:52:22.218753] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KT took 58.8s. Estimated remaining: 2h 41m 2s. Rate: 7.1 symbols/min [2025-11-03T19:52:22.355346] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-11-03T19:52:22.367585] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-11 (0.83 seconds). [2025-11-03T19:52:22.392533] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:22.392775] [INFO ] [REMOTE ] KTB: Full fetch complete (58314 records). [2025-11-03T19:52:22.393328] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-11-03T19:52:22.712022] [DEBUG] [LOCAL ] KW: Loaded 40547 existing records from primary storage. [2025-11-03T19:52:22.712716] [INFO ] [MAIN ] KW: Loaded 40547 existing records. [2025-11-03T19:52:22.913195] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-11-03T19:52:22.918732] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-11-03T19:52:22.924864] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-11-03T19:52:22.930038] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-11-03T19:52:22.992328] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:22.992622] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-11-03T19:52:22.992857] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-11-03T19:52:22.993019] [DEBUG] [LOCAL ] KTB: Trimmed 58314 records to 39714 (keeping 200 days of data) [2025-11-03T19:52:22.993612] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-11-03T19:52:22.993721] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-11-03T19:52:23.149744] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-11. [2025-11-03T19:52:23.532594] [DEBUG] [LOCAL ] KTB: Primary data saved (39714 records). [2025-11-03T19:52:23.545677] [INFO ] [MAIN ] KTB: Full history saved. [2025-11-03T19:52:23.557184] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KTB took 49.4s. Estimated remaining: 2h 40m 47s. Rate: 7.1 symbols/min [2025-11-03T19:52:23.728714] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:23.839040] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:23.880861] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-11-03T19:52:23.886834] [DEBUG] [LOCAL ] KWR: Loaded 15591 existing records from primary storage. [2025-11-03T19:52:23.898499] [INFO ] [MAIN ] KWR: Loaded 15591 existing records. [2025-11-03T19:52:23.942091] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-11-03T19:52:24.088774] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:24.089086] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-11-03T19:52:24.089159] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-11-03T19:52:24.089601] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-11-03T19:52:24.089699] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-11-03T19:52:24.500243] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:24.626717] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-11 (1.48 seconds). [2025-11-03T19:52:24.628945] [INFO ] [REMOTE ] KVUE: Full fetch complete (77846 records). [2025-11-03T19:52:24.629160] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-11-03T19:52:24.740000] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-11-03T19:52:25.073483] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-11-03T19:52:25.073635] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-11-03T19:52:25.074804] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-11-03T19:52:25.074891] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-11-03T19:52:25.076868] [DEBUG] [LOCAL ] KVUE: Trimmed 77846 records to 53667 (keeping 200 days of data) [2025-11-03T19:52:25.097926] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-11-03T19:52:25.426994] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-11-03T19:52:25.427300] [INFO ] [MAIN ] KVUE: Full history saved. [2025-11-03T19:52:25.427398] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KVUE took 36.2s. Estimated remaining: 2h 40m 33s. Rate: 7.1 symbols/min [2025-11-03T19:52:25.539094] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-11-03T19:52:25.604527] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:25.611593] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T19:52:25.643571] [DEBUG] [LOCAL ] KYN: Loaded 30215 existing records from primary storage. [2025-11-03T19:52:25.643886] [INFO ] [MAIN ] KYN: Loaded 30215 existing records. [2025-11-03T19:52:25.816955] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:25.817177] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-11-03T19:52:25.817224] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-11-03T19:52:25.817959] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-11-03T19:52:25.818019] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-11-03T19:52:26.162821] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:26.334811] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-11-03T19:52:26.559913] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-11-03T19:52:27.134872] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-11-03T19:52:27.377592] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T19:52:27.816044] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-11-03T19:52:27.934911] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-11-03T19:52:28.734905] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-11-03T19:52:28.749705] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-11-03T19:52:29.534868] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-11-03T19:52:29.951709] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T19:52:30.334860] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-11-03T19:52:30.461152] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-11-03T19:52:30.952413] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-11-03T19:52:31.134857] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-11-03T19:52:31.934847] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-11-03T19:52:32.577259] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-11-03T19:52:32.734818] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-11-03T19:52:33.103887] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:52:33.495110] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T19:52:33.534832] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-11-03T19:52:34.334860] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-11-03T19:52:34.447268] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-11-03T19:52:35.134966] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-11. [2025-11-03T19:52:35.581590] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-11-03T19:52:35.934905] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-11-03T19:52:36.205350] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-11 (1.07 seconds). [2025-11-03T19:52:36.206861] [INFO ] [REMOTE ] KVYO: Full fetch complete (72615 records). [2025-11-03T19:52:36.206959] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-11-03T19:52:36.617785] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-11-03T19:52:36.617993] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-11-03T19:52:36.619091] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-11-03T19:52:36.619168] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-11-03T19:52:36.630376] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-11-03T19:52:36.635130] [DEBUG] [LOCAL ] KVYO: Trimmed 72615 records to 50976 (keeping 200 days of data) [2025-11-03T19:52:36.741851] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-11-03T19:52:36.924201] [DEBUG] [LOCAL ] KVYO: Primary data saved (50976 records). [2025-11-03T19:52:36.924334] [INFO ] [MAIN ] KVYO: Full history saved. [2025-11-03T19:52:36.924409] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KVYO took 31.1s. Estimated remaining: 2h 40m 27s. Rate: 7.1 symbols/min [2025-11-03T19:52:37.093698] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:37.128741] [DEBUG] [LOCAL ] L: Loaded 41402 existing records from primary storage. [2025-11-03T19:52:37.129030] [INFO ] [MAIN ] L: Loaded 41402 existing records. [2025-11-03T19:52:37.301816] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:37.302003] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-11-03T19:52:37.302050] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-11-03T19:52:37.302719] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-11-03T19:52:37.302776] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-11-03T19:52:37.540042] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-11-03T19:52:37.669768] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:37.665557] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-11-03T19:52:38.334864] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-11-03T19:52:38.691935] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T19:52:38.951769] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-11-03T19:52:39.134881] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-11-03T19:52:39.934881] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-11-03T19:52:40.109349] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-11-03T19:52:40.734899] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-11-03T19:52:41.012514] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-11-03T19:52:41.534846] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-11-03T19:52:41.667827] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-11-03T19:52:42.334850] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-11-03T19:52:42.582905] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T19:52:43.134904] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-11-03T19:52:43.417113] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-11-03T19:52:43.934845] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-11-03T19:52:44.317578] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T19:52:44.544452] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-11-03T19:52:44.734889] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-11-03T19:52:45.534889] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-11-03T19:52:45.914692] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-11-03T19:52:46.334880] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-11-03T19:52:46.673580] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T19:52:47.134854] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-11-03T19:52:47.353541] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-11-03T19:52:47.738443] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-11-03T19:52:47.934917] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-11-03T19:52:48.734933] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-11-03T19:52:49.078481] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-11-03T19:52:49.534838] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-11-03T19:52:49.564201] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T19:52:50.334861] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-11-03T19:52:50.572403] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-11-03T19:52:51.134920] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-11. [2025-11-03T19:52:51.290906] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-11-03T19:52:51.718497] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-11 (0.58 seconds). [2025-11-03T19:52:51.719457] [INFO ] [REMOTE ] KWR: Full fetch complete (23058 records). [2025-11-03T19:52:51.719542] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-11-03T19:52:51.939959] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-11-03T19:52:52.084262] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-11-03T19:52:52.084335] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-11-03T19:52:52.084824] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-11-03T19:52:52.084885] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-11-03T19:52:52.085465] [DEBUG] [LOCAL ] KWR: Trimmed 23058 records to 15357 (keeping 200 days of data) [2025-11-03T19:52:52.176581] [DEBUG] [LOCAL ] KWR: Primary data saved (15357 records). [2025-11-03T19:52:52.176733] [INFO ] [MAIN ] KWR: Full history saved. [2025-11-03T19:52:52.176817] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KWR took 28.6s. Estimated remaining: 2h 40m 25s. Rate: 7.1 symbols/min [2025-11-03T19:52:52.343330] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:52.388822] [DEBUG] [LOCAL ] LAC: Loaded 53387 existing records from primary storage. [2025-11-03T19:52:52.389111] [INFO ] [MAIN ] LAC: Loaded 53387 existing records. [2025-11-03T19:52:52.562517] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:52.562766] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-11-03T19:52:52.562816] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-11-03T19:52:52.563638] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-11-03T19:52:52.563735] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-11-03T19:52:52.736019] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-11-03T19:52:52.919366] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:52.934471] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-11-03T19:52:53.534857] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-11-03T19:52:53.977786] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-11-03T19:52:54.334882] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-11-03T19:52:54.546339] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-11-03T19:52:55.134903] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-11-03T19:52:55.934907] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-11. [2025-11-03T19:52:55.966356] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-11-03T19:52:56.350163] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T19:52:56.734848] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-11-03T19:52:56.747964] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:52:56.749287] [INFO ] [REMOTE ] KYN: Full fetch complete (44246 records). [2025-11-03T19:52:56.749363] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-11-03T19:52:57.121348] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-11-03T19:52:57.121429] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-11-03T19:52:57.122195] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-11-03T19:52:57.122258] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-11-03T19:52:57.123259] [DEBUG] [LOCAL ] KYN: Trimmed 44246 records to 29675 (keeping 200 days of data) [2025-11-03T19:52:57.316092] [DEBUG] [LOCAL ] KYN: Primary data saved (29675 records). [2025-11-03T19:52:57.316216] [INFO ] [MAIN ] KYN: Full history saved. [2025-11-03T19:52:57.316292] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KYN took 31.9s. Estimated remaining: 2h 40m 13s. Rate: 7.1 symbols/min [2025-11-03T19:52:57.484526] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:52:57.505017] [DEBUG] [LOCAL ] LAD: Loaded 23543 existing records from primary storage. [2025-11-03T19:52:57.505254] [INFO ] [MAIN ] LAD: Loaded 23543 existing records. [2025-11-03T19:52:57.538604] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-11-03T19:52:57.727318] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:52:57.727801] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-11-03T19:52:57.727883] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-11-03T19:52:57.728684] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-11-03T19:52:57.728842] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-11-03T19:52:57.945792] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-11-03T19:52:58.140754] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:52:58.334897] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-11-03T19:52:58.761628] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-11-03T19:52:59.134831] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-11-03T19:52:59.205737] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-11-03T19:52:59.934865] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-11-03T19:53:00.268770] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-11-03T19:53:00.734841] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-11-03T19:53:01.144885] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T19:53:01.534892] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-11-03T19:53:01.966956] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-11-03T19:53:02.334856] [INFO ] [REMOTE ] L: Fetching primary data for 2025-11. [2025-11-03T19:53:02.889927] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T19:53:03.134861] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-11-03T19:53:03.393462] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:53:03.395723] [INFO ] [REMOTE ] L: Full fetch complete (59323 records). [2025-11-03T19:53:03.395902] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-11-03T19:53:03.823782] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-11-03T19:53:03.823921] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-11-03T19:53:03.825304] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-11-03T19:53:03.825395] [DEBUG] [LOCAL ] L: Saving primary data. [2025-11-03T19:53:03.827355] [DEBUG] [LOCAL ] L: Trimmed 59323 records to 40811 (keeping 200 days of data) [2025-11-03T19:53:03.935017] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-11-03T19:53:04.119482] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-11-03T19:53:04.122420] [DEBUG] [LOCAL ] L: Primary data saved (40811 records). [2025-11-03T19:53:04.127348] [INFO ] [MAIN ] L: Full history saved. [2025-11-03T19:53:04.128328] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. L took 27.2s. Estimated remaining: 2h 40m 3s. Rate: 7.1 symbols/min [2025-11-03T19:53:04.318440] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:04.359464] [DEBUG] [LOCAL ] LADR: Loaded 39671 existing records from primary storage. [2025-11-03T19:53:04.359973] [INFO ] [MAIN ] LADR: Loaded 39671 existing records. [2025-11-03T19:53:04.557612] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:53:04.557916] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-11-03T19:53:04.557969] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-11-03T19:53:04.558798] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-11-03T19:53:04.558860] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-11-03T19:53:04.740753] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-11-03T19:53:04.949380] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:05.197012] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-11-03T19:53:05.534915] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-11-03T19:53:06.334855] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-11-03T19:53:06.432742] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-11-03T19:53:06.494238] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:53:07.134875] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-11-03T19:53:07.255333] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-11-03T19:53:07.934903] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-11-03T19:53:08.701882] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-11-03T19:53:08.734899] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-11. [2025-11-03T19:53:08.925086] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-11-03T19:53:09.534833] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-11-03T19:53:09.565555] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-11 (0.83 seconds). [2025-11-03T19:53:09.566806] [INFO ] [REMOTE ] KW: Full fetch complete (57223 records). [2025-11-03T19:53:09.566891] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-11-03T19:53:09.957166] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-11-03T19:53:09.957247] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-11-03T19:53:09.958089] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-11-03T19:53:09.958154] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-11-03T19:53:09.959331] [DEBUG] [LOCAL ] KW: Trimmed 57223 records to 39919 (keeping 200 days of data) [2025-11-03T19:53:10.185837] [DEBUG] [LOCAL ] KW: Primary data saved (39919 records). [2025-11-03T19:53:10.186092] [INFO ] [MAIN ] KW: Full history saved. [2025-11-03T19:53:10.186187] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KW took 48.0s. Estimated remaining: 2h 39m 53s. Rate: 7.1 symbols/min [2025-11-03T19:53:10.337966] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-11-03T19:53:10.357062] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:10.371186] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-11-03T19:53:10.378055] [DEBUG] [LOCAL ] LANV: Loaded 2786 existing records from primary storage. [2025-11-03T19:53:10.378507] [INFO ] [MAIN ] LANV: Loaded 2786 existing records. [2025-11-03T19:53:10.552068] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:53:10.552281] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-11-03T19:53:10.552329] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-11-03T19:53:10.552482] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-11-03T19:53:10.552522] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-11-03T19:53:10.900064] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:11.134811] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-11-03T19:53:11.259824] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-11-03T19:53:11.550227] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-11-03T19:53:11.934910] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-11-03T19:53:12.204405] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-11-03T19:53:12.734834] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-11-03T19:53:13.094678] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-11-03T19:53:13.534906] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-11-03T19:53:14.334901] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-11-03T19:53:14.749977] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-11-03T19:53:15.134868] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-11-03T19:53:15.814391] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-11-03T19:53:15.884048] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-11-03T19:53:15.934811] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-11-03T19:53:16.734878] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-11-03T19:53:17.046538] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-11-03T19:53:17.534826] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-11-03T19:53:17.703007] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-11-03T19:53:17.763611] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-11-03T19:53:18.334862] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-11-03T19:53:19.139492] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-11-03T19:53:19.143235] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T19:53:19.503015] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-11-03T19:53:19.934848] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-11-03T19:53:20.734865] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-11-03T19:53:20.753339] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-11-03T19:53:21.534849] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-11-03T19:53:21.840747] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-11-03T19:53:22.251250] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-11-03T19:53:22.334840] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-11-03T19:53:22.697877] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-11-03T19:53:23.134855] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-11-03T19:53:23.520752] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T19:53:23.934850] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-11-03T19:53:24.734906] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-11-03T19:53:25.305065] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-11-03T19:53:25.534911] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-11-03T19:53:26.321174] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-11-03T19:53:26.334838] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-11-03T19:53:26.669349] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-11-03T19:53:26.733370] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-11-03T19:53:27.134848] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-11-03T19:53:27.934851] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-11-03T19:53:28.186526] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T19:53:28.734843] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-11. [2025-11-03T19:53:29.065849] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-11 (0.33 seconds). [2025-11-03T19:53:29.066476] [INFO ] [REMOTE ] LANV: Full fetch complete (4076 records). [2025-11-03T19:53:29.066543] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-11-03T19:53:29.417857] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-11-03T19:53:29.417935] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-11-03T19:53:29.418063] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-11-03T19:53:29.418101] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-11-03T19:53:29.418447] [DEBUG] [LOCAL ] LANV: Trimmed 4076 records to 2729 (keeping 200 days of data) [2025-11-03T19:53:29.432985] [DEBUG] [LOCAL ] LANV: Primary data saved (2729 records). [2025-11-03T19:53:29.433078] [INFO ] [MAIN ] LANV: Full history saved. [2025-11-03T19:53:29.433151] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. LANV took 19.2s. Estimated remaining: 2h 39m 54s. Rate: 7.1 symbols/min [2025-11-03T19:53:29.540057] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-11-03T19:53:29.604885] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:29.605054] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-11-03T19:53:29.605090] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-11-03T19:53:29.605198] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-11-03T19:53:29.605238] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-11-03T19:53:29.605278] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-11-03T19:53:29.605309] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-11-03T19:53:29.986420] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:30.334833] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-11-03T19:53:30.481765] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.55 seconds). [2025-11-03T19:53:30.686083] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T19:53:31.067311] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-11-03T19:53:31.134863] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-11. [2025-11-03T19:53:31.934886] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-11-03T19:53:32.734862] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-11-03T19:53:33.232738] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T19:53:33.310342] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-11 (2.18 seconds). [2025-11-03T19:53:33.311903] [INFO ] [REMOTE ] LAC: Full fetch complete (76180 records). [2025-11-03T19:53:33.312030] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-11-03T19:53:33.537044] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-11-03T19:53:33.705633] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-11-03T19:53:33.705764] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-11-03T19:53:33.706756] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-11-03T19:53:33.706916] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-11-03T19:53:33.724637] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-11-03T19:53:33.724109] [DEBUG] [LOCAL ] LAC: Trimmed 76180 records to 52653 (keeping 200 days of data) [2025-11-03T19:53:34.026370] [DEBUG] [LOCAL ] LAC: Primary data saved (52653 records). [2025-11-03T19:53:34.026516] [INFO ] [MAIN ] LAC: Full history saved. [2025-11-03T19:53:34.026604] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. LAC took 41.8s. Estimated remaining: 2h 39m 42s. Rate: 7.1 symbols/min [2025-11-03T19:53:34.191748] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:34.205254] [DEBUG] [LOCAL ] LAW: Loaded 15255 existing records from primary storage. [2025-11-03T19:53:34.205458] [INFO ] [MAIN ] LAW: Loaded 15255 existing records. [2025-11-03T19:53:34.341715] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-11-03T19:53:34.382483] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:53:34.382737] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-11-03T19:53:34.382793] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-11-03T19:53:34.383113] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-11-03T19:53:34.383170] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-11-03T19:53:34.741047] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:34.975737] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-11-03T19:53:35.134886] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-11-03T19:53:35.677446] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:53:35.934940] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-11. [2025-11-03T19:53:36.305889] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T19:53:36.735038] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-11-03T19:53:36.744105] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:53:36.745363] [INFO ] [REMOTE ] LAD: Full fetch complete (35918 records). [2025-11-03T19:53:36.745441] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-11-03T19:53:37.125218] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-11-03T19:53:37.125291] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-11-03T19:53:37.125942] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-11-03T19:53:37.126001] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-11-03T19:53:37.126758] [DEBUG] [LOCAL ] LAD: Trimmed 35918 records to 23382 (keeping 200 days of data) [2025-11-03T19:53:37.265538] [DEBUG] [LOCAL ] LAD: Primary data saved (23382 records). [2025-11-03T19:53:37.265687] [INFO ] [MAIN ] LAD: Full history saved. [2025-11-03T19:53:37.265786] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LAD took 39.9s. Estimated remaining: 2h 39m 29s. Rate: 7.1 symbols/min [2025-11-03T19:53:37.431739] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:37.469258] [DEBUG] [LOCAL ] LAZ: Loaded 44934 existing records from primary storage. [2025-11-03T19:53:37.469560] [INFO ] [MAIN ] LAZ: Loaded 44934 existing records. [2025-11-03T19:53:37.543311] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-11-03T19:53:37.646798] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:53:37.647002] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-11-03T19:53:37.647048] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-11-03T19:53:37.647841] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-11-03T19:53:37.647898] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-11-03T19:53:38.005597] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:38.031167] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-11-03T19:53:38.189404] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-11-03T19:53:38.334870] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-11-03T19:53:39.134860] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-11-03T19:53:39.434945] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:53:39.842058] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-11-03T19:53:39.934862] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-11-03T19:53:40.734869] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-11-03T19:53:41.109092] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-11-03T19:53:41.267062] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-11-03T19:53:41.534849] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-11-03T19:53:42.334918] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-11-03T19:53:42.722051] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-11-03T19:53:43.134849] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-11-03T19:53:43.434213] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:53:43.934852] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-11-03T19:53:44.316872] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-11-03T19:53:44.734902] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-11-03T19:53:45.117538] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-11-03T19:53:45.534862] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-11-03T19:53:46.014974] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-11-03T19:53:46.334874] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-11-03T19:53:46.834847] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T19:53:47.134860] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-11-03T19:53:47.665174] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:53:47.934860] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-11-03T19:53:48.482369] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-11-03T19:53:48.506319] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-11-03T19:53:48.734888] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-11. [2025-11-03T19:53:49.534850] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-11-03T19:53:49.858373] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-11 (1.12 seconds). [2025-11-03T19:53:49.859743] [INFO ] [REMOTE ] LADR: Full fetch complete (55736 records). [2025-11-03T19:53:49.859863] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-11-03T19:53:50.209778] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-11-03T19:53:50.281260] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-11-03T19:53:50.281331] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-11-03T19:53:50.282120] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-11-03T19:53:50.282192] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-11-03T19:53:50.283352] [DEBUG] [LOCAL ] LADR: Trimmed 55736 records to 38894 (keeping 200 days of data) [2025-11-03T19:53:50.341965] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-11-03T19:53:50.510060] [DEBUG] [LOCAL ] LADR: Primary data saved (38894 records). [2025-11-03T19:53:50.510185] [INFO ] [MAIN ] LADR: Full history saved. [2025-11-03T19:53:50.510259] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LADR took 46.4s. Estimated remaining: 2h 39m 25s. Rate: 7.1 symbols/min [2025-11-03T19:53:50.681267] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:50.712552] [DEBUG] [LOCAL ] LB: Loaded 36786 existing records from primary storage. [2025-11-03T19:53:50.712839] [INFO ] [MAIN ] LB: Loaded 36786 existing records. [2025-11-03T19:53:50.891764] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:53:50.892089] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-11-03T19:53:50.892143] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-11-03T19:53:50.892795] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-11-03T19:53:50.892852] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-11-03T19:53:51.060056] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-11-03T19:53:51.143734] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-11-03T19:53:51.262306] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:51.822335] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-11-03T19:53:51.934884] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-11-03T19:53:52.639814] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T19:53:52.734840] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-11-03T19:53:53.362243] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T19:53:53.534845] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-11-03T19:53:54.310404] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-11-03T19:53:54.334804] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-11. [2025-11-03T19:53:54.921016] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-11 (0.59 seconds). [2025-11-03T19:53:54.921877] [INFO ] [REMOTE ] LAW: Full fetch complete (21100 records). [2025-11-03T19:53:54.921946] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-11-03T19:53:55.140567] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-11-03T19:53:55.296315] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-11-03T19:53:55.296432] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-11-03T19:53:55.296986] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-11-03T19:53:55.297049] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-11-03T19:53:55.297677] [DEBUG] [LOCAL ] LAW: Trimmed 21100 records to 15124 (keeping 200 days of data) [2025-11-03T19:53:55.377714] [DEBUG] [LOCAL ] LAW: Primary data saved (15124 records). [2025-11-03T19:53:55.377846] [INFO ] [MAIN ] LAW: Full history saved. [2025-11-03T19:53:55.377926] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LAW took 21.4s. Estimated remaining: 2h 39m 13s. Rate: 7.1 symbols/min [2025-11-03T19:53:55.553257] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:53:55.599750] [DEBUG] [LOCAL ] LBRT: Loaded 53785 existing records from primary storage. [2025-11-03T19:53:55.600046] [INFO ] [MAIN ] LBRT: Loaded 53785 existing records. [2025-11-03T19:53:55.775923] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:53:55.776156] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-11-03T19:53:55.776220] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-11-03T19:53:55.777256] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-11-03T19:53:55.777316] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-11-03T19:53:55.946371] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-11-03T19:53:56.132893] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:53:56.553354] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-11-03T19:53:56.734853] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-11-03T19:53:57.341341] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T19:53:57.534865] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-11-03T19:53:58.092568] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T19:53:58.334889] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-11-03T19:53:58.688390] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T19:53:59.134860] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-11-03T19:53:59.669093] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T19:53:59.934858] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-11-03T19:54:00.344188] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:54:00.734883] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-11-03T19:54:01.209000] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-11-03T19:54:01.534914] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-11-03T19:54:02.334883] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-11-03T19:54:02.542524] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-11-03T19:54:02.827001] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-11-03T19:54:03.134888] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-11-03T19:54:03.677295] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:54:03.934855] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-11. [2025-11-03T19:54:04.321080] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-11-03T19:54:04.734875] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-11-03T19:54:05.354472] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-11 (1.42 seconds). [2025-11-03T19:54:05.356005] [INFO ] [REMOTE ] LAR: Full fetch complete (65453 records). [2025-11-03T19:54:05.356101] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-11-03T19:54:05.539947] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-11-03T19:54:05.599005] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-11-03T19:54:05.599730] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-11-03T19:54:05.599805] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-11-03T19:54:05.599880] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-11-03T19:54:05.599946] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-11-03T19:54:05.599984] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-11-03T19:54:05.600024] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-11-03T19:54:05.600089] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LAR took 36.2s. Estimated remaining: 2h 39m 6s. Rate: 7.1 symbols/min [2025-11-03T19:54:05.785004] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:54:05.829042] [DEBUG] [LOCAL ] LC: Loaded 48977 existing records from primary storage. [2025-11-03T19:54:05.829486] [INFO ] [MAIN ] LC: Loaded 48977 existing records. [2025-11-03T19:54:06.010708] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:54:06.010972] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-11-03T19:54:06.011044] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-11-03T19:54:06.011887] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-11-03T19:54:06.011994] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-11-03T19:54:06.219325] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-11-03T19:54:06.335042] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-11-03T19:54:06.413504] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:54:06.747383] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-11-03T19:54:07.134848] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-11-03T19:54:07.434618] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-11-03T19:54:07.934880] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-11-03T19:54:08.295798] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-11-03T19:54:08.734877] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-11-03T19:54:08.995167] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-11-03T19:54:09.534873] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-11-03T19:54:09.712871] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-11-03T19:54:10.334832] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-11-03T19:54:10.893415] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-11-03T19:54:11.134891] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-11-03T19:54:11.807280] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:54:11.934884] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-11-03T19:54:12.291939] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-11-03T19:54:12.734853] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-11-03T19:54:13.298944] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-11-03T19:54:13.534897] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-11-03T19:54:14.043544] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-11-03T19:54:14.334863] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-11-03T19:54:14.703043] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-11-03T19:54:15.134862] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-11-03T19:54:15.885025] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-11-03T19:54:15.934864] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-11-03T19:54:16.266808] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T19:54:16.734888] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-11-03T19:54:17.439362] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-11-03T19:54:17.534842] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-11-03T19:54:18.061006] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:54:18.334848] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-11-03T19:54:19.056393] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-11-03T19:54:19.134865] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-11-03T19:54:19.634490] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-11-03T19:54:19.934864] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-11-03T19:54:20.149311] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-11-03T19:54:20.734849] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-11-03T19:54:20.828318] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-11-03T19:54:21.534871] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-11-03T19:54:22.334822] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-11. [2025-11-03T19:54:22.401536] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T19:54:22.652110] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-11-03T19:54:23.134882] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-11-03T19:54:23.278014] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-11 (0.94 seconds). [2025-11-03T19:54:23.279403] [INFO ] [REMOTE ] LAZ: Full fetch complete (65247 records). [2025-11-03T19:54:23.279490] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-11-03T19:54:23.654691] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-11-03T19:54:23.654784] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-11-03T19:54:23.655735] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-11-03T19:54:23.655797] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-11-03T19:54:23.657021] [DEBUG] [LOCAL ] LAZ: Trimmed 65247 records to 44251 (keeping 200 days of data) [2025-11-03T19:54:23.923585] [DEBUG] [LOCAL ] LAZ: Primary data saved (44251 records). [2025-11-03T19:54:23.923757] [INFO ] [MAIN ] LAZ: Full history saved. [2025-11-03T19:54:23.924457] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. LAZ took 46.7s. Estimated remaining: 2h 39m 7s. Rate: 7.1 symbols/min [2025-11-03T19:54:23.934858] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-11. [2025-11-03T19:54:24.098037] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-11-03T19:54:24.734863] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-11. [2025-11-03T19:54:25.113693] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-11 (1.18 seconds). [2025-11-03T19:54:25.115192] [INFO ] [REMOTE ] LBRT: Full fetch complete (76943 records). [2025-11-03T19:54:25.115287] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-11-03T19:54:25.509961] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-11-03T19:54:25.510037] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-11-03T19:54:25.511072] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-11-03T19:54:25.511135] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-11-03T19:54:25.512461] [DEBUG] [LOCAL ] LBRT: Trimmed 76943 records to 53010 (keeping 200 days of data) [2025-11-03T19:54:25.563754] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-11-03T19:54:25.634823] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-11 (0.90 seconds). [2025-11-03T19:54:25.687972] [INFO ] [REMOTE ] LB: Full fetch complete (55009 records). [2025-11-03T19:54:25.688199] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-11-03T19:54:26.021736] [DEBUG] [LOCAL ] LBRT: Primary data saved (53010 records). [2025-11-03T19:54:26.038131] [INFO ] [MAIN ] LBRT: Full history saved. [2025-11-03T19:54:26.079538] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LBRT took 30.7s. Estimated remaining: 2h 38m 53s. Rate: 7.1 symbols/min [2025-11-03T19:54:26.233262] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-11-03T19:54:26.233357] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-11-03T19:54:26.234181] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-11-03T19:54:26.234244] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-11-03T19:54:26.235301] [DEBUG] [LOCAL ] LB: Trimmed 55009 records to 36285 (keeping 200 days of data) [2025-11-03T19:54:26.450770] [DEBUG] [LOCAL ] LB: Primary data saved (36285 records). [2025-11-03T19:54:26.450901] [INFO ] [MAIN ] LB: Full history saved. [2025-11-03T19:54:26.450977] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LB took 35.9s. Estimated remaining: 2h 38m 37s. Rate: 7.1 symbols/min [2025-11-03T19:54:26.784881] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-11-03T19:54:26.795392] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-11-03T19:54:28.196150] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-11-03T19:54:28.207126] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-11-03T19:54:29.468912] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-11-03T19:54:29.479090] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-11-03T19:54:30.798813] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T19:54:30.810571] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-11. [2025-11-03T19:54:32.181800] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-11 (1.37 seconds). [2025-11-03T19:54:32.183344] [INFO ] [REMOTE ] LC: Full fetch complete (70690 records). [2025-11-03T19:54:32.183426] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-11-03T19:54:32.573130] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-11-03T19:54:32.573226] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-11-03T19:54:32.574256] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-11-03T19:54:32.574322] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-11-03T19:54:32.575711] [DEBUG] [LOCAL ] LC: Trimmed 70690 records to 48288 (keeping 200 days of data) [2025-11-03T19:54:32.850836] [DEBUG] [LOCAL ] LC: Primary data saved (48288 records). [2025-11-03T19:54:32.850964] [INFO ] [MAIN ] LC: Full history saved. [2025-11-03T19:54:32.851040] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LC took 27.3s. Estimated remaining: 2h 38m 27s. Rate: 7.1 symbols/min [2025-11-03T19:54:33.410962] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:54:33.494939] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:54:33.546198] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:54:33.563851] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:54:33.576433] [DEBUG] [LOCAL ] LDP: Loaded 12245 existing records from primary storage. [2025-11-03T19:54:33.576986] [INFO ] [MAIN ] LDP: Loaded 12245 existing records. [2025-11-03T19:54:33.722197] [DEBUG] [LOCAL ] LCII: Loaded 26818 existing records from primary storage. [2025-11-03T19:54:33.722843] [INFO ] [MAIN ] LCII: Loaded 26818 existing records. [2025-11-03T19:54:33.877289] [DEBUG] [LOCAL ] LDI: Loaded 46150 existing records from primary storage. [2025-11-03T19:54:33.953740] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:54:33.937261] [INFO ] [MAIN ] LDI: Loaded 46150 existing records. [2025-11-03T19:54:33.954903] [DEBUG] [LOCAL ] LDOS: Loaded 44695 existing records from primary storage. [2025-11-03T19:54:33.976450] [INFO ] [MAIN ] LDOS: Loaded 44695 existing records. [2025-11-03T19:54:33.976355] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-11-03T19:54:34.052963] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-11-03T19:54:34.233785] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-11-03T19:54:34.233637] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:54:34.233940] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-11-03T19:54:34.250358] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-11-03T19:54:34.260779] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-11-03T19:54:34.335962] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-11-03T19:54:34.360306] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-11-03T19:54:34.588098] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:54:34.602180] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-11-03T19:54:34.601924] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:54:34.625142] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-11-03T19:54:34.640779] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-11-03T19:54:34.624925] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-11-03T19:54:34.686017] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-11-03T19:54:34.718084] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-11-03T19:54:34.742687] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-11-03T19:54:34.823461] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-11-03T19:54:35.386366] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:54:35.459563] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-11-03T19:54:35.795999] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:54:35.829122] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-11-03T19:54:35.938218] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:54:35.960357] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-11-03T19:54:35.991161] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:54:35.991500] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-11-03T19:54:36.298395] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-11-03T19:54:36.302119] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-11-03T19:54:36.598417] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-11-03T19:54:36.603422] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-11-03T19:54:36.806783] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-11-03T19:54:36.809812] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-11-03T19:54:36.948062] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-11-03T19:54:36.954721] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-11-03T19:54:37.450782] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-11-03T19:54:37.456309] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-11-03T19:54:37.494872] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-11-03T19:54:37.499379] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-11-03T19:54:37.502997] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T19:54:37.534827] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-11-03T19:54:37.851358] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-11-03T19:54:38.211304] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-11-03T19:54:38.334902] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-11-03T19:54:38.471378] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-11-03T19:54:38.835427] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-11-03T19:54:38.915741] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-11-03T19:54:39.134875] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-11-03T19:54:39.703223] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-11-03T19:54:39.934861] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-11-03T19:54:40.734859] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-11-03T19:54:41.363066] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-11-03T19:54:41.534892] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-11-03T19:54:41.775062] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-11-03T19:54:42.334849] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-11-03T19:54:42.704050] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-11-03T19:54:43.134886] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-11-03T19:54:43.244219] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-11-03T19:54:43.934899] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-11-03T19:54:44.467455] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:54:44.604526] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-11-03T19:54:44.734893] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-11-03T19:54:45.534909] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-11-03T19:54:45.914601] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-11-03T19:54:46.334856] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-11-03T19:54:46.801917] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-11-03T19:54:47.134894] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-11-03T19:54:47.388697] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-11-03T19:54:47.934906] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-11-03T19:54:48.305358] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-11-03T19:54:48.734898] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-11-03T19:54:48.976277] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-11-03T19:54:49.534842] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-11-03T19:54:49.981550] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:54:50.334865] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-11-03T19:54:50.689773] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-11-03T19:54:50.907722] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-11-03T19:54:51.134873] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-11-03T19:54:51.627997] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-11-03T19:54:51.934847] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-11-03T19:54:52.734875] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-11-03T19:54:53.177557] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T19:54:53.545967] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-11-03T19:54:53.553309] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-11-03T19:54:54.175056] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-11-03T19:54:54.334857] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-11-03T19:54:55.134880] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-11-03T19:54:55.478079] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-11-03T19:54:55.864061] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T19:54:55.934861] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-11. [2025-11-03T19:54:56.552405] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-11 (0.62 seconds). [2025-11-03T19:54:56.553214] [INFO ] [REMOTE ] LDP: Full fetch complete (18471 records). [2025-11-03T19:54:56.553283] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-11-03T19:54:56.734981] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-11-03T19:54:56.931675] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-11-03T19:54:56.931768] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-11-03T19:54:56.932272] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-11-03T19:54:56.932333] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-11-03T19:54:56.932905] [DEBUG] [LOCAL ] LDP: Trimmed 18471 records to 12054 (keeping 200 days of data) [2025-11-03T19:54:57.008085] [DEBUG] [LOCAL ] LDP: Primary data saved (12054 records). [2025-11-03T19:54:57.008223] [INFO ] [MAIN ] LDP: Full history saved. [2025-11-03T19:54:57.008306] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LDP took 24.2s. Estimated remaining: 2h 38m 32s. Rate: 7.1 symbols/min [2025-11-03T19:54:57.182897] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:54:57.219387] [DEBUG] [LOCAL ] LEA: Loaded 41378 existing records from primary storage. [2025-11-03T19:54:57.219694] [INFO ] [MAIN ] LEA: Loaded 41378 existing records. [2025-11-03T19:54:57.422486] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:54:57.422763] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-11-03T19:54:57.422824] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-11-03T19:54:57.423545] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-11-03T19:54:57.423606] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-11-03T19:54:57.539992] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-11-03T19:54:57.818079] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:54:57.921110] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-11-03T19:54:58.334869] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-11-03T19:54:58.458251] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-11-03T19:54:59.134907] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-11-03T19:54:59.864891] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-11-03T19:54:59.934832] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-11-03T19:54:59.971677] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-11-03T19:55:00.734890] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-11-03T19:55:01.241930] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-11-03T19:55:01.534832] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-11-03T19:55:01.566039] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-11-03T19:55:02.334884] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-11. [2025-11-03T19:55:02.618992] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T19:55:03.134822] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-11-03T19:55:03.189292] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-11 (0.85 seconds). [2025-11-03T19:55:03.190373] [INFO ] [REMOTE ] LCII: Full fetch complete (39380 records). [2025-11-03T19:55:03.190442] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-11-03T19:55:03.562255] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-11-03T19:55:03.562329] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-11-03T19:55:03.563000] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-11-03T19:55:03.563060] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-11-03T19:55:03.563884] [DEBUG] [LOCAL ] LCII: Trimmed 39380 records to 26185 (keeping 200 days of data) [2025-11-03T19:55:03.721427] [DEBUG] [LOCAL ] LCII: Primary data saved (26185 records). [2025-11-03T19:55:03.721549] [INFO ] [MAIN ] LCII: Full history saved. [2025-11-03T19:55:03.721624] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LCII took 30.9s. Estimated remaining: 2h 38m 22s. Rate: 7.1 symbols/min [2025-11-03T19:55:03.889600] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:03.934167] [DEBUG] [LOCAL ] LEG: Loaded 50590 existing records from primary storage. [2025-11-03T19:55:03.934456] [INFO ] [MAIN ] LEG: Loaded 50590 existing records. [2025-11-03T19:55:03.945858] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-11-03T19:55:04.115687] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:04.115992] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-11-03T19:55:04.116048] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-11-03T19:55:04.116966] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-11-03T19:55:04.117026] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-11-03T19:55:04.464079] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:04.699468] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T19:55:04.734836] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-11. [2025-11-03T19:55:05.300033] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-11-03T19:55:05.534881] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-11-03T19:55:06.031462] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-11 (1.30 seconds). [2025-11-03T19:55:06.032898] [INFO ] [REMOTE ] LDI: Full fetch complete (63135 records). [2025-11-03T19:55:06.032979] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-11-03T19:55:06.340082] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-11-03T19:55:06.410472] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-11-03T19:55:06.410563] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-11-03T19:55:06.411453] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-11-03T19:55:06.411515] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-11-03T19:55:06.412752] [DEBUG] [LOCAL ] LDI: Trimmed 63135 records to 45671 (keeping 200 days of data) [2025-11-03T19:55:06.660499] [DEBUG] [LOCAL ] LDI: Primary data saved (45671 records). [2025-11-03T19:55:06.660787] [INFO ] [MAIN ] LDI: Full history saved. [2025-11-03T19:55:06.660962] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LDI took 33.8s. Estimated remaining: 2h 38m 9s. Rate: 7.1 symbols/min [2025-11-03T19:55:06.830988] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:06.856840] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-11-03T19:55:06.908716] [DEBUG] [LOCAL ] LEN: Loaded 53968 existing records from primary storage. [2025-11-03T19:55:06.909076] [INFO ] [MAIN ] LEN: Loaded 53968 existing records. [2025-11-03T19:55:07.082364] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:07.082551] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-11-03T19:55:07.082598] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-11-03T19:55:07.083716] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-11-03T19:55:07.083773] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-11-03T19:55:07.145456] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-11. [2025-11-03T19:55:07.432338] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:07.630589] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-11-03T19:55:07.934878] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-11-03T19:55:08.198383] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-11 (1.05 seconds). [2025-11-03T19:55:08.199813] [INFO ] [REMOTE ] LDOS: Full fetch complete (66453 records). [2025-11-03T19:55:08.199893] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-11-03T19:55:08.579556] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-11-03T19:55:08.579635] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-11-03T19:55:08.580595] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-11-03T19:55:08.580661] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-11-03T19:55:08.581913] [DEBUG] [LOCAL ] LDOS: Trimmed 66453 records to 44017 (keeping 200 days of data) [2025-11-03T19:55:08.754560] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-11-03T19:55:08.848615] [DEBUG] [LOCAL ] LDOS: Primary data saved (44017 records). [2025-11-03T19:55:08.848766] [INFO ] [MAIN ] LDOS: Full history saved. [2025-11-03T19:55:08.848859] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LDOS took 36.0s. Estimated remaining: 2h 37m 55s. Rate: 7.1 symbols/min [2025-11-03T19:55:09.014345] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:09.029789] [DEBUG] [LOCAL ] LEO: Loaded 16724 existing records from primary storage. [2025-11-03T19:55:09.030021] [INFO ] [MAIN ] LEO: Loaded 16724 existing records. [2025-11-03T19:55:09.206183] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:09.206502] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-11-03T19:55:09.206558] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-11-03T19:55:09.206939] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-11-03T19:55:09.206998] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-11-03T19:55:09.564313] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:09.545756] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-11-03T19:55:09.597237] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-11-03T19:55:09.786184] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-11-03T19:55:10.334865] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-11-03T19:55:10.827788] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-11-03T19:55:11.134911] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-11-03T19:55:11.731948] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-11-03T19:55:11.934893] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-11-03T19:55:12.286260] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-11-03T19:55:12.734910] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-11-03T19:55:13.273596] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-11-03T19:55:13.459564] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-11-03T19:55:13.534866] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-11-03T19:55:14.334898] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-11-03T19:55:14.997047] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-11-03T19:55:15.134852] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-11-03T19:55:15.801986] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-11-03T19:55:15.934955] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-11-03T19:55:16.495617] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-11-03T19:55:16.734896] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-11-03T19:55:17.323175] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-11-03T19:55:17.534849] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-11-03T19:55:18.067358] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-11-03T19:55:18.334849] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-11-03T19:55:18.883879] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-11-03T19:55:19.070595] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-11-03T19:55:19.134870] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-11-03T19:55:19.934853] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-11-03T19:55:20.700235] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-11-03T19:55:20.734819] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-11-03T19:55:21.195094] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-11-03T19:55:21.534847] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-11-03T19:55:22.241837] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-11-03T19:55:22.334826] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-11-03T19:55:22.427115] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-11-03T19:55:23.081945] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-11-03T19:55:23.134808] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-11-03T19:55:23.737078] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-11-03T19:55:23.934846] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-11-03T19:55:24.734837] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-11-03T19:55:25.260701] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-11-03T19:55:25.404743] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-11-03T19:55:25.534888] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-11-03T19:55:26.334888] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-11-03T19:55:26.992528] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-11-03T19:55:27.067505] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-11-03T19:55:27.134841] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-11-03T19:55:27.934847] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-11-03T19:55:28.734816] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-11-03T19:55:28.786303] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-11-03T19:55:29.355001] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T19:55:29.437975] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-11-03T19:55:29.534824] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-11-03T19:55:30.334889] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-11-03T19:55:30.774202] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T19:55:30.931368] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-11-03T19:55:31.134894] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-11-03T19:55:31.891881] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-11-03T19:55:31.934861] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-11. [2025-11-03T19:55:32.594139] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-11 (0.66 seconds). [2025-11-03T19:55:32.595138] [INFO ] [REMOTE ] LEO: Full fetch complete (26589 records). [2025-11-03T19:55:32.595206] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-11-03T19:55:32.740040] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-11-03T19:55:32.974316] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-11-03T19:55:32.974391] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-11-03T19:55:32.974935] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-11-03T19:55:32.974995] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-11-03T19:55:32.975595] [DEBUG] [LOCAL ] LEO: Trimmed 26589 records to 16168 (keeping 200 days of data) [2025-11-03T19:55:33.064579] [DEBUG] [LOCAL ] LEO: Primary data saved (16168 records). [2025-11-03T19:55:33.064735] [INFO ] [MAIN ] LEO: Full history saved. [2025-11-03T19:55:33.064819] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LEO took 24.2s. Estimated remaining: 2h 38m 1s. Rate: 7.1 symbols/min [2025-11-03T19:55:33.235134] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:33.280960] [DEBUG] [LOCAL ] LEVI: Loaded 52557 existing records from primary storage. [2025-11-03T19:55:33.281263] [INFO ] [MAIN ] LEVI: Loaded 52557 existing records. [2025-11-03T19:55:33.461951] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:33.462171] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-11-03T19:55:33.462227] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-11-03T19:55:33.463113] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-11-03T19:55:33.463171] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-11-03T19:55:33.539942] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-11-03T19:55:33.824825] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:34.124956] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-11-03T19:55:34.334836] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-11-03T19:55:34.755321] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-11-03T19:55:35.134852] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-11-03T19:55:35.701190] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-11-03T19:55:35.934868] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-11-03T19:55:36.334675] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-11-03T19:55:36.734877] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-11. [2025-11-03T19:55:37.534829] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-11-03T19:55:37.607493] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-11-03T19:55:37.695003] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-11 (0.96 seconds). [2025-11-03T19:55:37.696364] [INFO ] [REMOTE ] LEA: Full fetch complete (60396 records). [2025-11-03T19:55:37.696443] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-11-03T19:55:38.092808] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-11-03T19:55:38.092886] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-11-03T19:55:38.094024] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-11-03T19:55:38.094104] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-11-03T19:55:38.095677] [DEBUG] [LOCAL ] LEA: Trimmed 60396 records to 40836 (keeping 200 days of data) [2025-11-03T19:55:38.335975] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-11. [2025-11-03T19:55:38.341180] [DEBUG] [LOCAL ] LEA: Primary data saved (40836 records). [2025-11-03T19:55:38.342169] [INFO ] [MAIN ] LEA: Full history saved. [2025-11-03T19:55:38.342269] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LEA took 41.3s. Estimated remaining: 2h 37m 49s. Rate: 7.1 symbols/min [2025-11-03T19:55:38.510510] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:38.526589] [DEBUG] [LOCAL ] LFT: Loaded 18308 existing records from primary storage. [2025-11-03T19:55:38.526884] [INFO ] [MAIN ] LFT: Loaded 18308 existing records. [2025-11-03T19:55:38.703479] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:38.704038] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-11-03T19:55:38.704246] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-11-03T19:55:38.705032] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-11-03T19:55:38.705293] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-11-03T19:55:39.091551] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-11-03T19:55:39.125437] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:39.134806] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-11. [2025-11-03T19:55:39.797631] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-11 (1.46 seconds). [2025-11-03T19:55:39.799141] [INFO ] [REMOTE ] LEN: Full fetch complete (77219 records). [2025-11-03T19:55:39.799244] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-11-03T19:55:39.939954] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-11-03T19:55:40.230148] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-11-03T19:55:40.230228] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-11-03T19:55:40.231327] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-11-03T19:55:40.231394] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-11-03T19:55:40.232854] [DEBUG] [LOCAL ] LEN: Trimmed 77219 records to 53204 (keeping 200 days of data) [2025-11-03T19:55:40.326519] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-11 (1.19 seconds). [2025-11-03T19:55:40.339124] [INFO ] [REMOTE ] LEG: Full fetch complete (72828 records). [2025-11-03T19:55:40.352381] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-11-03T19:55:40.736349] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-11-03T19:55:40.737992] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-11-03T19:55:41.026468] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-11-03T19:55:41.026180] [DEBUG] [LOCAL ] LEN: Primary data saved (53204 records). [2025-11-03T19:55:41.026766] [INFO ] [MAIN ] LEN: Full history saved. [2025-11-03T19:55:41.026876] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-11-03T19:55:41.027046] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEN took 34.4s. Estimated remaining: 2h 37m 36s. Rate: 7.1 symbols/min [2025-11-03T19:55:41.028392] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-11-03T19:55:41.028491] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-11-03T19:55:41.147109] [DEBUG] [LOCAL ] LEG: Trimmed 72828 records to 49842 (keeping 200 days of data) [2025-11-03T19:55:41.285631] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:41.448019] [DEBUG] [LOCAL ] LGI: Loaded 9771 existing records from primary storage. [2025-11-03T19:55:41.456086] [INFO ] [MAIN ] LGI: Loaded 9771 existing records. [2025-11-03T19:55:41.535073] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-11-03T19:55:41.666304] [DEBUG] [LOCAL ] LEG: Primary data saved (49842 records). [2025-11-03T19:55:41.695065] [INFO ] [MAIN ] LEG: Full history saved. [2025-11-03T19:55:41.726558] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LEG took 38.0s. Estimated remaining: 2h 37m 20s. Rate: 7.1 symbols/min [2025-11-03T19:55:41.732497] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:41.810718] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-11-03T19:55:41.822557] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-11-03T19:55:41.835928] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-11-03T19:55:41.844773] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-11-03T19:55:42.072697] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:42.237834] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-11-03T19:55:42.332265] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:42.342821] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-11-03T19:55:42.362400] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-11-03T19:55:42.384080] [DEBUG] [LOCAL ] LH: Loaded 37449 existing records from primary storage. [2025-11-03T19:55:42.384315] [INFO ] [MAIN ] LH: Loaded 37449 existing records. [2025-11-03T19:55:42.569092] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:42.569363] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-11-03T19:55:42.569419] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-11-03T19:55:42.570090] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-11-03T19:55:42.570150] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-11-03T19:55:42.930289] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:43.012105] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-11-03T19:55:43.134884] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-11-03T19:55:43.891481] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-11-03T19:55:43.934847] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-11-03T19:55:44.596857] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-11-03T19:55:44.734873] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-11-03T19:55:45.374811] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-11-03T19:55:45.534840] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-11-03T19:55:46.334833] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-11-03T19:55:46.392156] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:55:47.134941] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-11-03T19:55:47.545720] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T19:55:47.914310] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-11-03T19:55:47.934808] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-11-03T19:55:48.734852] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-11-03T19:55:49.155694] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-11-03T19:55:49.494096] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-11-03T19:55:49.534879] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-11-03T19:55:50.165170] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-11-03T19:55:50.334872] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-11-03T19:55:50.891139] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-11-03T19:55:51.134920] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-11-03T19:55:51.662675] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-11-03T19:55:51.934899] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-11-03T19:55:52.524396] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-11-03T19:55:52.734906] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-11-03T19:55:53.534928] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-11-03T19:55:53.814895] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-11-03T19:55:54.334846] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-11-03T19:55:54.732999] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-11-03T19:55:54.992505] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-11-03T19:55:55.134929] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-11. [2025-11-03T19:55:55.747143] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-11 (0.61 seconds). [2025-11-03T19:55:55.748599] [INFO ] [REMOTE ] LFT: Full fetch complete (23825 records). [2025-11-03T19:55:55.748743] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-11-03T19:55:55.935023] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-11-03T19:55:56.168979] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-11-03T19:55:56.169074] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-11-03T19:55:56.169613] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-11-03T19:55:56.169687] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-11-03T19:55:56.170506] [DEBUG] [LOCAL ] LFT: Trimmed 23825 records to 18062 (keeping 200 days of data) [2025-11-03T19:55:56.274160] [DEBUG] [LOCAL ] LFT: Primary data saved (18062 records). [2025-11-03T19:55:56.274305] [INFO ] [MAIN ] LFT: Full history saved. [2025-11-03T19:55:56.274384] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LFT took 17.9s. Estimated remaining: 2h 37m 17s. Rate: 7.1 symbols/min [2025-11-03T19:55:56.472437] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:55:56.515718] [DEBUG] [LOCAL ] LHX: Loaded 48936 existing records from primary storage. [2025-11-03T19:55:56.516076] [INFO ] [MAIN ] LHX: Loaded 48936 existing records. [2025-11-03T19:55:56.688978] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:55:56.689207] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-11-03T19:55:56.689254] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-11-03T19:55:56.690114] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-11-03T19:55:56.690171] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-11-03T19:55:56.743542] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-11-03T19:55:57.050815] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:55:57.148415] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-11-03T19:55:57.270524] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-11-03T19:55:57.534847] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-11-03T19:55:58.334864] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-11-03T19:55:58.876754] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T19:55:59.134865] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-11-03T19:55:59.586797] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-11-03T19:55:59.934869] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-11-03T19:56:00.598505] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T19:56:00.734887] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-11-03T19:56:01.215872] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-11-03T19:56:01.534931] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-11-03T19:56:01.990454] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-11-03T19:56:02.023216] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-11-03T19:56:02.334850] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-11-03T19:56:03.134910] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-11-03T19:56:03.641569] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-11-03T19:56:03.752613] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-11-03T19:56:03.934853] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-11-03T19:56:04.617831] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-11-03T19:56:04.734852] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-11-03T19:56:05.217399] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-11-03T19:56:05.534900] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-11-03T19:56:06.334833] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-11-03T19:56:06.855139] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-11-03T19:56:06.860028] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-11-03T19:56:07.134876] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-11-03T19:56:07.934821] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-11-03T19:56:08.405633] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-11-03T19:56:08.734854] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-11-03T19:56:09.141673] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-11-03T19:56:09.534868] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-11-03T19:56:10.052945] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-11-03T19:56:10.334885] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-11. [2025-11-03T19:56:10.598626] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-11-03T19:56:10.763451] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-11 (0.43 seconds). [2025-11-03T19:56:10.764231] [INFO ] [REMOTE ] LGI: Full fetch complete (14316 records). [2025-11-03T19:56:10.764299] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-11-03T19:56:11.134890] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-11-03T19:56:11.152526] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-11-03T19:56:11.152592] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-11-03T19:56:11.152963] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-11-03T19:56:11.153025] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-11-03T19:56:11.153500] [DEBUG] [LOCAL ] LGI: Trimmed 14316 records to 9570 (keeping 200 days of data) [2025-11-03T19:56:11.211260] [DEBUG] [LOCAL ] LGI: Primary data saved (9570 records). [2025-11-03T19:56:11.211368] [INFO ] [MAIN ] LGI: Full history saved. [2025-11-03T19:56:11.211440] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LGI took 30.2s. Estimated remaining: 2h 37m 15s. Rate: 7.1 symbols/min [2025-11-03T19:56:11.378989] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:56:11.403406] [DEBUG] [LOCAL ] LII: Loaded 28052 existing records from primary storage. [2025-11-03T19:56:11.403689] [INFO ] [MAIN ] LII: Loaded 28052 existing records. [2025-11-03T19:56:11.593501] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:56:11.593768] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-11-03T19:56:11.593834] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-11-03T19:56:11.594396] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-11-03T19:56:11.594453] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-11-03T19:56:11.935174] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-11-03T19:56:11.959712] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:56:12.407708] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T19:56:12.734905] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-11-03T19:56:13.317102] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-11-03T19:56:13.534881] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-11-03T19:56:14.249231] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T19:56:14.334841] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-11-03T19:56:14.882758] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-11-03T19:56:15.134874] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-11-03T19:56:15.410429] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-11-03T19:56:15.934895] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-11. [2025-11-03T19:56:16.365291] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:56:16.734849] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-11-03T19:56:17.207209] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-11 (1.27 seconds). [2025-11-03T19:56:17.208797] [INFO ] [REMOTE ] LEVI: Full fetch complete (75091 records). [2025-11-03T19:56:17.208946] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-11-03T19:56:17.539936] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-11-03T19:56:17.620241] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-11-03T19:56:17.620679] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-11-03T19:56:17.621694] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-11-03T19:56:17.621782] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-11-03T19:56:17.623514] [DEBUG] [LOCAL ] LEVI: Trimmed 75091 records to 51810 (keeping 200 days of data) [2025-11-03T19:56:17.729463] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-11-03T19:56:17.953247] [DEBUG] [LOCAL ] LEVI: Primary data saved (51810 records). [2025-11-03T19:56:17.953381] [INFO ] [MAIN ] LEVI: Full history saved. [2025-11-03T19:56:17.953476] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LEVI took 44.9s. Estimated remaining: 2h 37m 5s. Rate: 7.1 symbols/min [2025-11-03T19:56:18.121185] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:56:18.161229] [DEBUG] [LOCAL ] LION: Loaded 48167 existing records from primary storage. [2025-11-03T19:56:18.161544] [INFO ] [MAIN ] LION: Loaded 48167 existing records. [2025-11-03T19:56:18.337188] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:56:18.337271] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-11-03T19:56:18.338263] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-11-03T19:56:18.338316] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-11-03T19:56:18.338991] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-11-03T19:56:18.339047] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-11-03T19:56:18.703176] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:56:18.894530] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-11-03T19:56:19.134857] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-11-03T19:56:19.474370] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-11-03T19:56:19.934913] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-11-03T19:56:20.599689] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-11-03T19:56:20.734833] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-11-03T19:56:20.932319] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T19:56:21.534858] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-11-03T19:56:22.146793] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-11-03T19:56:22.275904] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T19:56:22.334844] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-11-03T19:56:23.134859] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-11-03T19:56:23.607723] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-11-03T19:56:23.934859] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-11-03T19:56:24.119278] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-11-03T19:56:24.570853] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-11-03T19:56:24.734871] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-11-03T19:56:25.534873] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-11-03T19:56:26.196285] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-11-03T19:56:26.334844] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-11. [2025-11-03T19:56:26.422143] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-11-03T19:56:27.134906] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-11. [2025-11-03T19:56:27.389909] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-11 (1.06 seconds). [2025-11-03T19:56:27.391467] [INFO ] [REMOTE ] LHX: Full fetch complete (70701 records). [2025-11-03T19:56:27.391569] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-11-03T19:56:27.783478] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-11-03T19:56:27.783566] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-11-03T19:56:27.784498] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-11-03T19:56:27.784566] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-11-03T19:56:27.785938] [DEBUG] [LOCAL ] LHX: Trimmed 70701 records to 48215 (keeping 200 days of data) [2025-11-03T19:56:27.966830] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-11-03T19:56:28.082239] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-11 (0.95 seconds). [2025-11-03T19:56:28.086710] [INFO ] [REMOTE ] LH: Full fetch complete (55076 records). [2025-11-03T19:56:28.087909] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-11-03T19:56:28.176311] [DEBUG] [LOCAL ] LHX: Primary data saved (48215 records). [2025-11-03T19:56:28.190779] [INFO ] [MAIN ] LHX: Full history saved. [2025-11-03T19:56:28.207068] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LHX took 31.9s. Estimated remaining: 2h 36m 58s. Rate: 7.1 symbols/min [2025-11-03T19:56:28.578446] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:56:28.633371] [DEBUG] [LOCAL ] LITB: Loaded 3735 existing records from primary storage. [2025-11-03T19:56:28.658623] [INFO ] [MAIN ] LITB: Loaded 3735 existing records. [2025-11-03T19:56:28.740778] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-11-03T19:56:28.740609] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-11-03T19:56:28.763869] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-11-03T19:56:28.771473] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-11-03T19:56:28.784229] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-11-03T19:56:28.863833] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:56:28.863952] [DEBUG] [LOCAL ] LH: Trimmed 55076 records to 36901 (keeping 200 days of data) [2025-11-03T19:56:28.864188] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-11-03T19:56:28.864452] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-11-03T19:56:28.864850] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-11-03T19:56:28.864909] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-11-03T19:56:29.481449] [DEBUG] [LOCAL ] LH: Primary data saved (36901 records). [2025-11-03T19:56:29.481859] [INFO ] [MAIN ] LH: Full history saved. [2025-11-03T19:56:29.481106] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:56:29.482031] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LH took 47.7s. Estimated remaining: 2h 36m 43s. Rate: 7.1 symbols/min [2025-11-03T19:56:29.538999] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-11-03T19:56:29.586829] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-11-03T19:56:29.680217] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T19:56:29.709668] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:56:29.756475] [DEBUG] [LOCAL ] LLY: Loaded 53940 existing records from primary storage. [2025-11-03T19:56:29.756802] [INFO ] [MAIN ] LLY: Loaded 53940 existing records. [2025-11-03T19:56:29.934866] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:56:29.935140] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-11-03T19:56:29.937893] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-11-03T19:56:29.938451] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-11-03T19:56:29.940769] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-11-03T19:56:29.940827] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-11-03T19:56:30.285430] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:56:30.334809] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-11-03T19:56:31.134852] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-11-03T19:56:31.934818] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-11-03T19:56:32.083828] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-11-03T19:56:32.117115] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-11-03T19:56:32.734824] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-11-03T19:56:32.777367] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-11-03T19:56:33.069855] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-11-03T19:56:33.534910] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-11-03T19:56:34.334863] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-11-03T19:56:35.134829] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-11-03T19:56:35.194386] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-11-03T19:56:35.243232] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-11-03T19:56:35.523881] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-11-03T19:56:35.934925] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-11-03T19:56:36.734867] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-11-03T19:56:37.534841] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-11-03T19:56:37.684237] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-11-03T19:56:38.017581] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-11-03T19:56:38.048968] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-11-03T19:56:38.334832] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-11-03T19:56:39.134897] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-11-03T19:56:39.934876] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-11-03T19:56:40.075401] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-11-03T19:56:40.287700] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-11-03T19:56:40.734905] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-11-03T19:56:41.052970] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-11-03T19:56:41.534937] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-11-03T19:56:41.854962] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-11-03T19:56:42.334875] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-11-03T19:56:42.743216] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-11-03T19:56:43.134828] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-11-03T19:56:43.177030] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-11-03T19:56:43.437199] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-11-03T19:56:43.934886] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-11-03T19:56:44.734939] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-11-03T19:56:45.044777] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-11-03T19:56:45.119928] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T19:56:45.534950] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-11-03T19:56:46.334968] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-11-03T19:56:46.635372] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-11-03T19:56:46.786552] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-11-03T19:56:47.134918] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-11-03T19:56:47.934891] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-11-03T19:56:48.734927] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-11-03T19:56:49.019685] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-11-03T19:56:49.050229] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T19:56:49.066531] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-11-03T19:56:49.534892] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-11. [2025-11-03T19:56:50.334824] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-11-03T19:56:50.347837] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:56:50.349227] [INFO ] [REMOTE ] LII: Full fetch complete (42122 records). [2025-11-03T19:56:50.349314] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-11-03T19:56:50.717735] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-11-03T19:56:50.717819] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-11-03T19:56:50.718623] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-11-03T19:56:50.718695] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-11-03T19:56:50.719578] [DEBUG] [LOCAL ] LII: Trimmed 42122 records to 27774 (keeping 200 days of data) [2025-11-03T19:56:50.788054] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-11-03T19:56:50.895797] [DEBUG] [LOCAL ] LII: Primary data saved (27774 records). [2025-11-03T19:56:50.895927] [INFO ] [MAIN ] LII: Full history saved. [2025-11-03T19:56:50.896003] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LII took 39.7s. Estimated remaining: 2h 36m 46s. Rate: 7.1 symbols/min [2025-11-03T19:56:51.080307] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:56:51.127715] [DEBUG] [LOCAL ] LMND: Loaded 52883 existing records from primary storage. [2025-11-03T19:56:51.128051] [INFO ] [MAIN ] LMND: Loaded 52883 existing records. [2025-11-03T19:56:51.139989] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-11. [2025-11-03T19:56:51.303800] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:56:51.303994] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-11-03T19:56:51.304040] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-11-03T19:56:51.304834] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-11-03T19:56:51.304891] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-11-03T19:56:51.648994] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:56:51.653566] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-11 (0.51 seconds). [2025-11-03T19:56:51.654198] [INFO ] [REMOTE ] LITB: Full fetch complete (5860 records). [2025-11-03T19:56:51.654264] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-11-03T19:56:51.939993] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-11-03T19:56:52.026363] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-11-03T19:56:52.026443] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-11-03T19:56:52.026615] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-11-03T19:56:52.026694] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-11-03T19:56:52.027088] [DEBUG] [LOCAL ] LITB: Trimmed 5860 records to 3602 (keeping 200 days of data) [2025-11-03T19:56:52.046497] [DEBUG] [LOCAL ] LITB: Primary data saved (3602 records). [2025-11-03T19:56:52.046572] [INFO ] [MAIN ] LITB: Full history saved. [2025-11-03T19:56:52.046663] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LITB took 23.8s. Estimated remaining: 2h 36m 31s. Rate: 7.1 symbols/min [2025-11-03T19:56:52.220503] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:56:52.265127] [DEBUG] [LOCAL ] LMT: Loaded 50114 existing records from primary storage. [2025-11-03T19:56:52.265430] [INFO ] [MAIN ] LMT: Loaded 50114 existing records. [2025-11-03T19:56:52.448111] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:56:52.448345] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-11-03T19:56:52.448393] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-11-03T19:56:52.449368] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-11-03T19:56:52.449427] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-11-03T19:56:52.738395] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-11-03T19:56:52.816993] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:56:53.329493] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-11-03T19:56:53.534858] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-11-03T19:56:53.979557] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-11-03T19:56:54.334866] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-11-03T19:56:55.039911] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-11-03T19:56:55.134906] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-11-03T19:56:55.647541] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-11-03T19:56:55.934895] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-11-03T19:56:56.546821] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-11-03T19:56:56.734834] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-11-03T19:56:57.534901] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-11-03T19:56:58.014548] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-11-03T19:56:58.016392] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-11-03T19:56:58.334857] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-11-03T19:56:59.063554] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-11-03T19:56:59.134836] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-11-03T19:56:59.857073] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-11-03T19:56:59.934854] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-11-03T19:57:00.734859] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-11-03T19:57:01.051722] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-11-03T19:57:01.271892] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-11-03T19:57:01.534886] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-11-03T19:57:02.334851] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-11-03T19:57:02.836355] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-11-03T19:57:03.134829] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-11-03T19:57:03.322391] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-11-03T19:57:03.745607] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-11-03T19:57:03.934919] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-11. [2025-11-03T19:57:04.734912] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-11-03T19:57:05.204206] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-11 (1.27 seconds). [2025-11-03T19:57:05.207070] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-11-03T19:57:05.221069] [INFO ] [REMOTE ] LION: Full fetch complete (59329 records). [2025-11-03T19:57:05.221897] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-11-03T19:57:05.540033] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-11-03T19:57:05.614835] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-11-03T19:57:05.614943] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-11-03T19:57:05.616184] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-11-03T19:57:05.616257] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-11-03T19:57:05.618019] [DEBUG] [LOCAL ] LION: Trimmed 59329 records to 48019 (keeping 200 days of data) [2025-11-03T19:57:05.915169] [DEBUG] [LOCAL ] LION: Primary data saved (48019 records). [2025-11-03T19:57:05.915368] [INFO ] [MAIN ] LION: Full history saved. [2025-11-03T19:57:05.915479] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LION took 48.0s. Estimated remaining: 2h 36m 27s. Rate: 7.1 symbols/min [2025-11-03T19:57:06.093200] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:06.146176] [DEBUG] [LOCAL ] LNC: Loaded 52028 existing records from primary storage. [2025-11-03T19:57:06.146591] [INFO ] [MAIN ] LNC: Loaded 52028 existing records. [2025-11-03T19:57:06.337093] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:06.334904] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-11-03T19:57:06.338006] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-11-03T19:57:06.339458] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-11-03T19:57:06.340597] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-11-03T19:57:06.340695] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-11-03T19:57:06.636409] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-11-03T19:57:06.814391] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:07.134818] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-11-03T19:57:07.306951] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-11-03T19:57:07.934848] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-11-03T19:57:08.419275] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-11-03T19:57:08.734914] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-11-03T19:57:08.928485] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-11-03T19:57:09.534863] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-11. [2025-11-03T19:57:09.575516] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-11-03T19:57:10.274765] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-11-03T19:57:10.334868] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-11-03T19:57:11.134906] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-11-03T19:57:11.406196] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-11 (1.87 seconds). [2025-11-03T19:57:11.408405] [INFO ] [REMOTE ] LLY: Full fetch complete (77183 records). [2025-11-03T19:57:11.408577] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-11-03T19:57:11.919883] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-11-03T19:57:11.939276] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-11-03T19:57:12.042948] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-11-03T19:57:12.043068] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-11-03T19:57:12.045027] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-11-03T19:57:12.045134] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-11-03T19:57:12.047198] [DEBUG] [LOCAL ] LLY: Trimmed 77183 records to 53167 (keeping 200 days of data) [2025-11-03T19:57:12.416888] [DEBUG] [LOCAL ] LLY: Primary data saved (53167 records). [2025-11-03T19:57:12.417052] [INFO ] [MAIN ] LLY: Full history saved. [2025-11-03T19:57:12.417160] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LLY took 42.9s. Estimated remaining: 2h 36m 17s. Rate: 7.1 symbols/min [2025-11-03T19:57:12.589100] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:12.595143] [DEBUG] [LOCAL ] LND: Loaded 4942 existing records from primary storage. [2025-11-03T19:57:12.595333] [INFO ] [MAIN ] LND: Loaded 4942 existing records. [2025-11-03T19:57:12.744342] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-11-03T19:57:12.773610] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:12.774992] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-11-03T19:57:12.775066] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-11-03T19:57:12.775300] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-11-03T19:57:12.775365] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-11-03T19:57:13.109664] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-11-03T19:57:13.208468] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:13.534861] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-11-03T19:57:13.787359] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-11-03T19:57:14.007707] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-11-03T19:57:14.103909] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-11-03T19:57:14.334855] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-11-03T19:57:14.809932] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-11-03T19:57:15.134862] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-11-03T19:57:15.775686] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-11-03T19:57:15.934867] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-11-03T19:57:16.734879] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-11-03T19:57:17.104179] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-11-03T19:57:17.534822] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-11-03T19:57:17.691924] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-11-03T19:57:18.334853] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-11-03T19:57:18.703822] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-11-03T19:57:19.130032] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-11-03T19:57:19.140187] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-11-03T19:57:19.583553] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-11-03T19:57:19.934867] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-11-03T19:57:20.734860] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-11-03T19:57:21.439953] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-11-03T19:57:21.534848] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-11-03T19:57:22.334889] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-11-03T19:57:22.557697] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-11-03T19:57:23.134852] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-11-03T19:57:23.249136] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-11-03T19:57:23.442774] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-11-03T19:57:23.639761] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-11-03T19:57:23.934849] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-11-03T19:57:24.302335] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-11-03T19:57:24.734862] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-11-03T19:57:25.125541] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-11-03T19:57:25.534900] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-11-03T19:57:25.956507] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-11-03T19:57:26.334908] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-11. [2025-11-03T19:57:26.770732] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-11 (0.44 seconds). [2025-11-03T19:57:26.771401] [INFO ] [REMOTE ] LND: Full fetch complete (7813 records). [2025-11-03T19:57:26.771466] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-11-03T19:57:27.140052] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-11. [2025-11-03T19:57:27.147194] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-11-03T19:57:27.148068] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-11-03T19:57:27.148281] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-11-03T19:57:27.148320] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-11-03T19:57:27.148797] [DEBUG] [LOCAL ] LND: Trimmed 7813 records to 4854 (keeping 200 days of data) [2025-11-03T19:57:27.178526] [DEBUG] [LOCAL ] LND: Primary data saved (4854 records). [2025-11-03T19:57:27.178671] [INFO ] [MAIN ] LND: Full history saved. [2025-11-03T19:57:27.178771] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LND took 14.8s. Estimated remaining: 2h 36m 14s. Rate: 7.1 symbols/min [2025-11-03T19:57:27.355541] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:27.402709] [DEBUG] [LOCAL ] LNG: Loaded 51702 existing records from primary storage. [2025-11-03T19:57:27.403011] [INFO ] [MAIN ] LNG: Loaded 51702 existing records. [2025-11-03T19:57:27.580828] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:27.581033] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-11-03T19:57:27.581079] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-11-03T19:57:27.582057] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-11-03T19:57:27.582114] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-11-03T19:57:27.948680] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-11. [2025-11-03T19:57:27.975431] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:28.541506] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-11 (1.40 seconds). [2025-11-03T19:57:28.544072] [INFO ] [REMOTE ] LMND: Full fetch complete (75501 records). [2025-11-03T19:57:28.544302] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-11-03T19:57:28.746623] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-11-03T19:57:28.950554] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-11-03T19:57:28.950673] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-11-03T19:57:28.951778] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-11-03T19:57:28.951844] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-11-03T19:57:28.953373] [DEBUG] [LOCAL ] LMND: Trimmed 75501 records to 52223 (keeping 200 days of data) [2025-11-03T19:57:29.255476] [DEBUG] [LOCAL ] LMND: Primary data saved (52223 records). [2025-11-03T19:57:29.255606] [INFO ] [MAIN ] LMND: Full history saved. [2025-11-03T19:57:29.255720] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LMND took 38.4s. Estimated remaining: 2h 36m 0s. Rate: 7.1 symbols/min [2025-11-03T19:57:29.447892] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:29.443776] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-11 (1.50 seconds). [2025-11-03T19:57:29.450294] [INFO ] [REMOTE ] LMT: Full fetch complete (72501 records). [2025-11-03T19:57:29.450737] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-11-03T19:57:29.546486] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-11-03T19:57:29.573158] [DEBUG] [LOCAL ] LNN: Loaded 11849 existing records from primary storage. [2025-11-03T19:57:29.587127] [INFO ] [MAIN ] LNN: Loaded 11849 existing records. [2025-11-03T19:57:29.944907] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:29.981160] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-11-03T19:57:29.987002] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-11-03T19:57:30.056910] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-11-03T19:57:30.058727] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-11-03T19:57:30.102111] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-11-03T19:57:30.113135] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-11-03T19:57:30.127739] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-11-03T19:57:30.151928] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-11-03T19:57:30.197116] [DEBUG] [LOCAL ] LMT: Trimmed 72501 records to 49412 (keeping 200 days of data) [2025-11-03T19:57:30.740678] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:30.742830] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-11-03T19:57:30.753351] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-11-03T19:57:30.844176] [DEBUG] [LOCAL ] LMT: Primary data saved (49412 records). [2025-11-03T19:57:30.844402] [INFO ] [MAIN ] LMT: Full history saved. [2025-11-03T19:57:30.844616] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LMT took 38.8s. Estimated remaining: 2h 35m 46s. Rate: 7.1 symbols/min [2025-11-03T19:57:31.025184] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:31.069999] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-11-03T19:57:31.109141] [DEBUG] [LOCAL ] LOAR: Loaded 41928 existing records from primary storage. [2025-11-03T19:57:31.109442] [INFO ] [MAIN ] LOAR: Loaded 41928 existing records. [2025-11-03T19:57:31.139956] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-11-03T19:57:31.292393] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:31.292738] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-11-03T19:57:31.301232] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-11-03T19:57:31.302089] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-11-03T19:57:31.302162] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-11-03T19:57:31.302477] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-11-03T19:57:31.659966] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:31.934857] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-11-03T19:57:32.369611] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-11-03T19:57:32.734908] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-11-03T19:57:33.306476] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-11-03T19:57:33.534930] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-11-03T19:57:34.027739] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-11-03T19:57:34.073614] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-11-03T19:57:34.334906] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-11-03T19:57:34.847117] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-11-03T19:57:35.134868] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-11-03T19:57:35.795913] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-11-03T19:57:35.934854] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-11-03T19:57:36.734876] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-11-03T19:57:37.114615] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T19:57:37.250340] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-11-03T19:57:37.534859] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-11-03T19:57:38.167748] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-11-03T19:57:38.334845] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-11-03T19:57:38.970340] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-11-03T19:57:39.134894] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-11-03T19:57:39.660008] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-11-03T19:57:39.934864] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-11-03T19:57:40.734869] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-11-03T19:57:41.297348] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-11-03T19:57:41.534841] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-11-03T19:57:42.334835] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-11-03T19:57:42.380897] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-11-03T19:57:42.424927] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-11-03T19:57:42.769131] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-11-03T19:57:43.134871] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-11-03T19:57:43.934871] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-11-03T19:57:44.181979] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-11-03T19:57:44.734842] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-11-03T19:57:45.534828] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-11-03T19:57:45.665548] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-11-03T19:57:46.128110] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-11-03T19:57:46.258294] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-11-03T19:57:46.334858] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-11-03T19:57:47.134871] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-11-03T19:57:47.386809] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-11-03T19:57:47.934857] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-11. [2025-11-03T19:57:48.592532] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-11-03T19:57:48.734876] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-11-03T19:57:48.905215] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-11 (0.97 seconds). [2025-11-03T19:57:48.907143] [INFO ] [REMOTE ] LNC: Full fetch complete (74547 records). [2025-11-03T19:57:48.907260] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-11-03T19:57:49.310307] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-11-03T19:57:49.310391] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-11-03T19:57:49.311351] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-11-03T19:57:49.311415] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-11-03T19:57:49.312849] [DEBUG] [LOCAL ] LNC: Trimmed 74547 records to 51253 (keeping 200 days of data) [2025-11-03T19:57:49.536991] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-11-03T19:57:49.616777] [DEBUG] [LOCAL ] LNC: Primary data saved (51253 records). [2025-11-03T19:57:49.616943] [INFO ] [MAIN ] LNC: Full history saved. [2025-11-03T19:57:49.617027] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LNC took 43.7s. Estimated remaining: 2h 35m 46s. Rate: 7.1 symbols/min [2025-11-03T19:57:49.783453] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:49.807180] [DEBUG] [LOCAL ] LOB: Loaded 26486 existing records from primary storage. [2025-11-03T19:57:49.807446] [INFO ] [MAIN ] LOB: Loaded 26486 existing records. [2025-11-03T19:57:49.988875] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:49.989502] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-11-03T19:57:49.989610] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-11-03T19:57:49.990235] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-11-03T19:57:49.990295] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-11-03T19:57:50.360276] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-11. [2025-11-03T19:57:50.360189] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:50.389577] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-11-03T19:57:50.490002] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-11-03T19:57:51.066207] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-11 (0.71 seconds). [2025-11-03T19:57:51.067069] [INFO ] [REMOTE ] LNN: Full fetch complete (16563 records). [2025-11-03T19:57:51.067138] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-11-03T19:57:51.140076] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-11-03T19:57:51.432430] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-11-03T19:57:51.432497] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-11-03T19:57:51.432886] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-11-03T19:57:51.432969] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-11-03T19:57:51.433451] [DEBUG] [LOCAL ] LNN: Trimmed 16563 records to 11676 (keeping 200 days of data) [2025-11-03T19:57:51.504305] [DEBUG] [LOCAL ] LNN: Primary data saved (11676 records). [2025-11-03T19:57:51.504431] [INFO ] [MAIN ] LNN: Full history saved. [2025-11-03T19:57:51.504506] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LNN took 22.2s. Estimated remaining: 2h 35m 32s. Rate: 7.1 symbols/min [2025-11-03T19:57:51.673251] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:57:51.677810] [DEBUG] [LOCAL ] LOCL: Loaded 3274 existing records from primary storage. [2025-11-03T19:57:51.677975] [INFO ] [MAIN ] LOCL: Loaded 3274 existing records. [2025-11-03T19:57:51.859684] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:57:51.860126] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-11-03T19:57:51.860216] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-11-03T19:57:51.860583] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-11-03T19:57:51.860716] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-11-03T19:57:51.939980] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-11-03T19:57:52.219375] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:57:52.734821] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-11-03T19:57:52.787414] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-11-03T19:57:52.873871] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-11-03T19:57:53.534905] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-11-03T19:57:54.020268] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-11-03T19:57:54.334847] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-11-03T19:57:54.374598] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T19:57:55.134864] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-11-03T19:57:55.811912] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-11-03T19:57:55.934867] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-11-03T19:57:56.133064] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-11-03T19:57:56.734864] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-11-03T19:57:57.032701] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-11-03T19:57:57.335270] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-11-03T19:57:57.534855] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-11-03T19:57:58.334865] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-11-03T19:57:58.547445] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-11-03T19:57:59.134877] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-11-03T19:57:59.732169] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-11-03T19:57:59.934864] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-11. [2025-11-03T19:58:00.269781] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-11-03T19:58:00.734901] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-11-03T19:58:01.095273] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-11 (1.16 seconds). [2025-11-03T19:58:01.096827] [INFO ] [REMOTE ] LNG: Full fetch complete (74616 records). [2025-11-03T19:58:01.096964] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-11-03T19:58:01.541053] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-11-03T19:58:01.544755] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-11-03T19:58:01.544998] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-11-03T19:58:01.546574] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-11-03T19:58:01.546813] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-11-03T19:58:01.548864] [DEBUG] [LOCAL ] LNG: Trimmed 74616 records to 50954 (keeping 200 days of data) [2025-11-03T19:58:01.837995] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-11-03T19:58:01.842126] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-11-03T19:58:01.927495] [DEBUG] [LOCAL ] LNG: Primary data saved (50954 records). [2025-11-03T19:58:01.927676] [INFO ] [MAIN ] LNG: Full history saved. [2025-11-03T19:58:01.928669] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LNG took 34.7s. Estimated remaining: 2h 35m 25s. Rate: 7.1 symbols/min [2025-11-03T19:58:02.111340] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:02.144046] [DEBUG] [LOCAL ] LOMA: Loaded 33846 existing records from primary storage. [2025-11-03T19:58:02.144308] [INFO ] [MAIN ] LOMA: Loaded 33846 existing records. [2025-11-03T19:58:02.321025] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:02.321252] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-11-03T19:58:02.321312] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-11-03T19:58:02.322139] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-11-03T19:58:02.322197] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-11-03T19:58:02.343380] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-11-03T19:58:02.689091] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-11-03T19:58:02.688942] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:03.134920] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-11-03T19:58:03.934929] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-11-03T19:58:04.174935] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T19:58:04.459777] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-11-03T19:58:04.734938] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-11-03T19:58:05.534933] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-11-03T19:58:05.575973] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-11-03T19:58:06.334875] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-11-03T19:58:06.605753] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-11-03T19:58:06.627362] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-11-03T19:58:07.134876] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-11-03T19:58:07.394381] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-11-03T19:58:07.934855] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-11. [2025-11-03T19:58:08.734822] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-11-03T19:58:08.789620] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-11 (0.85 seconds). [2025-11-03T19:58:08.790919] [INFO ] [REMOTE ] LOAR: Full fetch complete (56011 records). [2025-11-03T19:58:08.791007] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-11-03T19:58:09.213992] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-11-03T19:58:09.214330] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-11-03T19:58:09.215295] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-11-03T19:58:09.215365] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-11-03T19:58:09.216895] [DEBUG] [LOCAL ] LOAR: Trimmed 56011 records to 41332 (keeping 200 days of data) [2025-11-03T19:58:09.469277] [DEBUG] [LOCAL ] LOAR: Primary data saved (41332 records). [2025-11-03T19:58:09.469408] [INFO ] [MAIN ] LOAR: Full history saved. [2025-11-03T19:58:09.469487] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LOAR took 38.6s. Estimated remaining: 2h 35m 16s. Rate: 7.1 symbols/min [2025-11-03T19:58:09.542495] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-11-03T19:58:09.655099] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:09.674424] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-11-03T19:58:09.724555] [DEBUG] [LOCAL ] LOW: Loaded 53672 existing records from primary storage. [2025-11-03T19:58:09.724879] [INFO ] [MAIN ] LOW: Loaded 53672 existing records. [2025-11-03T19:58:09.906995] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:09.907219] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-11-03T19:58:09.907267] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-11-03T19:58:09.908377] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-11-03T19:58:09.908439] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-11-03T19:58:10.264354] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:10.334824] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-11-03T19:58:10.578840] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T19:58:11.134866] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-11-03T19:58:11.513344] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-11-03T19:58:11.771899] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-11-03T19:58:11.934880] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-11-03T19:58:12.734906] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-11-03T19:58:12.951839] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-11-03T19:58:13.534889] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-11-03T19:58:13.940778] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-11-03T19:58:14.292372] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-11-03T19:58:14.334830] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-11-03T19:58:15.134861] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-11-03T19:58:15.531740] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-11-03T19:58:15.805437] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-11-03T19:58:15.934862] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-11-03T19:58:16.734871] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-11-03T19:58:17.452697] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-11-03T19:58:17.518369] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-11-03T19:58:17.534818] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-11-03T19:58:18.334878] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-11-03T19:58:18.454768] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-11-03T19:58:18.765919] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-11-03T19:58:19.134854] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-11. [2025-11-03T19:58:19.510851] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-11 (0.38 seconds). [2025-11-03T19:58:19.511504] [INFO ] [REMOTE ] LOCL: Full fetch complete (4588 records). [2025-11-03T19:58:19.511570] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-11-03T19:58:19.886692] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-11-03T19:58:19.886775] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-11-03T19:58:19.886909] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-11-03T19:58:19.886957] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-11-03T19:58:19.887384] [DEBUG] [LOCAL ] LOCL: Trimmed 4588 records to 3217 (keeping 200 days of data) [2025-11-03T19:58:19.905538] [DEBUG] [LOCAL ] LOCL: Primary data saved (3217 records). [2025-11-03T19:58:19.905691] [INFO ] [MAIN ] LOCL: Full history saved. [2025-11-03T19:58:19.905799] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LOCL took 28.4s. Estimated remaining: 2h 35m 9s. Rate: 7.1 symbols/min [2025-11-03T19:58:19.938038] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-11-03T19:58:20.078509] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:20.112883] [DEBUG] [LOCAL ] LPG: Loaded 39088 existing records from primary storage. [2025-11-03T19:58:20.113172] [INFO ] [MAIN ] LPG: Loaded 39088 existing records. [2025-11-03T19:58:20.288693] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:20.288924] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-11-03T19:58:20.288972] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-11-03T19:58:20.289684] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-11-03T19:58:20.289741] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-11-03T19:58:20.648310] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:20.734855] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-11-03T19:58:21.534829] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-11-03T19:58:21.650017] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-11-03T19:58:22.074307] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-11-03T19:58:22.334850] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-11-03T19:58:22.412485] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-11-03T19:58:23.134852] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-11-03T19:58:23.673829] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-11-03T19:58:23.934839] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-11-03T19:58:24.165703] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-11-03T19:58:24.734912] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-11-03T19:58:24.968883] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-11-03T19:58:25.534898] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-11-03T19:58:25.888960] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-11-03T19:58:26.334876] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-11-03T19:58:27.095731] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-11-03T19:58:27.134813] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-11-03T19:58:27.330544] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-11-03T19:58:27.934891] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-11-03T19:58:28.492398] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-11-03T19:58:28.734913] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-11-03T19:58:29.167300] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-11-03T19:58:29.490333] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-11-03T19:58:29.534823] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-11-03T19:58:30.320942] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-11-03T19:58:30.334819] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-11-03T19:58:31.134860] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-11-03T19:58:31.481169] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-11-03T19:58:31.934852] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-11-03T19:58:32.259737] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-11-03T19:58:32.734853] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-11-03T19:58:33.172072] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-11-03T19:58:33.534815] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-11-03T19:58:33.569636] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-11-03T19:58:34.334850] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-11-03T19:58:34.604201] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-11-03T19:58:35.126449] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-11-03T19:58:35.134809] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-11-03T19:58:35.934916] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-11. [2025-11-03T19:58:36.167287] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-11-03T19:58:36.734849] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-11-03T19:58:36.924600] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-11 (0.99 seconds). [2025-11-03T19:58:36.926380] [INFO ] [REMOTE ] LOMA: Full fetch complete (48499 records). [2025-11-03T19:58:36.926476] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-11-03T19:58:37.303554] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-11-03T19:58:37.303692] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-11-03T19:58:37.304605] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-11-03T19:58:37.304833] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-11-03T19:58:37.306020] [DEBUG] [LOCAL ] LOMA: Trimmed 48499 records to 33555 (keeping 200 days of data) [2025-11-03T19:58:37.499988] [DEBUG] [LOCAL ] LOMA: Primary data saved (33555 records). [2025-11-03T19:58:37.500126] [INFO ] [MAIN ] LOMA: Full history saved. [2025-11-03T19:58:37.500209] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LOMA took 35.6s. Estimated remaining: 2h 35m 9s. Rate: 7.1 symbols/min [2025-11-03T19:58:37.543523] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-11-03T19:58:37.678348] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:37.704793] [DEBUG] [LOCAL ] LPL: Loaded 29901 existing records from primary storage. [2025-11-03T19:58:37.705079] [INFO ] [MAIN ] LPL: Loaded 29901 existing records. [2025-11-03T19:58:37.880590] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:37.880838] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-11-03T19:58:37.880887] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-11-03T19:58:37.881400] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-11-03T19:58:37.881458] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-11-03T19:58:38.248755] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:38.284435] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-11-03T19:58:38.334813] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-11-03T19:58:38.395893] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-11-03T19:58:39.134909] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-11-03T19:58:39.844456] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-11-03T19:58:39.871385] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-11-03T19:58:39.934851] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-11-03T19:58:40.627248] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-11-03T19:58:40.734852] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-11-03T19:58:41.534842] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-11. [2025-11-03T19:58:41.735538] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-11-03T19:58:42.334880] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-11-03T19:58:42.685716] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-11 (1.15 seconds). [2025-11-03T19:58:42.687203] [INFO ] [REMOTE ] LOW: Full fetch complete (76668 records). [2025-11-03T19:58:42.687291] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-11-03T19:58:43.080467] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-11-03T19:58:43.080543] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-11-03T19:58:43.081514] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-11-03T19:58:43.081575] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-11-03T19:58:43.082958] [DEBUG] [LOCAL ] LOW: Trimmed 76668 records to 52907 (keeping 200 days of data) [2025-11-03T19:58:43.139960] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-11-03T19:58:43.417210] [DEBUG] [LOCAL ] LOW: Primary data saved (52907 records). [2025-11-03T19:58:43.417371] [INFO ] [MAIN ] LOW: Full history saved. [2025-11-03T19:58:43.417709] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LOW took 33.9s. Estimated remaining: 2h 34m 58s. Rate: 7.1 symbols/min [2025-11-03T19:58:43.569242] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-11-03T19:58:43.626908] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:43.660912] [DEBUG] [LOCAL ] LPX: Loaded 40389 existing records from primary storage. [2025-11-03T19:58:43.661205] [INFO ] [MAIN ] LPX: Loaded 40389 existing records. [2025-11-03T19:58:43.839401] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:43.839699] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-11-03T19:58:43.839874] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-11-03T19:58:43.840627] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-11-03T19:58:43.840714] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-11-03T19:58:43.942131] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-11-03T19:58:44.039341] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-11-03T19:58:44.227511] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:44.734879] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-11. [2025-11-03T19:58:44.762850] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-11-03T19:58:45.534890] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-11-03T19:58:45.539268] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-11 (0.80 seconds). [2025-11-03T19:58:45.540296] [INFO ] [REMOTE ] LOB: Full fetch complete (38812 records). [2025-11-03T19:58:45.540369] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-11-03T19:58:45.918466] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-11-03T19:58:45.918551] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-11-03T19:58:45.919325] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-11-03T19:58:45.919390] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-11-03T19:58:45.920361] [DEBUG] [LOCAL ] LOB: Trimmed 38812 records to 25890 (keeping 200 days of data) [2025-11-03T19:58:46.070970] [DEBUG] [LOCAL ] LOB: Primary data saved (25890 records). [2025-11-03T19:58:46.071092] [INFO ] [MAIN ] LOB: Full history saved. [2025-11-03T19:58:46.071166] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOB took 56.5s. Estimated remaining: 2h 34m 45s. Rate: 7.1 symbols/min [2025-11-03T19:58:46.239187] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:46.275543] [DEBUG] [LOCAL ] LRN: Loaded 39921 existing records from primary storage. [2025-11-03T19:58:46.275860] [INFO ] [MAIN ] LRN: Loaded 39921 existing records. [2025-11-03T19:58:46.340044] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-11-03T19:58:46.451912] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:46.452139] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-11-03T19:58:46.452188] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-11-03T19:58:46.452882] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-11-03T19:58:46.452941] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-11-03T19:58:46.810427] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:46.837479] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-11-03T19:58:47.134854] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-11-03T19:58:47.240910] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-11-03T19:58:47.934903] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-11-03T19:58:48.347103] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-11-03T19:58:48.649830] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-11-03T19:58:48.734849] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-11-03T19:58:49.446762] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-11-03T19:58:49.534889] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-11-03T19:58:50.340333] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-11-03T19:58:50.342217] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-11-03T19:58:51.134866] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-11-03T19:58:51.370982] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-11-03T19:58:51.934914] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-11-03T19:58:52.251232] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-11-03T19:58:52.734886] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-11. [2025-11-03T19:58:53.006178] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-11-03T19:58:53.534842] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-11-03T19:58:53.543496] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-11 (0.81 seconds). [2025-11-03T19:58:53.544877] [INFO ] [REMOTE ] LPG: Full fetch complete (58347 records). [2025-11-03T19:58:53.544957] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-11-03T19:58:53.922798] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-11-03T19:58:53.922916] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-11-03T19:58:53.924537] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-11-03T19:58:53.924599] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-11-03T19:58:53.925836] [DEBUG] [LOCAL ] LPG: Trimmed 58347 records to 38514 (keeping 200 days of data) [2025-11-03T19:58:54.179368] [DEBUG] [LOCAL ] LPG: Primary data saved (38514 records). [2025-11-03T19:58:54.179554] [INFO ] [MAIN ] LPG: Full history saved. [2025-11-03T19:58:54.179682] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LPG took 34.3s. Estimated remaining: 2h 34m 36s. Rate: 7.1 symbols/min [2025-11-03T19:58:54.347892] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:58:54.345221] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-11-03T19:58:54.386851] [DEBUG] [LOCAL ] LSPD: Loaded 42577 existing records from primary storage. [2025-11-03T19:58:54.387175] [INFO ] [MAIN ] LSPD: Loaded 42577 existing records. [2025-11-03T19:58:54.564003] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:58:54.564271] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-11-03T19:58:54.564349] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-11-03T19:58:54.565125] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-11-03T19:58:54.565182] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-11-03T19:58:54.927131] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-11-03T19:58:54.962849] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:58:55.134837] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-11-03T19:58:55.526035] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-11-03T19:58:55.934868] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-11-03T19:58:56.605517] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-11-03T19:58:56.734858] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-11-03T19:58:56.951678] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-11-03T19:58:57.534861] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-11-03T19:58:57.881384] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-11-03T19:58:58.334872] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-11-03T19:58:58.647077] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-11-03T19:58:59.134924] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-11-03T19:58:59.602444] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-11-03T19:58:59.934950] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-11-03T19:59:00.325701] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-11-03T19:59:00.734892] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-11-03T19:59:01.121862] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-11-03T19:59:01.534957] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-11. [2025-11-03T19:59:01.777244] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-11-03T19:59:02.334867] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-11-03T19:59:02.568033] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-11 (1.03 seconds). [2025-11-03T19:59:02.569222] [INFO ] [REMOTE ] LPL: Full fetch complete (38835 records). [2025-11-03T19:59:02.569299] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-11-03T19:59:02.950846] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-11-03T19:59:02.950935] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-11-03T19:59:02.951677] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-11-03T19:59:02.951741] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-11-03T19:59:02.952769] [DEBUG] [LOCAL ] LPL: Trimmed 38835 records to 29628 (keeping 200 days of data) [2025-11-03T19:59:03.118789] [DEBUG] [LOCAL ] LPL: Primary data saved (29628 records). [2025-11-03T19:59:03.118944] [INFO ] [MAIN ] LPL: Full history saved. [2025-11-03T19:59:03.119031] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LPL took 25.6s. Estimated remaining: 2h 34m 28s. Rate: 7.1 symbols/min [2025-11-03T19:59:03.141693] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-11-03T19:59:03.310603] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:59:03.338676] [DEBUG] [LOCAL ] LTC: Loaded 30925 existing records from primary storage. [2025-11-03T19:59:03.338955] [INFO ] [MAIN ] LTC: Loaded 30925 existing records. [2025-11-03T19:59:03.532436] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:59:03.533000] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-11-03T19:59:03.533134] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-11-03T19:59:03.533964] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-11-03T19:59:03.534234] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-11-03T19:59:03.632115] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-11-03T19:59:03.941570] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-11-03T19:59:03.963852] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-17 to 2025-11-03 (requires 11 months of data pull). [2025-11-03T19:59:04.525891] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-11-03T19:59:04.734889] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-11-03T19:59:05.271264] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-11-03T19:59:05.534862] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-11-03T19:59:05.907923] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-11-03T19:59:06.334836] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-11-03T19:59:06.588813] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-11-03T19:59:07.134880] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-11-03T19:59:07.484074] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-11-03T19:59:07.934918] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-11-03T19:59:08.175525] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-11-03T19:59:08.734938] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-11-03T19:59:09.151114] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-11-03T19:59:09.534849] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-11-03T19:59:09.835488] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-11-03T19:59:10.334851] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-11-03T19:59:10.600554] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-11-03T19:59:11.134918] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-11-03T19:59:11.480782] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-11-03T19:59:11.935562] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-11-03T19:59:11.935678] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-11-03T19:59:12.734882] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-11. [2025-11-03T19:59:13.134023] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-11-03T19:59:13.534852] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-11-03T19:59:13.610705] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-11 (0.88 seconds). [2025-11-03T19:59:13.611931] [INFO ] [REMOTE ] LPX: Full fetch complete (58356 records). [2025-11-03T19:59:13.612004] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-11-03T19:59:14.001474] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-11-03T19:59:14.001568] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-11-03T19:59:14.002416] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-11-03T19:59:14.002478] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-11-03T19:59:14.003587] [DEBUG] [LOCAL ] LPX: Trimmed 58356 records to 39961 (keeping 200 days of data) [2025-11-03T19:59:14.239941] [DEBUG] [LOCAL ] LPX: Primary data saved (39961 records). [2025-11-03T19:59:14.240080] [INFO ] [MAIN ] LPX: Full history saved. [2025-11-03T19:59:14.240156] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LPX took 30.8s. Estimated remaining: 2h 34m 22s. Rate: 7.1 symbols/min [2025-11-03T19:59:14.339940] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-11-03T19:59:14.418140] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-24 to 2025-11-03. [2025-11-03T19:59:14.470094] [DEBUG] [LOCAL ] LTH: Loaded 52270 existing records from primary storage. [2025-11-03T19:59:14.470461] [INFO ] [MAIN ] LTH: Loaded 52270 existing records. [2025-11-03T19:59:14.698031] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-14, but need from 2025-01-17 for 200 day retention. Performing full refresh. [2025-11-03T19:59:14.698353] [INFO ] [MAIN ] LTH: Wiping exis